2023-12-17T11:28:41.124 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-17T11:28:41.124 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/kernel_untar_build}} --archive /home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495186 --name rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi --verbose --owner scheduled_rishabh@teuthology -- /home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495186/orig.config.yaml 2023-12-17T11:28:41.171 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-17T11:28:41.253 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495186 branch: rishabh-2023dec11 description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/kernel_untar_build}} email: null first_in_suite: false job_id: '7495186' kernel: flavor: default kdb: true sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: rishabh-2023dec11 ceph: cephfs: max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request sha1: a62fda73efba5520d409bb5a21bd8373289dda5d subvols: create: 2 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.dir_split install: ceph: flavor: default sha1: a62fda73efba5520d409bb5a21bd8373289dda5d kclient: client.0: mount_subvol_num: 1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-2023dec11 sha1: a62fda73efba5520d409bb5a21bd8373289dda5d owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 5791 sha1: a62fda73efba5520d409bb5a21bd8373289dda5d sleep_before_teardown: 0 subset: 209/512 suite: fs suite_branch: rishabh-2023dec11 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a62fda73efba5520d409bb5a21bd8373289dda5d/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a62fda73efba5520d409bb5a21bd8373289dda5d syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi008.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOX94aMeRrAKfYj3aVLUbfkXRSEVAi4taiUJYa9mnBG81kycTeEXy3BI1pxu1B8kLXQq/pzkn0FyYtX96RaDplw= smithi100.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJbs4lzcAzApz1BJNzcKvPKXHFEKi9kRHbWImBeDT0Cp+gzkn5ZsY9c4eqJm6PaBiuO/hpo1LxYWQVFdF5rq+LU= smithi186.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPhO1Ffo4DoojJMi/vqST8+CWXg8BJFJlMJgLpjrHSk/KG4AGUy+kCQnllGrmpkYVEYgL+uZLxEZ8+FqnZPxkMw= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - ceph-fuse: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - kernel_untar_build.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73 timestamp: 2023-12-17_11:19:43 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078 2023-12-17T11:28:41.253 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a62fda73efba5520d409bb5a21bd8373289dda5d/qa; will attempt to use it 2023-12-17T11:28:41.254 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a62fda73efba5520d409bb5a21bd8373289dda5d/qa/tasks 2023-12-17T11:28:41.254 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-17T11:28:41.255 INFO:teuthology.task.internal:Checking packages... 2023-12-17T11:28:41.277 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'a62fda73efba5520d409bb5a21bd8373289dda5d' 2023-12-17T11:28:41.277 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-17T11:28:41.277 INFO:teuthology.packaging:ref: None 2023-12-17T11:28:41.277 INFO:teuthology.packaging:tag: None 2023-12-17T11:28:41.278 INFO:teuthology.packaging:branch: rishabh-2023dec11 2023-12-17T11:28:41.278 INFO:teuthology.packaging:sha1: a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-17T11:28:41.278 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=rishabh-2023dec11 2023-12-17T11:28:41.494 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-119.ga62fda73 2023-12-17T11:28:41.495 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-17T11:28:41.502 INFO:teuthology.task.internal:no buildpackages task found 2023-12-17T11:28:41.502 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-17T11:28:41.521 INFO:teuthology.task.internal:Saving configuration 2023-12-17T11:28:41.539 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-17T11:28:41.547 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-17T11:28:41.567 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi008.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495186', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-17 11:21:31.545159', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOX94aMeRrAKfYj3aVLUbfkXRSEVAi4taiUJYa9mnBG81kycTeEXy3BI1pxu1B8kLXQq/pzkn0FyYtX96RaDplw='} 2023-12-17T11:28:41.590 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495186', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-17 11:21:31.543191', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJbs4lzcAzApz1BJNzcKvPKXHFEKi9kRHbWImBeDT0Cp+gzkn5ZsY9c4eqJm6PaBiuO/hpo1LxYWQVFdF5rq+LU='} 2023-12-17T11:28:41.616 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495186', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-17 11:21:31.546922', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPhO1Ffo4DoojJMi/vqST8+CWXg8BJFJlMJgLpjrHSk/KG4AGUy+kCQnllGrmpkYVEYgL+uZLxEZ8+FqnZPxkMw='} 2023-12-17T11:28:41.616 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-17T11:28:41.624 INFO:teuthology.task.internal:roles: ubuntu@smithi008.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-12-17T11:28:41.624 INFO:teuthology.task.internal:roles: ubuntu@smithi100.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-12-17T11:28:41.624 INFO:teuthology.task.internal:roles: ubuntu@smithi186.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-12-17T11:28:41.624 INFO:teuthology.run_tasks:Running task console_log... 2023-12-17T11:28:41.717 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f0f792e2dc0>, signals=[15]) 2023-12-17T11:28:41.717 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-17T11:28:41.725 INFO:teuthology.task.internal:Opening connections... 2023-12-17T11:28:41.725 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi008.front.sepia.ceph.com 2023-12-17T11:28:41.726 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:28:41.794 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi100.front.sepia.ceph.com 2023-12-17T11:28:41.795 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:28:41.860 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi186.front.sepia.ceph.com 2023-12-17T11:28:41.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:28:41.925 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-17T11:28:41.932 DEBUG:teuthology.orchestra.run.smithi008:> uname -m 2023-12-17T11:28:41.953 INFO:teuthology.orchestra.run.smithi008.stdout:x86_64 2023-12-17T11:28:41.953 DEBUG:teuthology.orchestra.run.smithi008:> cat /etc/os-release 2023-12-17T11:28:42.014 INFO:teuthology.orchestra.run.smithi008.stdout:NAME="Red Hat Enterprise Linux" 2023-12-17T11:28:42.014 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION="8.6 (Ootpa)" 2023-12-17T11:28:42.014 INFO:teuthology.orchestra.run.smithi008.stdout:ID="rhel" 2023-12-17T11:28:42.014 INFO:teuthology.orchestra.run.smithi008.stdout:ID_LIKE="fedora" 2023-12-17T11:28:42.014 INFO:teuthology.orchestra.run.smithi008.stdout:VERSION_ID="8.6" 2023-12-17T11:28:42.015 INFO:teuthology.orchestra.run.smithi008.stdout:PLATFORM_ID="platform:el8" 2023-12-17T11:28:42.015 INFO:teuthology.orchestra.run.smithi008.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-17T11:28:42.015 INFO:teuthology.orchestra.run.smithi008.stdout:ANSI_COLOR="0;31" 2023-12-17T11:28:42.015 INFO:teuthology.orchestra.run.smithi008.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-17T11:28:42.015 INFO:teuthology.orchestra.run.smithi008.stdout:HOME_URL="https://www.redhat.com/" 2023-12-17T11:28:42.015 INFO:teuthology.orchestra.run.smithi008.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-17T11:28:42.015 INFO:teuthology.orchestra.run.smithi008.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-17T11:28:42.015 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T11:28:42.015 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-17T11:28:42.015 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-17T11:28:42.015 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-17T11:28:42.015 INFO:teuthology.orchestra.run.smithi008.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-17T11:28:42.016 INFO:teuthology.lock.ops:Updating smithi008.front.sepia.ceph.com on lock server 2023-12-17T11:28:42.036 DEBUG:teuthology.orchestra.run.smithi100:> uname -m 2023-12-17T11:28:42.056 INFO:teuthology.orchestra.run.smithi100.stdout:x86_64 2023-12-17T11:28:42.056 DEBUG:teuthology.orchestra.run.smithi100:> cat /etc/os-release 2023-12-17T11:28:42.115 INFO:teuthology.orchestra.run.smithi100.stdout:NAME="Red Hat Enterprise Linux" 2023-12-17T11:28:42.115 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION="8.6 (Ootpa)" 2023-12-17T11:28:42.115 INFO:teuthology.orchestra.run.smithi100.stdout:ID="rhel" 2023-12-17T11:28:42.116 INFO:teuthology.orchestra.run.smithi100.stdout:ID_LIKE="fedora" 2023-12-17T11:28:42.116 INFO:teuthology.orchestra.run.smithi100.stdout:VERSION_ID="8.6" 2023-12-17T11:28:42.116 INFO:teuthology.orchestra.run.smithi100.stdout:PLATFORM_ID="platform:el8" 2023-12-17T11:28:42.116 INFO:teuthology.orchestra.run.smithi100.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-17T11:28:42.116 INFO:teuthology.orchestra.run.smithi100.stdout:ANSI_COLOR="0;31" 2023-12-17T11:28:42.116 INFO:teuthology.orchestra.run.smithi100.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-17T11:28:42.116 INFO:teuthology.orchestra.run.smithi100.stdout:HOME_URL="https://www.redhat.com/" 2023-12-17T11:28:42.116 INFO:teuthology.orchestra.run.smithi100.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-17T11:28:42.116 INFO:teuthology.orchestra.run.smithi100.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-17T11:28:42.116 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-17T11:28:42.116 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-17T11:28:42.116 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-17T11:28:42.116 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-17T11:28:42.116 INFO:teuthology.orchestra.run.smithi100.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-17T11:28:42.117 INFO:teuthology.lock.ops:Updating smithi100.front.sepia.ceph.com on lock server 2023-12-17T11:28:42.134 DEBUG:teuthology.orchestra.run.smithi186:> uname -m 2023-12-17T11:28:42.156 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64 2023-12-17T11:28:42.157 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2023-12-17T11:28:42.215 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="Red Hat Enterprise Linux" 2023-12-17T11:28:42.215 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8.6 (Ootpa)" 2023-12-17T11:28:42.215 INFO:teuthology.orchestra.run.smithi186.stdout:ID="rhel" 2023-12-17T11:28:42.215 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="fedora" 2023-12-17T11:28:42.215 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8.6" 2023-12-17T11:28:42.215 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8" 2023-12-17T11:28:42.216 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-12-17T11:28:42.216 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2023-12-17T11:28:42.216 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-12-17T11:28:42.216 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://www.redhat.com/" 2023-12-17T11:28:42.216 INFO:teuthology.orchestra.run.smithi186.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-12-17T11:28:42.216 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-17T11:28:42.216 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-12-17T11:28:42.216 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-12-17T11:28:42.216 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-12-17T11:28:42.216 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-12-17T11:28:42.216 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-12-17T11:28:42.216 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2023-12-17T11:28:42.234 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-17T11:28:42.246 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-17T11:28:42.257 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-17T11:28:42.257 DEBUG:teuthology.orchestra.run.smithi008:> test '!' -e /home/ubuntu/cephtest 2023-12-17T11:28:42.260 DEBUG:teuthology.orchestra.run.smithi100:> test '!' -e /home/ubuntu/cephtest 2023-12-17T11:28:42.262 DEBUG:teuthology.orchestra.run.smithi186:> test '!' -e /home/ubuntu/cephtest 2023-12-17T11:28:42.281 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-17T11:28:42.292 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-17T11:28:42.292 DEBUG:teuthology.orchestra.run.smithi008:> test -z $(ls -A /var/lib/ceph) 2023-12-17T11:28:42.321 DEBUG:teuthology.orchestra.run.smithi100:> test -z $(ls -A /var/lib/ceph) 2023-12-17T11:28:42.323 DEBUG:teuthology.orchestra.run.smithi186:> test -z $(ls -A /var/lib/ceph) 2023-12-17T11:28:42.358 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-17T11:28:42.432 INFO:teuthology.run_tasks:Running task kernel... 2023-12-17T11:28:42.448 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'} 2023-12-17T11:28:42.448 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}, 'mon.c': {'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}}, timeout 300 2023-12-17T11:28:42.448 DEBUG:teuthology.orchestra.run.smithi008:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-17T11:28:42.449 DEBUG:teuthology.orchestra.run.smithi100:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-17T11:28:42.449 DEBUG:teuthology.orchestra.run.smithi186:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-17T11:28:42.467 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-17T11:28:42.468 DEBUG:teuthology.task.kernel:sha1 for mon.b is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-17T11:28:42.468 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-17T11:28:42.468 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2023-12-17T11:28:42.469 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-17T11:28:42.469 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-17T11:28:42.470 DEBUG:teuthology.task.kernel:sha1 for mon.a is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-17T11:28:42.470 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-17T11:28:42.470 DEBUG:teuthology.orchestra.run.smithi008:> uname -r 2023-12-17T11:28:42.470 DEBUG:teuthology.task.kernel:sha1 for mon.c is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-17T11:28:42.470 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-17T11:28:42.470 DEBUG:teuthology.orchestra.run.smithi186:> uname -r 2023-12-17T11:28:42.526 INFO:teuthology.orchestra.run.smithi186.stdout:4.18.0-513.9.1.el8_9.x86_64 2023-12-17T11:28:42.526 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-513.9.1.el8_9.x86_64 vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-17T11:28:42.527 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-17T11:28:42.527 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-17T11:28:42.530 INFO:teuthology.orchestra.run.smithi100.stdout:4.18.0-513.9.1.el8_9.x86_64 2023-12-17T11:28:42.530 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-513.9.1.el8_9.x86_64 vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-17T11:28:42.530 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-17T11:28:42.531 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-17T11:28:42.533 INFO:teuthology.orchestra.run.smithi008.stdout:4.18.0-513.9.1.el8_9.x86_64 2023-12-17T11:28:42.534 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-513.9.1.el8_9.x86_64 vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-17T11:28:42.534 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-17T11:28:42.534 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-17T11:28:42.668 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum upgrade -y linux-firmware 2023-12-17T11:28:42.682 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum upgrade -y linux-firmware 2023-12-17T11:28:42.683 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum upgrade -y linux-firmware 2023-12-17T11:28:44.120 INFO:teuthology.orchestra.run.smithi100.stdout:Updating Subscription Management repositories. 2023-12-17T11:28:44.120 INFO:teuthology.orchestra.run.smithi100.stdout:Unable to read consumer identity 2023-12-17T11:28:44.122 INFO:teuthology.orchestra.run.smithi186.stdout:Updating Subscription Management repositories. 2023-12-17T11:28:44.122 INFO:teuthology.orchestra.run.smithi186.stdout:Unable to read consumer identity 2023-12-17T11:28:44.230 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-12-17T11:28:44.230 INFO:teuthology.orchestra.run.smithi186.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2023-12-17T11:28:44.230 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-12-17T11:28:44.248 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-12-17T11:28:44.248 INFO:teuthology.orchestra.run.smithi008.stdout:Unable to read consumer identity 2023-12-17T11:28:44.264 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-17T11:28:44.265 INFO:teuthology.orchestra.run.smithi100.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2023-12-17T11:28:44.265 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-17T11:28:44.350 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T11:28:44.350 INFO:teuthology.orchestra.run.smithi008.stdout:This system is not registered with an entitlement server. You can use subscription-manager to register. 2023-12-17T11:28:44.350 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T11:28:45.960 INFO:teuthology.orchestra.run.smithi186.stdout:Copr repo for python3-asyncssh owned by ceph 19 kB/s | 3.5 kB 00:00 2023-12-17T11:28:45.968 INFO:teuthology.orchestra.run.smithi100.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2023-12-17T11:28:46.023 INFO:teuthology.orchestra.run.smithi008.stdout:Copr repo for python3-asyncssh owned by ceph 26 kB/s | 3.5 kB 00:00 2023-12-17T11:28:47.026 INFO:teuthology.orchestra.run.smithi008.stdout:Extra Packages for Enterprise Linux 17 MB/s | 16 MB 00:00 2023-12-17T11:28:47.119 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 14 MB/s | 16 MB 00:01 2023-12-17T11:28:47.877 INFO:teuthology.orchestra.run.smithi186.stdout:Extra Packages for Enterprise Linux 8.5 MB/s | 16 MB 00:01 2023-12-17T11:28:50.677 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 448 kB/s | 24 kB 00:00 2023-12-17T11:28:50.957 INFO:teuthology.orchestra.run.smithi008.stdout:lab-extras 419 kB/s | 24 kB 00:00 2023-12-17T11:28:51.039 INFO:teuthology.orchestra.run.smithi008.stdout:Last metadata expiration check: 0:00:01 ago on Sun 17 Dec 2023 11:28:50 AM UTC. 2023-12-17T11:28:51.402 INFO:teuthology.orchestra.run.smithi186.stdout:lab-extras 466 kB/s | 24 kB 00:00 2023-12-17T11:28:51.477 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2023-12-17T11:28:51.478 INFO:teuthology.orchestra.run.smithi100.stdout:Nothing to do. 2023-12-17T11:28:51.478 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2023-12-17T11:28:51.606 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on mon.b... 2023-12-17T11:28:51.606 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-17T11:28:51.816 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-12-17T11:28:51.818 INFO:teuthology.orchestra.run.smithi008.stdout:Nothing to do. 2023-12-17T11:28:51.818 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-12-17T11:28:51.907 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/8/flavors/default/x86_64/ 2023-12-17T11:28:51.907 DEBUG:teuthology.orchestra.run.smithi100:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/8/flavors/default/x86_64/ --input-file=- 2023-12-17T11:28:51.910 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi100.front.sepia.ceph.com to complete... 2023-12-17T11:28:51.958 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on mon.a... 2023-12-17T11:28:51.958 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-17T11:28:52.098 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/8/flavors/default/x86_64/ 2023-12-17T11:28:52.098 DEBUG:teuthology.orchestra.run.smithi008:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/8/flavors/default/x86_64/ --input-file=- 2023-12-17T11:28:52.100 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi008.front.sepia.ceph.com to complete... 2023-12-17T11:28:52.196 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2023-12-17T11:28:52.197 INFO:teuthology.orchestra.run.smithi186.stdout:Nothing to do. 2023-12-17T11:28:52.198 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2023-12-17T11:28:52.340 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on mon.c... 2023-12-17T11:28:52.340 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-17T11:28:52.486 INFO:teuthology.task.kernel:fetching, builder baseurl is https://1.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/8/flavors/default/x86_64/ 2023-12-17T11:28:52.486 DEBUG:teuthology.orchestra.run.smithi186:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://1.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/8/flavors/default/x86_64/ --input-file=- 2023-12-17T11:28:52.489 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi186.front.sepia.ceph.com to complete... 2023-12-17T11:31:12.495 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17 11:31:12 URL:https://1.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/8/flavors/default/x86_64/kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm [383180176/383180176] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-17T11:31:12.495 INFO:teuthology.orchestra.run.smithi100.stderr:FINISHED --2023-12-17 11:31:12-- 2023-12-17T11:31:12.495 INFO:teuthology.orchestra.run.smithi100.stderr:Total wall clock time: 2m 21s 2023-12-17T11:31:12.496 INFO:teuthology.orchestra.run.smithi100.stderr:Downloaded: 1 files, 365M in 2m 20s (2.61 MB/s) 2023-12-17T11:31:12.498 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on mon.b... 2023-12-17T11:31:12.499 DEBUG:teuthology.orchestra.run.smithi100:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-17T11:31:14.281 INFO:teuthology.orchestra.run.smithi100.stdout:Verifying... ######################################## 2023-12-17T11:31:14.367 INFO:teuthology.orchestra.run.smithi100.stdout:Preparing... ######################################## 2023-12-17T11:31:14.512 INFO:teuthology.orchestra.run.smithi100.stdout:Updating / installing... 2023-12-17T11:31:52.854 INFO:teuthology.orchestra.run.smithi100.stdout:kernel-6.6.0_gcd68252d7b4d-1 ######################################## 2023-12-17T11:31:56.602 INFO:teuthology.orchestra.run.smithi100.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-17T11:32:15.754 INFO:teuthology.orchestra.run.smithi100.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-17T11:34:22.684 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi100.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-17T11:34:22.685 DEBUG:teuthology.orchestra.run.smithi100:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-17T11:34:22.744 INFO:teuthology.orchestra.run.smithi100.stdout:/boot/System.map-6.6.0-gcd68252d7b4d 2023-12-17T11:34:22.744 INFO:teuthology.orchestra.run.smithi100.stdout:/boot/config-6.6.0-gcd68252d7b4d 2023-12-17T11:34:22.744 INFO:teuthology.orchestra.run.smithi100.stdout:/boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-17T11:34:22.745 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d 2023-12-17T11:34:22.745 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel 2023-12-17T11:34:22.745 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch 2023-12-17T11:34:22.745 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86 2023-12-17T11:34:22.745 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto 2023-12-17T11:34:22.745 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-17T11:34:22.745 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-17T11:34:22.745 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-17T11:34:22.745 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-17T11:34:22.745 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-17T11:34:22.745 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-17T11:34:22.745 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-17T11:34:22.745 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-17T11:34:22.746 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-17T11:34:22.746 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-17T11:34:22.746 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-17T11:34:22.746 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-17T11:34:22.746 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-17T11:34:22.746 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-17T11:34:22.746 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-17T11:34:22.746 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-17T11:34:22.746 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-17T11:34:22.746 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-17T11:34:22.746 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-17T11:34:22.746 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-17T11:34:22.746 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel 2023-12-17T11:34:22.746 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu 2023-12-17T11:34:22.746 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce 2023-12-17T11:34:22.747 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-17T11:34:22.747 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm 2023-12-17T11:34:22.747 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-17T11:34:22.747 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-17T11:34:22.747 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-17T11:34:22.747 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto 2023-12-17T11:34:22.747 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-17T11:34:22.747 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-17T11:34:22.747 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-17T11:34:22.747 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx 2023-12-17T11:34:22.747 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-17T11:34:22.747 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-17T11:34:22.747 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-17T11:34:22.747 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-17T11:34:22.747 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-17T11:34:22.747 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-17T11:34:22.748 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-17T11:34:22.748 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-17T11:34:22.748 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-17T11:34:22.748 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-17T11:34:22.748 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-17T11:34:22.748 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-17T11:34:22.748 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-17T11:34:22.748 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-17T11:34:22.748 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-17T11:34:22.748 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-17T11:34:22.748 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-17T11:34:22.748 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-17T11:34:22.748 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-17T11:34:22.748 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-17T11:34:22.748 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-17T11:34:22.748 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-17T11:34:22.749 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-17T11:34:22.749 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-17T11:34:22.749 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-17T11:34:22.749 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-17T11:34:22.749 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-17T11:34:22.749 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-17T11:34:22.749 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-17T11:34:22.749 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-17T11:34:22.749 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-17T11:34:22.749 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-17T11:34:22.749 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-17T11:34:22.749 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-17T11:34:22.749 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-17T11:34:22.749 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-17T11:34:22.749 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-17T11:34:22.750 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-17T11:34:22.750 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-17T11:34:22.750 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-17T11:34:22.750 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-17T11:34:22.750 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-17T11:34:22.750 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-17T11:34:22.750 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-17T11:34:22.750 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-17T11:34:22.750 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers 2023-12-17T11:34:22.750 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi 2023-12-17T11:34:22.750 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-17T11:34:22.750 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-17T11:34:22.750 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/custom_method.ko 2023-12-17T11:34:22.750 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-17T11:34:22.750 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-17T11:34:22.750 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-17T11:34:22.751 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-17T11:34:22.751 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-17T11:34:22.751 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata 2023-12-17T11:34:22.751 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-17T11:34:22.751 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-17T11:34:22.751 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ata_generic.ko 2023-12-17T11:34:22.751 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-17T11:34:22.751 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-17T11:34:22.751 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-17T11:34:22.751 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-17T11:34:22.751 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-17T11:34:22.751 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-17T11:34:22.751 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-17T11:34:22.752 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-17T11:34:22.752 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-17T11:34:22.752 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-17T11:34:22.752 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-17T11:34:22.752 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-17T11:34:22.752 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-17T11:34:22.752 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-17T11:34:22.752 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-17T11:34:22.752 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-17T11:34:22.752 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-17T11:34:22.752 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-17T11:34:22.752 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-17T11:34:22.752 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-17T11:34:22.752 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-17T11:34:22.752 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-17T11:34:22.753 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-17T11:34:22.753 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-17T11:34:22.753 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-17T11:34:22.753 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-17T11:34:22.753 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-17T11:34:22.753 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-17T11:34:22.753 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-17T11:34:22.753 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-17T11:34:22.753 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-17T11:34:22.753 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-17T11:34:22.753 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-17T11:34:22.753 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-17T11:34:22.753 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-17T11:34:22.754 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sis.ko 2023-12-17T11:34:22.754 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-17T11:34:22.754 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-17T11:34:22.754 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-17T11:34:22.754 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-17T11:34:22.754 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-17T11:34:22.754 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-17T11:34:22.754 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-17T11:34:22.754 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-17T11:34:22.754 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-17T11:34:22.754 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-17T11:34:22.754 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-17T11:34:22.754 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-17T11:34:22.755 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-17T11:34:22.755 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-17T11:34:22.755 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-17T11:34:22.755 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-17T11:34:22.755 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-17T11:34:22.755 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay 2023-12-17T11:34:22.755 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-17T11:34:22.755 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base 2023-12-17T11:34:22.755 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap 2023-12-17T11:34:22.755 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-17T11:34:22.755 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-17T11:34:22.755 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma 2023-12-17T11:34:22.755 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-17T11:34:22.756 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block 2023-12-17T11:34:22.756 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe 2023-12-17T11:34:22.756 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-17T11:34:22.756 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/brd.ko 2023-12-17T11:34:22.756 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd 2023-12-17T11:34:22.756 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-17T11:34:22.756 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-17T11:34:22.756 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/loop.ko 2023-12-17T11:34:22.756 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx 2023-12-17T11:34:22.756 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-17T11:34:22.756 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-17T11:34:22.756 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk 2023-12-17T11:34:22.756 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-17T11:34:22.756 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-17T11:34:22.756 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-17T11:34:22.757 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/virtio_blk.ko 2023-12-17T11:34:22.757 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback 2023-12-17T11:34:22.757 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-17T11:34:22.757 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkfront.ko 2023-12-17T11:34:22.757 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram 2023-12-17T11:34:22.757 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-17T11:34:22.757 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char 2023-12-17T11:34:22.757 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-17T11:34:22.757 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random 2023-12-17T11:34:22.757 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-17T11:34:22.757 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-17T11:34:22.757 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-17T11:34:22.758 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-17T11:34:22.758 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-17T11:34:22.758 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi 2023-12-17T11:34:22.758 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-17T11:34:22.758 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-17T11:34:22.758 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-17T11:34:22.758 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-17T11:34:22.758 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-17T11:34:22.758 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-17T11:34:22.758 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-17T11:34:22.758 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave 2023-12-17T11:34:22.758 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-17T11:34:22.758 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-17T11:34:22.758 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-17T11:34:22.758 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm 2023-12-17T11:34:22.758 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm.ko 2023-12-17T11:34:22.759 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-17T11:34:22.759 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-17T11:34:22.759 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-17T11:34:22.759 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-17T11:34:22.759 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-17T11:34:22.759 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/uv_mmtimer.ko 2023-12-17T11:34:22.759 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/virtio_console.ko 2023-12-17T11:34:22.759 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq 2023-12-17T11:34:22.759 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-17T11:34:22.759 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-17T11:34:22.759 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-17T11:34:22.759 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-17T11:34:22.760 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-17T11:34:22.760 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-17T11:34:22.760 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto 2023-12-17T11:34:22.760 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp 2023-12-17T11:34:22.760 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-17T11:34:22.760 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-17T11:34:22.760 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel 2023-12-17T11:34:22.760 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat 2023-12-17T11:34:22.760 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common 2023-12-17T11:34:22.760 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-17T11:34:22.760 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-17T11:34:22.760 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-17T11:34:22.760 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-17T11:34:22.760 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-17T11:34:22.760 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio 2023-12-17T11:34:22.761 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-17T11:34:22.761 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca 2023-12-17T11:34:22.761 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-17T11:34:22.761 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq 2023-12-17T11:34:22.761 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-17T11:34:22.761 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma 2023-12-17T11:34:22.761 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw 2023-12-17T11:34:22.761 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-17T11:34:22.761 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat 2023-12-17T11:34:22.761 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-17T11:34:22.761 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac 2023-12-17T11:34:22.761 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-17T11:34:22.761 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-17T11:34:22.761 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-17T11:34:22.762 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-17T11:34:22.762 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-17T11:34:22.762 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-17T11:34:22.762 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-17T11:34:22.762 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-17T11:34:22.762 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-17T11:34:22.762 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-17T11:34:22.762 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-17T11:34:22.762 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-17T11:34:22.762 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-17T11:34:22.762 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware 2023-12-17T11:34:22.762 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/edd.ko 2023-12-17T11:34:22.762 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-17T11:34:22.763 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio 2023-12-17T11:34:22.763 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-17T11:34:22.763 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-17T11:34:22.763 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid 2023-12-17T11:34:22.763 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-17T11:34:22.763 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-17T11:34:22.763 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-17T11:34:22.763 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-17T11:34:22.763 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-17T11:34:22.763 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-17T11:34:22.763 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-17T11:34:22.763 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-17T11:34:22.763 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-17T11:34:22.763 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-17T11:34:22.763 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-17T11:34:22.764 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-17T11:34:22.764 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-17T11:34:22.764 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-17T11:34:22.764 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-17T11:34:22.764 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-17T11:34:22.764 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-17T11:34:22.764 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-17T11:34:22.764 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-17T11:34:22.764 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-17T11:34:22.764 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-17T11:34:22.764 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-17T11:34:22.764 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-17T11:34:22.764 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-17T11:34:22.764 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-17T11:34:22.765 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-17T11:34:22.765 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-17T11:34:22.765 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-17T11:34:22.765 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-17T11:34:22.765 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-17T11:34:22.765 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-17T11:34:22.765 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-17T11:34:22.765 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-17T11:34:22.765 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-17T11:34:22.765 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-17T11:34:22.765 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-17T11:34:22.765 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-17T11:34:22.765 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-17T11:34:22.765 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-17T11:34:22.765 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-17T11:34:22.766 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-17T11:34:22.766 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-17T11:34:22.766 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-17T11:34:22.766 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-17T11:34:22.766 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-17T11:34:22.766 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-17T11:34:22.766 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-17T11:34:22.766 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-17T11:34:22.766 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-17T11:34:22.766 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-17T11:34:22.766 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-17T11:34:22.766 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-17T11:34:22.766 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-17T11:34:22.766 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-17T11:34:22.767 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-17T11:34:22.767 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-17T11:34:22.767 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-17T11:34:22.767 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-17T11:34:22.767 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-17T11:34:22.767 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-17T11:34:22.767 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-17T11:34:22.767 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-17T11:34:22.767 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-17T11:34:22.767 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-17T11:34:22.767 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv 2023-12-17T11:34:22.767 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-17T11:34:22.767 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-17T11:34:22.767 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-17T11:34:22.767 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon 2023-12-17T11:34:22.768 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-17T11:34:22.768 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-17T11:34:22.768 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-17T11:34:22.768 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-17T11:34:22.768 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-17T11:34:22.768 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-17T11:34:22.768 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-17T11:34:22.768 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-17T11:34:22.768 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-17T11:34:22.768 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-17T11:34:22.768 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-17T11:34:22.768 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-17T11:34:22.768 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-17T11:34:22.768 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-17T11:34:22.768 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-17T11:34:22.769 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-17T11:34:22.769 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-17T11:34:22.769 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-17T11:34:22.769 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-17T11:34:22.769 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-17T11:34:22.769 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-17T11:34:22.769 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-17T11:34:22.769 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-17T11:34:22.769 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-17T11:34:22.769 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-17T11:34:22.769 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-17T11:34:22.769 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-17T11:34:22.769 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-17T11:34:22.769 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-17T11:34:22.770 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-17T11:34:22.770 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-17T11:34:22.770 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-17T11:34:22.770 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-17T11:34:22.770 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-17T11:34:22.770 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-17T11:34:22.770 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-17T11:34:22.770 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-17T11:34:22.770 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-17T11:34:22.770 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-17T11:34:22.770 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-17T11:34:22.770 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-17T11:34:22.770 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-17T11:34:22.770 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-17T11:34:22.770 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-17T11:34:22.771 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-17T11:34:22.771 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-17T11:34:22.771 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-17T11:34:22.771 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-17T11:34:22.771 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-17T11:34:22.771 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-17T11:34:22.771 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-17T11:34:22.771 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-17T11:34:22.771 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-17T11:34:22.771 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-17T11:34:22.771 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-17T11:34:22.771 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-17T11:34:22.771 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-17T11:34:22.771 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-17T11:34:22.772 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-17T11:34:22.772 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-17T11:34:22.772 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-17T11:34:22.772 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-17T11:34:22.772 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-17T11:34:22.772 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-17T11:34:22.772 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-17T11:34:22.772 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-17T11:34:22.772 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-17T11:34:22.772 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-17T11:34:22.772 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-17T11:34:22.772 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-17T11:34:22.772 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-17T11:34:22.772 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-17T11:34:22.772 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-17T11:34:22.773 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-17T11:34:22.773 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-17T11:34:22.773 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-17T11:34:22.773 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-17T11:34:22.773 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-17T11:34:22.773 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-17T11:34:22.773 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-17T11:34:22.773 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-17T11:34:22.773 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-17T11:34:22.773 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-17T11:34:22.773 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-17T11:34:22.773 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-17T11:34:22.773 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-17T11:34:22.773 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-17T11:34:22.774 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-17T11:34:22.774 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus 2023-12-17T11:34:22.774 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-17T11:34:22.774 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-17T11:34:22.774 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-17T11:34:22.774 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-17T11:34:22.774 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-17T11:34:22.774 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-17T11:34:22.774 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-17T11:34:22.774 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-17T11:34:22.774 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-17T11:34:22.774 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-17T11:34:22.774 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-17T11:34:22.774 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-17T11:34:22.775 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-17T11:34:22.775 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-17T11:34:22.775 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-17T11:34:22.775 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-17T11:34:22.775 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-17T11:34:22.775 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-17T11:34:22.775 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-17T11:34:22.775 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-17T11:34:22.775 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-17T11:34:22.775 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-17T11:34:22.775 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-17T11:34:22.775 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-17T11:34:22.775 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-17T11:34:22.775 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-17T11:34:22.776 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-17T11:34:22.776 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-17T11:34:22.776 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-17T11:34:22.776 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-17T11:34:22.776 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-17T11:34:22.776 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-17T11:34:22.776 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-17T11:34:22.776 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-17T11:34:22.776 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-17T11:34:22.776 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-17T11:34:22.776 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-17T11:34:22.776 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-17T11:34:22.776 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-17T11:34:22.776 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-17T11:34:22.777 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-17T11:34:22.777 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c 2023-12-17T11:34:22.777 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos 2023-12-17T11:34:22.777 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-17T11:34:22.777 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-17T11:34:22.777 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses 2023-12-17T11:34:22.777 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-17T11:34:22.777 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-17T11:34:22.777 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-17T11:34:22.777 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-17T11:34:22.777 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-17T11:34:22.777 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-17T11:34:22.777 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-17T11:34:22.778 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-17T11:34:22.778 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-17T11:34:22.778 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-17T11:34:22.778 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-17T11:34:22.778 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-17T11:34:22.778 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-17T11:34:22.778 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-17T11:34:22.778 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-17T11:34:22.778 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-17T11:34:22.778 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-17T11:34:22.778 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-17T11:34:22.778 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-17T11:34:22.778 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-17T11:34:22.779 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-17T11:34:22.779 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-17T11:34:22.779 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-17T11:34:22.779 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-dev.ko 2023-12-17T11:34:22.779 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-17T11:34:22.779 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-17T11:34:22.779 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-17T11:34:22.779 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-17T11:34:22.779 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband 2023-12-17T11:34:22.779 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core 2023-12-17T11:34:22.779 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-17T11:34:22.779 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-17T11:34:22.779 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-17T11:34:22.779 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-17T11:34:22.780 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-17T11:34:22.780 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-17T11:34:22.780 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-17T11:34:22.780 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw 2023-12-17T11:34:22.780 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4 2023-12-17T11:34:22.780 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-17T11:34:22.780 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4 2023-12-17T11:34:22.780 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-17T11:34:22.780 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5 2023-12-17T11:34:22.780 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-17T11:34:22.780 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca 2023-12-17T11:34:22.780 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-17T11:34:22.780 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp 2023-12-17T11:34:22.780 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib 2023-12-17T11:34:22.780 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-17T11:34:22.781 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser 2023-12-17T11:34:22.781 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-17T11:34:22.781 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert 2023-12-17T11:34:22.781 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-17T11:34:22.781 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp 2023-12-17T11:34:22.781 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-17T11:34:22.781 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt 2023-12-17T11:34:22.781 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-17T11:34:22.781 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input 2023-12-17T11:34:22.781 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport 2023-12-17T11:34:22.781 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-17T11:34:22.781 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-17T11:34:22.781 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-17T11:34:22.781 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-17T11:34:22.782 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard 2023-12-17T11:34:22.782 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-17T11:34:22.782 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse 2023-12-17T11:34:22.782 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-17T11:34:22.782 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-17T11:34:22.782 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-17T11:34:22.782 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-17T11:34:22.782 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-17T11:34:22.782 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-17T11:34:22.782 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-17T11:34:22.782 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-17T11:34:22.782 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4 2023-12-17T11:34:22.782 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-17T11:34:22.782 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio 2023-12-17T11:34:22.782 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-17T11:34:22.783 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-17T11:34:22.783 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-17T11:34:22.783 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-17T11:34:22.783 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-17T11:34:22.783 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu 2023-12-17T11:34:22.783 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd 2023-12-17T11:34:22.783 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-17T11:34:22.783 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds 2023-12-17T11:34:22.783 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-17T11:34:22.783 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-17T11:34:22.783 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-17T11:34:22.783 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-17T11:34:22.783 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger 2023-12-17T11:34:22.783 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-17T11:34:22.783 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-17T11:34:22.784 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-17T11:34:22.784 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-17T11:34:22.784 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-17T11:34:22.784 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-17T11:34:22.784 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-17T11:34:22.784 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-17T11:34:22.784 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md 2023-12-17T11:34:22.784 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache 2023-12-17T11:34:22.784 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-17T11:34:22.784 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-17T11:34:22.784 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-17T11:34:22.784 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-17T11:34:22.784 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-17T11:34:22.784 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-17T11:34:22.785 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-17T11:34:22.785 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-17T11:34:22.785 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-17T11:34:22.785 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-17T11:34:22.785 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-17T11:34:22.785 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-17T11:34:22.785 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-17T11:34:22.785 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-17T11:34:22.785 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-17T11:34:22.785 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-17T11:34:22.785 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-17T11:34:22.785 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-17T11:34:22.785 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-17T11:34:22.785 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data 2023-12-17T11:34:22.785 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-17T11:34:22.786 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-17T11:34:22.786 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-17T11:34:22.786 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-17T11:34:22.786 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-17T11:34:22.786 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message 2023-12-17T11:34:22.786 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion 2023-12-17T11:34:22.786 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-17T11:34:22.786 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-17T11:34:22.786 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-17T11:34:22.786 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-17T11:34:22.786 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-17T11:34:22.786 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-17T11:34:22.786 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-17T11:34:22.786 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd 2023-12-17T11:34:22.786 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-17T11:34:22.787 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-17T11:34:22.787 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mfd-core.ko 2023-12-17T11:34:22.787 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-17T11:34:22.787 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-17T11:34:22.787 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-17T11:34:22.787 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-17T11:34:22.787 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc 2023-12-17T11:34:22.787 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl 2023-12-17T11:34:22.787 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-17T11:34:22.787 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-17T11:34:22.787 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-17T11:34:22.787 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-17T11:34:22.787 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710 2023-12-17T11:34:22.787 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-17T11:34:22.787 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom 2023-12-17T11:34:22.788 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-17T11:34:22.788 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-17T11:34:22.788 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-17T11:34:22.788 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-17T11:34:22.788 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-17T11:34:22.788 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-17T11:34:22.788 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-17T11:34:22.788 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-17T11:34:22.788 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d 2023-12-17T11:34:22.788 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-17T11:34:22.788 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-17T11:34:22.788 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei 2023-12-17T11:34:22.788 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-17T11:34:22.788 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-17T11:34:22.788 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-17T11:34:22.789 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru 2023-12-17T11:34:22.789 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-17T11:34:22.789 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp 2023-12-17T11:34:22.789 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-17T11:34:22.789 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-17T11:34:22.789 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-17T11:34:22.789 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-17T11:34:22.789 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-17T11:34:22.789 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-17T11:34:22.789 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-17T11:34:22.789 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci 2023-12-17T11:34:22.789 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-17T11:34:22.789 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net 2023-12-17T11:34:22.789 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding 2023-12-17T11:34:22.789 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-17T11:34:22.790 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa 2023-12-17T11:34:22.790 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53 2023-12-17T11:34:22.790 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-17T11:34:22.790 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-17T11:34:22.790 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-17T11:34:22.790 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx 2023-12-17T11:34:22.790 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-17T11:34:22.790 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-17T11:34:22.790 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-17T11:34:22.790 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet 2023-12-17T11:34:22.790 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com 2023-12-17T11:34:22.790 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-17T11:34:22.790 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-17T11:34:22.790 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-17T11:34:22.790 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-17T11:34:22.791 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390 2023-12-17T11:34:22.791 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-17T11:34:22.791 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-17T11:34:22.791 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-17T11:34:22.791 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-17T11:34:22.791 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec 2023-12-17T11:34:22.791 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-17T11:34:22.791 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere 2023-12-17T11:34:22.791 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-17T11:34:22.791 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon 2023-12-17T11:34:22.791 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-17T11:34:22.791 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera 2023-12-17T11:34:22.791 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-17T11:34:22.791 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd 2023-12-17T11:34:22.792 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-17T11:34:22.792 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-17T11:34:22.792 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-17T11:34:22.792 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros 2023-12-17T11:34:22.792 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx 2023-12-17T11:34:22.792 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-17T11:34:22.792 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-17T11:34:22.792 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-17T11:34:22.792 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-17T11:34:22.792 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-17T11:34:22.792 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx 2023-12-17T11:34:22.792 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-17T11:34:22.792 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-17T11:34:22.792 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom 2023-12-17T11:34:22.793 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-17T11:34:22.793 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-17T11:34:22.793 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-17T11:34:22.793 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-17T11:34:22.793 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-17T11:34:22.793 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet 2023-12-17T11:34:22.793 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-17T11:34:22.793 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-17T11:34:22.793 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade 2023-12-17T11:34:22.793 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna 2023-12-17T11:34:22.793 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-17T11:34:22.793 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio 2023-12-17T11:34:22.793 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-17T11:34:22.793 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-17T11:34:22.793 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-17T11:34:22.794 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-17T11:34:22.794 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-17T11:34:22.794 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-17T11:34:22.794 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-17T11:34:22.794 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-17T11:34:22.794 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-17T11:34:22.794 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-17T11:34:22.794 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco 2023-12-17T11:34:22.794 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic 2023-12-17T11:34:22.794 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-17T11:34:22.794 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec 2023-12-17T11:34:22.794 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip 2023-12-17T11:34:22.794 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-17T11:34:22.794 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-17T11:34:22.795 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-17T11:34:22.795 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-17T11:34:22.795 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-17T11:34:22.795 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-17T11:34:22.795 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink 2023-12-17T11:34:22.795 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-17T11:34:22.795 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-17T11:34:22.795 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-17T11:34:22.795 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex 2023-12-17T11:34:22.795 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet 2023-12-17T11:34:22.796 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-17T11:34:22.796 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-17T11:34:22.796 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-17T11:34:22.796 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel 2023-12-17T11:34:22.796 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-17T11:34:22.796 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000 2023-12-17T11:34:22.796 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-17T11:34:22.796 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e 2023-12-17T11:34:22.796 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-17T11:34:22.796 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k 2023-12-17T11:34:22.796 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-17T11:34:22.796 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e 2023-12-17T11:34:22.796 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-17T11:34:22.796 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf 2023-12-17T11:34:22.797 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-17T11:34:22.797 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb 2023-12-17T11:34:22.797 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-17T11:34:22.797 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf 2023-12-17T11:34:22.797 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-17T11:34:22.797 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-17T11:34:22.797 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-17T11:34:22.797 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-17T11:34:22.797 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-17T11:34:22.797 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-17T11:34:22.797 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell 2023-12-17T11:34:22.797 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-17T11:34:22.797 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-17T11:34:22.797 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-17T11:34:22.797 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox 2023-12-17T11:34:22.798 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-17T11:34:22.798 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-17T11:34:22.798 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-17T11:34:22.798 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-17T11:34:22.798 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-17T11:34:22.798 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-17T11:34:22.798 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel 2023-12-17T11:34:22.798 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-17T11:34:22.798 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom 2023-12-17T11:34:22.798 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-17T11:34:22.798 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-17T11:34:22.798 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi 2023-12-17T11:34:22.798 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-17T11:34:22.798 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-17T11:34:22.798 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion 2023-12-17T11:34:22.799 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-17T11:34:22.799 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia 2023-12-17T11:34:22.799 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-17T11:34:22.799 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines 2023-12-17T11:34:22.799 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-17T11:34:22.799 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-17T11:34:22.799 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic 2023-12-17T11:34:22.799 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-17T11:34:22.799 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-17T11:34:22.799 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-17T11:34:22.799 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-17T11:34:22.799 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-17T11:34:22.799 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc 2023-12-17T11:34:22.799 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-17T11:34:22.799 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek 2023-12-17T11:34:22.800 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-17T11:34:22.800 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-17T11:34:22.800 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-17T11:34:22.800 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-17T11:34:22.800 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker 2023-12-17T11:34:22.800 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-17T11:34:22.800 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc 2023-12-17T11:34:22.800 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-17T11:34:22.800 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan 2023-12-17T11:34:22.800 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-17T11:34:22.800 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis 2023-12-17T11:34:22.800 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-17T11:34:22.800 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-17T11:34:22.800 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc 2023-12-17T11:34:22.801 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-17T11:34:22.801 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-17T11:34:22.801 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-17T11:34:22.801 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-17T11:34:22.801 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro 2023-12-17T11:34:22.801 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-17T11:34:22.801 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-17T11:34:22.801 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-17T11:34:22.801 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun 2023-12-17T11:34:22.801 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-17T11:34:22.801 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-17T11:34:22.801 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-17T11:34:22.801 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-17T11:34:22.801 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti 2023-12-17T11:34:22.802 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-17T11:34:22.802 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti 2023-12-17T11:34:22.802 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-17T11:34:22.802 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via 2023-12-17T11:34:22.802 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-17T11:34:22.802 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-17T11:34:22.802 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet 2023-12-17T11:34:22.802 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-17T11:34:22.802 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-17T11:34:22.802 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom 2023-12-17T11:34:22.802 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-17T11:34:22.802 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-17T11:34:22.802 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv 2023-12-17T11:34:22.802 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-17T11:34:22.802 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154 2023-12-17T11:34:22.803 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-17T11:34:22.803 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-17T11:34:22.803 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan 2023-12-17T11:34:22.803 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-17T11:34:22.803 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-17T11:34:22.803 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-17T11:34:22.803 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio 2023-12-17T11:34:22.803 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-17T11:34:22.803 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-17T11:34:22.803 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-17T11:34:22.803 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-17T11:34:22.803 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-17T11:34:22.803 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/net_failover.ko 2023-12-17T11:34:22.803 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-17T11:34:22.804 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-17T11:34:22.804 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs 2023-12-17T11:34:22.804 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-17T11:34:22.804 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-17T11:34:22.804 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy 2023-12-17T11:34:22.804 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-17T11:34:22.804 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-17T11:34:22.804 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-17T11:34:22.804 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-17T11:34:22.804 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-17T11:34:22.804 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-17T11:34:22.804 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-17T11:34:22.804 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-17T11:34:22.804 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/dp83640.ko 2023-12-17T11:34:22.804 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-17T11:34:22.805 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-17T11:34:22.805 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-17T11:34:22.805 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-17T11:34:22.805 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-17T11:34:22.805 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-17T11:34:22.805 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-17T11:34:22.805 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-17T11:34:22.805 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-17T11:34:22.805 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-17T11:34:22.805 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-17T11:34:22.805 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-17T11:34:22.805 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp 2023-12-17T11:34:22.805 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-17T11:34:22.805 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-17T11:34:22.806 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-17T11:34:22.806 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-17T11:34:22.806 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-17T11:34:22.806 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-17T11:34:22.806 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-17T11:34:22.806 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-17T11:34:22.806 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-17T11:34:22.806 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip 2023-12-17T11:34:22.806 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slhc.ko 2023-12-17T11:34:22.806 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-17T11:34:22.806 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-17T11:34:22.806 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-17T11:34:22.806 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team 2023-12-17T11:34:22.806 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-17T11:34:22.807 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-17T11:34:22.807 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-17T11:34:22.807 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-17T11:34:22.807 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-17T11:34:22.807 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-17T11:34:22.807 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tun.ko 2023-12-17T11:34:22.807 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-17T11:34:22.807 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/virtio_net.ko 2023-12-17T11:34:22.807 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3 2023-12-17T11:34:22.807 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-17T11:34:22.807 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan 2023-12-17T11:34:22.807 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-17T11:34:22.807 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback 2023-12-17T11:34:22.807 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-17T11:34:22.807 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netfront.ko 2023-12-17T11:34:22.808 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb 2023-12-17T11:34:22.808 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-17T11:34:22.808 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme 2023-12-17T11:34:22.808 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host 2023-12-17T11:34:22.808 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-17T11:34:22.808 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-17T11:34:22.808 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport 2023-12-17T11:34:22.808 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-17T11:34:22.808 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-17T11:34:22.808 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-17T11:34:22.808 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-17T11:34:22.808 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci 2023-12-17T11:34:22.808 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug 2023-12-17T11:34:22.808 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-17T11:34:22.809 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie 2023-12-17T11:34:22.809 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-17T11:34:22.809 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-17T11:34:22.809 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia 2023-12-17T11:34:22.809 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-17T11:34:22.809 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-17T11:34:22.809 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-17T11:34:22.809 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl 2023-12-17T11:34:22.809 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel 2023-12-17T11:34:22.809 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-17T11:34:22.809 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform 2023-12-17T11:34:22.809 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86 2023-12-17T11:34:22.809 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-17T11:34:22.809 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-17T11:34:22.809 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-17T11:34:22.810 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-17T11:34:22.810 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-17T11:34:22.810 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-17T11:34:22.810 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-17T11:34:22.810 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-17T11:34:22.810 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-17T11:34:22.810 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-17T11:34:22.810 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-17T11:34:22.810 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-17T11:34:22.810 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel 2023-12-17T11:34:22.810 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-17T11:34:22.810 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-17T11:34:22.810 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-17T11:34:22.810 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-17T11:34:22.810 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-17T11:34:22.811 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-17T11:34:22.811 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-17T11:34:22.811 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-17T11:34:22.811 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-17T11:34:22.811 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-17T11:34:22.811 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-17T11:34:22.811 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-17T11:34:22.811 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap 2023-12-17T11:34:22.811 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-17T11:34:22.811 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-17T11:34:22.811 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps 2023-12-17T11:34:22.811 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients 2023-12-17T11:34:22.811 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-17T11:34:22.811 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-17T11:34:22.811 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-17T11:34:22.812 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-17T11:34:22.812 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp 2023-12-17T11:34:22.812 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-17T11:34:22.812 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-17T11:34:22.812 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc 2023-12-17T11:34:22.812 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-17T11:34:22.812 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-17T11:34:22.812 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-17T11:34:22.812 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-17T11:34:22.812 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-17T11:34:22.812 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-17T11:34:22.812 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-17T11:34:22.812 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-17T11:34:22.812 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-17T11:34:22.812 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-17T11:34:22.813 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-17T11:34:22.813 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-17T11:34:22.813 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-17T11:34:22.813 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-17T11:34:22.813 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-17T11:34:22.813 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-17T11:34:22.813 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-17T11:34:22.813 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-17T11:34:22.813 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-17T11:34:22.813 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-17T11:34:22.813 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-17T11:34:22.813 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-17T11:34:22.813 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-17T11:34:22.814 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-17T11:34:22.814 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-17T11:34:22.814 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-17T11:34:22.814 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-17T11:34:22.814 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-17T11:34:22.814 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-17T11:34:22.814 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-17T11:34:22.814 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-17T11:34:22.814 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi 2023-12-17T11:34:22.814 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-17T11:34:22.814 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-17T11:34:22.814 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-17T11:34:22.814 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-17T11:34:22.814 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-17T11:34:22.815 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid 2023-12-17T11:34:22.815 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-17T11:34:22.815 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-17T11:34:22.815 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx 2023-12-17T11:34:22.815 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-17T11:34:22.815 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-17T11:34:22.815 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-17T11:34:22.815 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr 2023-12-17T11:34:22.815 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-17T11:34:22.815 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-17T11:34:22.815 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi 2023-12-17T11:34:22.815 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-17T11:34:22.815 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa 2023-12-17T11:34:22.815 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-17T11:34:22.815 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc 2023-12-17T11:34:22.816 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-17T11:34:22.816 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i 2023-12-17T11:34:22.816 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-17T11:34:22.816 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-17T11:34:22.816 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor 2023-12-17T11:34:22.816 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-17T11:34:22.816 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi 2023-12-17T11:34:22.816 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-17T11:34:22.816 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-17T11:34:22.816 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-17T11:34:22.816 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-17T11:34:22.816 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-17T11:34:22.816 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-17T11:34:22.816 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler 2023-12-17T11:34:22.817 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-17T11:34:22.817 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-17T11:34:22.817 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-17T11:34:22.817 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-17T11:34:22.817 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-17T11:34:22.817 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r 2023-12-17T11:34:22.817 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-17T11:34:22.817 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-17T11:34:22.817 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe 2023-12-17T11:34:22.817 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-17T11:34:22.817 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-17T11:34:22.817 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic 2023-12-17T11:34:22.817 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-17T11:34:22.817 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-17T11:34:22.817 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-17T11:34:22.818 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-17T11:34:22.818 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-17T11:34:22.818 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-17T11:34:22.818 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-17T11:34:22.818 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci 2023-12-17T11:34:22.818 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-17T11:34:22.818 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-17T11:34:22.818 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-17T11:34:22.818 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc 2023-12-17T11:34:22.818 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-17T11:34:22.818 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-17T11:34:22.818 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-17T11:34:22.818 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas 2023-12-17T11:34:22.818 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-17T11:34:22.818 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc 2023-12-17T11:34:22.819 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-17T11:34:22.819 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid 2023-12-17T11:34:22.819 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-17T11:34:22.819 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-17T11:34:22.819 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-17T11:34:22.819 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-17T11:34:22.819 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas 2023-12-17T11:34:22.819 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-17T11:34:22.819 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas 2023-12-17T11:34:22.819 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-17T11:34:22.819 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-17T11:34:22.819 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001 2023-12-17T11:34:22.819 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-17T11:34:22.819 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-17T11:34:22.819 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-17T11:34:22.820 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx 2023-12-17T11:34:22.820 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-17T11:34:22.820 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-17T11:34:22.820 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx 2023-12-17T11:34:22.820 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-17T11:34:22.820 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-17T11:34:22.820 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-17T11:34:22.820 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-17T11:34:22.820 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-17T11:34:22.820 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-17T11:34:22.820 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-17T11:34:22.820 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-17T11:34:22.820 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-17T11:34:22.821 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-17T11:34:22.821 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-17T11:34:22.821 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2 2023-12-17T11:34:22.821 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-17T11:34:22.821 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-17T11:34:22.821 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-17T11:34:22.821 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-17T11:34:22.821 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb 2023-12-17T11:34:22.821 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-17T11:34:22.821 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target 2023-12-17T11:34:22.821 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi 2023-12-17T11:34:22.821 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-17T11:34:22.821 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback 2023-12-17T11:34:22.822 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-17T11:34:22.822 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-17T11:34:22.822 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-17T11:34:22.822 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-17T11:34:22.822 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-17T11:34:22.822 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-17T11:34:22.822 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc 2023-12-17T11:34:22.822 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-17T11:34:22.822 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal 2023-12-17T11:34:22.822 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel 2023-12-17T11:34:22.822 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal 2023-12-17T11:34:22.822 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-17T11:34:22.822 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-17T11:34:22.822 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-17T11:34:22.822 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-17T11:34:22.823 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-17T11:34:22.823 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-17T11:34:22.823 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-17T11:34:22.823 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-17T11:34:22.823 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-17T11:34:22.823 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-17T11:34:22.823 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-17T11:34:22.823 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-17T11:34:22.823 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-17T11:34:22.823 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-17T11:34:22.823 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-17T11:34:22.823 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty 2023-12-17T11:34:22.823 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless 2023-12-17T11:34:22.823 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-17T11:34:22.823 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-17T11:34:22.824 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-17T11:34:22.824 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-17T11:34:22.824 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial 2023-12-17T11:34:22.824 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250 2023-12-17T11:34:22.824 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-17T11:34:22.824 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-17T11:34:22.824 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm 2023-12-17T11:34:22.824 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-17T11:34:22.824 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs 2023-12-17T11:34:22.824 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core 2023-12-17T11:34:22.824 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-17T11:34:22.824 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host 2023-12-17T11:34:22.824 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-17T11:34:22.824 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio 2023-12-17T11:34:22.825 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-17T11:34:22.825 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-17T11:34:22.825 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-17T11:34:22.825 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-17T11:34:22.825 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-17T11:34:22.825 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb 2023-12-17T11:34:22.825 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class 2023-12-17T11:34:22.825 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-17T11:34:22.825 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-17T11:34:22.825 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-17T11:34:22.825 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-17T11:34:22.825 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host 2023-12-17T11:34:22.825 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-17T11:34:22.825 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image 2023-12-17T11:34:22.826 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-17T11:34:22.826 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-17T11:34:22.826 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc 2023-12-17T11:34:22.826 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-17T11:34:22.826 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-17T11:34:22.826 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-17T11:34:22.826 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-17T11:34:22.826 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-17T11:34:22.826 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-17T11:34:22.826 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-17T11:34:22.826 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-17T11:34:22.826 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-17T11:34:22.826 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-17T11:34:22.826 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga 2023-12-17T11:34:22.826 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-17T11:34:22.827 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-17T11:34:22.827 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-17T11:34:22.827 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-17T11:34:22.827 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-17T11:34:22.827 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-17T11:34:22.827 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-17T11:34:22.827 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy 2023-12-17T11:34:22.827 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-17T11:34:22.827 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial 2023-12-17T11:34:22.827 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-17T11:34:22.827 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-17T11:34:22.827 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-17T11:34:22.827 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-17T11:34:22.827 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-17T11:34:22.828 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-17T11:34:22.828 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-17T11:34:22.828 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-17T11:34:22.828 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-17T11:34:22.828 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-17T11:34:22.828 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-17T11:34:22.828 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-17T11:34:22.828 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-17T11:34:22.828 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-17T11:34:22.828 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-17T11:34:22.828 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-17T11:34:22.828 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-17T11:34:22.828 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-17T11:34:22.828 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-17T11:34:22.828 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-17T11:34:22.829 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-17T11:34:22.829 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-17T11:34:22.829 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-17T11:34:22.829 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-17T11:34:22.829 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-17T11:34:22.829 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-17T11:34:22.829 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-17T11:34:22.829 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-17T11:34:22.829 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-17T11:34:22.829 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-17T11:34:22.829 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-17T11:34:22.829 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-17T11:34:22.829 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-17T11:34:22.829 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-17T11:34:22.830 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-17T11:34:22.830 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-17T11:34:22.830 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-17T11:34:22.830 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-17T11:34:22.830 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-17T11:34:22.830 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-17T11:34:22.830 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-17T11:34:22.830 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-17T11:34:22.830 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-17T11:34:22.830 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-17T11:34:22.830 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-17T11:34:22.830 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage 2023-12-17T11:34:22.830 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-17T11:34:22.830 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-17T11:34:22.830 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-17T11:34:22.831 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-17T11:34:22.831 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-17T11:34:22.831 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-17T11:34:22.831 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-17T11:34:22.831 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-17T11:34:22.831 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-17T11:34:22.831 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-17T11:34:22.831 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-17T11:34:22.831 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-17T11:34:22.831 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-17T11:34:22.831 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-17T11:34:22.831 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-17T11:34:22.831 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip 2023-12-17T11:34:22.832 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-17T11:34:22.832 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-17T11:34:22.832 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-17T11:34:22.832 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio 2023-12-17T11:34:22.832 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci 2023-12-17T11:34:22.832 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-17T11:34:22.832 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-17T11:34:22.832 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-17T11:34:22.832 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-17T11:34:22.832 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost 2023-12-17T11:34:22.832 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-17T11:34:22.832 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-17T11:34:22.832 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-17T11:34:22.832 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-17T11:34:22.832 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video 2023-12-17T11:34:22.833 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight 2023-12-17T11:34:22.833 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-17T11:34:22.833 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-17T11:34:22.833 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-17T11:34:22.833 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio 2023-12-17T11:34:22.833 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio.ko 2023-12-17T11:34:22.833 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_balloon.ko 2023-12-17T11:34:22.833 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_mmio.ko 2023-12-17T11:34:22.833 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci.ko 2023-12-17T11:34:22.833 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-17T11:34:22.833 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-17T11:34:22.834 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_ring.ko 2023-12-17T11:34:22.834 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1 2023-12-17T11:34:22.834 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters 2023-12-17T11:34:22.834 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-17T11:34:22.834 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-17T11:34:22.834 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves 2023-12-17T11:34:22.834 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-17T11:34:22.834 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-17T11:34:22.834 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-17T11:34:22.834 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-17T11:34:22.834 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-17T11:34:22.834 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-17T11:34:22.834 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-17T11:34:22.834 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-17T11:34:22.835 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-17T11:34:22.835 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-17T11:34:22.835 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-17T11:34:22.835 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-17T11:34:22.835 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog 2023-12-17T11:34:22.835 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-17T11:34:22.835 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-17T11:34:22.835 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-17T11:34:22.835 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-17T11:34:22.835 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-17T11:34:22.835 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-17T11:34:22.835 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-17T11:34:22.835 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-17T11:34:22.835 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-17T11:34:22.835 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-17T11:34:22.836 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-17T11:34:22.836 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-17T11:34:22.836 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-17T11:34:22.836 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-17T11:34:22.836 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-17T11:34:22.836 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-17T11:34:22.836 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-17T11:34:22.836 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-17T11:34:22.836 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-17T11:34:22.836 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-17T11:34:22.836 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-17T11:34:22.836 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-17T11:34:22.836 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-17T11:34:22.836 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-17T11:34:22.836 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-17T11:34:22.836 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-17T11:34:22.836 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen 2023-12-17T11:34:22.837 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-17T11:34:22.837 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-17T11:34:22.837 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-17T11:34:22.837 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-17T11:34:22.837 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback 2023-12-17T11:34:22.837 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-17T11:34:22.837 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-17T11:34:22.837 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs 2023-12-17T11:34:22.837 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-17T11:34:22.837 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs 2023-12-17T11:34:22.837 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p 2023-12-17T11:34:22.837 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-17T11:34:22.837 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs 2023-12-17T11:34:22.837 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-17T11:34:22.837 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs 2023-12-17T11:34:22.838 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-17T11:34:22.838 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-17T11:34:22.838 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs 2023-12-17T11:34:22.838 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-17T11:34:22.838 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles 2023-12-17T11:34:22.838 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-17T11:34:22.838 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph 2023-12-17T11:34:22.838 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-17T11:34:22.838 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda 2023-12-17T11:34:22.838 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-17T11:34:22.838 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs 2023-12-17T11:34:22.838 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-17T11:34:22.838 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm 2023-12-17T11:34:22.838 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-17T11:34:22.838 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs 2023-12-17T11:34:22.839 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-17T11:34:22.839 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs 2023-12-17T11:34:22.839 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-17T11:34:22.839 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat 2023-12-17T11:34:22.839 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/fat.ko 2023-12-17T11:34:22.839 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-17T11:34:22.839 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/vfat.ko 2023-12-17T11:34:22.839 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache 2023-12-17T11:34:22.839 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-17T11:34:22.839 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse 2023-12-17T11:34:22.839 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-17T11:34:22.839 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/fuse.ko 2023-12-17T11:34:22.839 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2 2023-12-17T11:34:22.839 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-17T11:34:22.839 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs 2023-12-17T11:34:22.839 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-17T11:34:22.840 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus 2023-12-17T11:34:22.840 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-17T11:34:22.840 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs 2023-12-17T11:34:22.840 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-17T11:34:22.840 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs 2023-12-17T11:34:22.840 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-17T11:34:22.840 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd 2023-12-17T11:34:22.840 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-17T11:34:22.840 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix 2023-12-17T11:34:22.840 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-17T11:34:22.840 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs 2023-12-17T11:34:22.840 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-17T11:34:22.840 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs 2023-12-17T11:34:22.840 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout 2023-12-17T11:34:22.840 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-17T11:34:22.840 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout 2023-12-17T11:34:22.840 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-17T11:34:22.841 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout 2023-12-17T11:34:22.841 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-17T11:34:22.841 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-17T11:34:22.841 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-17T11:34:22.841 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-17T11:34:22.841 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common 2023-12-17T11:34:22.841 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-17T11:34:22.841 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-17T11:34:22.841 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd 2023-12-17T11:34:22.841 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-17T11:34:22.841 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2 2023-12-17T11:34:22.841 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-17T11:34:22.841 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls 2023-12-17T11:34:22.841 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-17T11:34:22.842 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-17T11:34:22.842 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-17T11:34:22.842 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-17T11:34:22.842 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-17T11:34:22.842 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-17T11:34:22.842 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-17T11:34:22.842 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-17T11:34:22.842 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-17T11:34:22.842 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-17T11:34:22.842 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-17T11:34:22.842 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-17T11:34:22.842 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-17T11:34:22.842 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-17T11:34:22.842 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-17T11:34:22.842 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-17T11:34:22.842 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-17T11:34:22.842 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-17T11:34:22.842 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-17T11:34:22.843 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-17T11:34:22.843 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-17T11:34:22.843 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-17T11:34:22.843 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-17T11:34:22.843 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-17T11:34:22.843 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-17T11:34:22.843 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-17T11:34:22.843 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-17T11:34:22.843 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-17T11:34:22.843 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-17T11:34:22.843 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-17T11:34:22.843 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-17T11:34:22.843 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-17T11:34:22.843 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-17T11:34:22.843 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-17T11:34:22.843 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-17T11:34:22.843 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-17T11:34:22.844 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-17T11:34:22.844 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-17T11:34:22.844 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-17T11:34:22.844 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-17T11:34:22.844 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-17T11:34:22.844 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-17T11:34:22.844 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-17T11:34:22.844 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-17T11:34:22.844 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-17T11:34:22.844 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-17T11:34:22.844 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-17T11:34:22.844 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-17T11:34:22.844 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-17T11:34:22.844 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-17T11:34:22.844 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2 2023-12-17T11:34:22.845 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster 2023-12-17T11:34:22.845 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-17T11:34:22.845 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm 2023-12-17T11:34:22.845 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-17T11:34:22.845 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs 2023-12-17T11:34:22.845 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-17T11:34:22.845 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-17T11:34:22.845 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-17T11:34:22.845 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-17T11:34:22.845 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-17T11:34:22.845 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs 2023-12-17T11:34:22.845 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-17T11:34:22.845 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore 2023-12-17T11:34:22.845 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-17T11:34:22.845 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs 2023-12-17T11:34:22.846 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-17T11:34:22.846 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs 2023-12-17T11:34:22.846 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-17T11:34:22.846 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb 2023-12-17T11:34:22.846 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client 2023-12-17T11:34:22.846 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-17T11:34:22.846 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common 2023-12-17T11:34:22.846 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-17T11:34:22.846 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-17T11:34:22.846 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs 2023-12-17T11:34:22.846 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-17T11:34:22.846 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv 2023-12-17T11:34:22.846 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-17T11:34:22.846 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf 2023-12-17T11:34:22.847 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-17T11:34:22.847 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs 2023-12-17T11:34:22.847 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-17T11:34:22.847 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs 2023-12-17T11:34:22.847 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-17T11:34:22.847 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel 2023-12-17T11:34:22.847 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu 2023-12-17T11:34:22.847 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu/rcutorture.ko 2023-12-17T11:34:22.847 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-17T11:34:22.847 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace 2023-12-17T11:34:22.847 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-17T11:34:22.847 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib 2023-12-17T11:34:22.847 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/asn1_encoder.ko 2023-12-17T11:34:22.847 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-17T11:34:22.847 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-17T11:34:22.848 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto 2023-12-17T11:34:22.848 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-17T11:34:22.848 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-17T11:34:22.848 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-17T11:34:22.848 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-17T11:34:22.848 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4 2023-12-17T11:34:22.848 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-17T11:34:22.848 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-17T11:34:22.848 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math 2023-12-17T11:34:22.848 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-17T11:34:22.848 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6 2023-12-17T11:34:22.848 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-17T11:34:22.848 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon 2023-12-17T11:34:22.848 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-17T11:34:22.849 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-17T11:34:22.849 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-17T11:34:22.849 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-17T11:34:22.849 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd 2023-12-17T11:34:22.849 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd/zstd_compress.ko 2023-12-17T11:34:22.849 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm 2023-12-17T11:34:22.849 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-17T11:34:22.849 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net 2023-12-17T11:34:22.849 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan 2023-12-17T11:34:22.849 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-17T11:34:22.849 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-17T11:34:22.849 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-17T11:34:22.849 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-17T11:34:22.850 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-17T11:34:22.850 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-17T11:34:22.850 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-17T11:34:22.850 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-17T11:34:22.850 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802 2023-12-17T11:34:22.850 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-17T11:34:22.850 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-17T11:34:22.850 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-17T11:34:22.850 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-17T11:34:22.850 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-17T11:34:22.850 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q 2023-12-17T11:34:22.850 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-17T11:34:22.850 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p 2023-12-17T11:34:22.850 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-17T11:34:22.850 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-17T11:34:22.851 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-17T11:34:22.851 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-17T11:34:22.851 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv 2023-12-17T11:34:22.851 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-17T11:34:22.851 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge 2023-12-17T11:34:22.851 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-17T11:34:22.851 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-17T11:34:22.851 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter 2023-12-17T11:34:22.851 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-17T11:34:22.851 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-17T11:34:22.851 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-17T11:34:22.851 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-17T11:34:22.851 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-17T11:34:22.852 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-17T11:34:22.852 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-17T11:34:22.852 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-17T11:34:22.852 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-17T11:34:22.852 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-17T11:34:22.852 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-17T11:34:22.852 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-17T11:34:22.852 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-17T11:34:22.852 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-17T11:34:22.852 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-17T11:34:22.852 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-17T11:34:22.852 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-17T11:34:22.852 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-17T11:34:22.852 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-17T11:34:22.853 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-17T11:34:22.853 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-17T11:34:22.853 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-17T11:34:22.853 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-17T11:34:22.853 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-17T11:34:22.853 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph 2023-12-17T11:34:22.853 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-17T11:34:22.853 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core 2023-12-17T11:34:22.853 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/failover.ko 2023-12-17T11:34:22.853 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-17T11:34:22.853 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp 2023-12-17T11:34:22.853 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-17T11:34:22.853 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-17T11:34:22.854 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-17T11:34:22.854 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-17T11:34:22.854 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver 2023-12-17T11:34:22.854 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver/dns_resolver.ko 2023-12-17T11:34:22.854 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa 2023-12-17T11:34:22.854 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-17T11:34:22.854 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-17T11:34:22.854 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-17T11:34:22.854 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-17T11:34:22.854 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-17T11:34:22.854 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154 2023-12-17T11:34:22.854 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan 2023-12-17T11:34:22.854 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-17T11:34:22.854 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-17T11:34:22.854 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-17T11:34:22.855 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4 2023-12-17T11:34:22.855 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-17T11:34:22.855 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-17T11:34:22.855 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-17T11:34:22.855 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-17T11:34:22.855 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-17T11:34:22.855 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-17T11:34:22.855 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-17T11:34:22.855 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-17T11:34:22.855 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-17T11:34:22.855 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-17T11:34:22.855 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter 2023-12-17T11:34:22.855 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-17T11:34:22.855 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-17T11:34:22.856 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-17T11:34:22.856 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-17T11:34:22.856 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-17T11:34:22.856 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-17T11:34:22.856 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-17T11:34:22.856 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-17T11:34:22.856 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-17T11:34:22.856 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-17T11:34:22.856 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-17T11:34:22.856 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-17T11:34:22.856 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-17T11:34:22.856 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-17T11:34:22.856 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-17T11:34:22.856 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-17T11:34:22.856 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-17T11:34:22.857 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-17T11:34:22.857 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-17T11:34:22.857 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-17T11:34:22.857 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-17T11:34:22.857 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-17T11:34:22.857 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-17T11:34:22.857 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-17T11:34:22.857 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-17T11:34:22.857 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-17T11:34:22.857 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-17T11:34:22.857 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-17T11:34:22.857 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-17T11:34:22.857 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-17T11:34:22.857 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-17T11:34:22.858 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-17T11:34:22.858 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-17T11:34:22.858 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-17T11:34:22.858 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-17T11:34:22.858 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-17T11:34:22.858 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-17T11:34:22.858 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-17T11:34:22.858 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6 2023-12-17T11:34:22.858 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-17T11:34:22.858 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-17T11:34:22.858 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-17T11:34:22.858 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-17T11:34:22.858 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-17T11:34:22.858 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-17T11:34:22.858 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-17T11:34:22.858 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter 2023-12-17T11:34:22.859 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-17T11:34:22.859 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-17T11:34:22.859 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-17T11:34:22.859 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-17T11:34:22.859 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-17T11:34:22.859 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-17T11:34:22.859 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-17T11:34:22.859 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-17T11:34:22.859 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-17T11:34:22.859 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-17T11:34:22.859 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-17T11:34:22.859 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-17T11:34:22.859 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-17T11:34:22.859 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-17T11:34:22.859 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-17T11:34:22.859 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-17T11:34:22.859 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-17T11:34:22.860 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-17T11:34:22.860 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-17T11:34:22.860 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-17T11:34:22.860 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-17T11:34:22.860 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-17T11:34:22.860 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-17T11:34:22.860 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-17T11:34:22.860 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-17T11:34:22.860 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-17T11:34:22.860 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-17T11:34:22.860 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key 2023-12-17T11:34:22.860 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-17T11:34:22.860 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp 2023-12-17T11:34:22.861 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-17T11:34:22.861 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-17T11:34:22.861 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-17T11:34:22.861 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-17T11:34:22.861 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-17T11:34:22.861 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-17T11:34:22.861 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-17T11:34:22.861 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc 2023-12-17T11:34:22.861 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-17T11:34:22.861 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154 2023-12-17T11:34:22.861 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-17T11:34:22.861 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls 2023-12-17T11:34:22.861 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-17T11:34:22.861 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter 2023-12-17T11:34:22.861 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset 2023-12-17T11:34:22.862 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-17T11:34:22.862 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-17T11:34:22.862 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-17T11:34:22.862 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-17T11:34:22.862 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-17T11:34:22.862 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-17T11:34:22.862 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-17T11:34:22.862 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-17T11:34:22.862 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-17T11:34:22.862 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-17T11:34:22.862 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-17T11:34:22.862 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-17T11:34:22.862 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-17T11:34:22.862 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-17T11:34:22.862 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-17T11:34:22.862 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-17T11:34:22.862 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs 2023-12-17T11:34:22.863 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-17T11:34:22.863 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-17T11:34:22.863 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-17T11:34:22.863 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-17T11:34:22.863 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-17T11:34:22.863 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-17T11:34:22.863 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-17T11:34:22.863 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-17T11:34:22.863 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-17T11:34:22.863 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-17T11:34:22.863 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-17T11:34:22.863 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-17T11:34:22.863 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-17T11:34:22.863 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-17T11:34:22.863 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-17T11:34:22.863 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-17T11:34:22.863 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-17T11:34:22.864 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-17T11:34:22.864 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-17T11:34:22.864 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-17T11:34:22.864 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-17T11:34:22.864 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-17T11:34:22.864 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-17T11:34:22.864 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-17T11:34:22.864 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-17T11:34:22.864 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-17T11:34:22.864 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-17T11:34:22.864 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-17T11:34:22.864 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-17T11:34:22.864 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-17T11:34:22.864 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-17T11:34:22.865 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-17T11:34:22.865 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-17T11:34:22.865 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-17T11:34:22.865 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-17T11:34:22.865 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-17T11:34:22.865 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-17T11:34:22.865 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-17T11:34:22.865 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-17T11:34:22.865 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-17T11:34:22.865 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-17T11:34:22.865 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-17T11:34:22.865 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-17T11:34:22.865 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-17T11:34:22.865 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-17T11:34:22.866 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-17T11:34:22.866 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-17T11:34:22.866 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-17T11:34:22.866 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-17T11:34:22.866 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-17T11:34:22.866 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-17T11:34:22.866 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-17T11:34:22.866 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-17T11:34:22.866 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-17T11:34:22.866 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-17T11:34:22.866 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-17T11:34:22.866 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-17T11:34:22.866 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-17T11:34:22.866 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_quota.ko 2023-12-17T11:34:22.867 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-17T11:34:22.867 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-17T11:34:22.867 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-17T11:34:22.867 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-17T11:34:22.867 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tunnel.ko 2023-12-17T11:34:22.867 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-17T11:34:22.867 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-17T11:34:22.867 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-17T11:34:22.867 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-17T11:34:22.867 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-17T11:34:22.867 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-17T11:34:22.867 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-17T11:34:22.867 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-17T11:34:22.867 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-17T11:34:22.867 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-17T11:34:22.868 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-17T11:34:22.868 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-17T11:34:22.868 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-17T11:34:22.868 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-17T11:34:22.868 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-17T11:34:22.868 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-17T11:34:22.868 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-17T11:34:22.868 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-17T11:34:22.868 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-17T11:34:22.868 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-17T11:34:22.868 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-17T11:34:22.868 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-17T11:34:22.868 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-17T11:34:22.868 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-17T11:34:22.869 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-17T11:34:22.869 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-17T11:34:22.869 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-17T11:34:22.869 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-17T11:34:22.869 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-17T11:34:22.869 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-17T11:34:22.869 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-17T11:34:22.869 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-17T11:34:22.869 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-17T11:34:22.869 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-17T11:34:22.869 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-17T11:34:22.869 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-17T11:34:22.869 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-17T11:34:22.869 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-17T11:34:22.869 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-17T11:34:22.870 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-17T11:34:22.870 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-17T11:34:22.870 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-17T11:34:22.870 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-17T11:34:22.870 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-17T11:34:22.870 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-17T11:34:22.870 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-17T11:34:22.870 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-17T11:34:22.870 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-17T11:34:22.870 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-17T11:34:22.870 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-17T11:34:22.870 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-17T11:34:22.870 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-17T11:34:22.870 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-17T11:34:22.870 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-17T11:34:22.870 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-17T11:34:22.870 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-17T11:34:22.871 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-17T11:34:22.871 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-17T11:34:22.871 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-17T11:34:22.871 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-17T11:34:22.871 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-17T11:34:22.871 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-17T11:34:22.871 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-17T11:34:22.871 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-17T11:34:22.871 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-17T11:34:22.871 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-17T11:34:22.871 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-17T11:34:22.871 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-17T11:34:22.871 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-17T11:34:22.871 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-17T11:34:22.871 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-17T11:34:22.871 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink 2023-12-17T11:34:22.872 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-17T11:34:22.872 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh 2023-12-17T11:34:22.872 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-17T11:34:22.872 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch 2023-12-17T11:34:22.872 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-17T11:34:22.872 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-17T11:34:22.872 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-17T11:34:22.872 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-17T11:34:22.872 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet 2023-12-17T11:34:22.872 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-17T11:34:22.872 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds 2023-12-17T11:34:22.872 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-17T11:34:22.872 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-17T11:34:22.872 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-17T11:34:22.872 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched 2023-12-17T11:34:22.872 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-17T11:34:22.873 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-17T11:34:22.873 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-17T11:34:22.873 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-17T11:34:22.873 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-17T11:34:22.873 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-17T11:34:22.873 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-17T11:34:22.873 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-17T11:34:22.873 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-17T11:34:22.873 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-17T11:34:22.873 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-17T11:34:22.873 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-17T11:34:22.873 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-17T11:34:22.873 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-17T11:34:22.873 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-17T11:34:22.873 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-17T11:34:22.873 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-17T11:34:22.874 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-17T11:34:22.874 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-17T11:34:22.874 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-17T11:34:22.874 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-17T11:34:22.874 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-17T11:34:22.874 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-17T11:34:22.874 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-17T11:34:22.874 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-17T11:34:22.874 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-17T11:34:22.874 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-17T11:34:22.874 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-17T11:34:22.874 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-17T11:34:22.874 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-17T11:34:22.874 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-17T11:34:22.874 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-17T11:34:22.874 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-17T11:34:22.875 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-17T11:34:22.875 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-17T11:34:22.875 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-17T11:34:22.875 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-17T11:34:22.875 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-17T11:34:22.875 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-17T11:34:22.875 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-17T11:34:22.875 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-17T11:34:22.875 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-17T11:34:22.875 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-17T11:34:22.875 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-17T11:34:22.875 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp 2023-12-17T11:34:22.875 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-17T11:34:22.875 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-17T11:34:22.875 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc 2023-12-17T11:34:22.875 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss 2023-12-17T11:34:22.876 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-17T11:34:22.876 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-17T11:34:22.876 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-17T11:34:22.876 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma 2023-12-17T11:34:22.876 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-17T11:34:22.876 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc 2023-12-17T11:34:22.876 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-17T11:34:22.876 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-17T11:34:22.876 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix 2023-12-17T11:34:22.876 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-17T11:34:22.876 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock 2023-12-17T11:34:22.876 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-17T11:34:22.876 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-17T11:34:22.876 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-17T11:34:22.876 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-17T11:34:22.876 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-17T11:34:22.876 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm 2023-12-17T11:34:22.877 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-17T11:34:22.877 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security 2023-12-17T11:34:22.877 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys 2023-12-17T11:34:22.877 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys 2023-12-17T11:34:22.877 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-17T11:34:22.877 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys 2023-12-17T11:34:22.877 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys/trusted.ko 2023-12-17T11:34:22.877 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt 2023-12-17T11:34:22.877 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib 2023-12-17T11:34:22.877 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-17T11:34:22.877 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-17T11:34:22.877 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-17T11:34:22.877 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-17T11:34:22.877 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-17T11:34:22.878 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-17T11:34:22.878 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-17T11:34:22.878 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-17T11:34:22.878 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-17T11:34:22.878 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-17T11:34:22.878 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-17T11:34:22.878 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-17T11:34:22.878 INFO:teuthology.orchestra.run.smithi100.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-17T11:34:22.879 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-17T11:34:22.879 DEBUG:teuthology.orchestra.run.smithi100:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-17T11:34:22.902 INFO:teuthology.orchestra.run.smithi100.stdout:postinstall scriptlet (using /bin/sh): 2023-12-17T11:34:22.902 INFO:teuthology.orchestra.run.smithi100.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-gcd68252d7b4d -a -r /boot/System.map-6.6.0-gcd68252d7b4d ]; then 2023-12-17T11:34:22.902 INFO:teuthology.orchestra.run.smithi100.stdout:cp /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm 2023-12-17T11:34:22.902 INFO:teuthology.orchestra.run.smithi100.stdout:cp /boot/System.map-6.6.0-gcd68252d7b4d /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-17T11:34:22.902 INFO:teuthology.orchestra.run.smithi100.stdout:rm -f /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/System.map-6.6.0-gcd68252d7b4d 2023-12-17T11:34:22.902 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/installkernel 6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-17T11:34:22.902 INFO:teuthology.orchestra.run.smithi100.stdout:rm -f /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-17T11:34:22.902 INFO:teuthology.orchestra.run.smithi100.stdout:fi 2023-12-17T11:34:22.902 INFO:teuthology.orchestra.run.smithi100.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-17T11:34:22.903 INFO:teuthology.orchestra.run.smithi100.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-17T11:34:22.903 INFO:teuthology.orchestra.run.smithi100.stdout:new-kernel-pkg --remove 6.6.0-gcd68252d7b4d --rminitrd --initrdfile=/boot/initramfs-6.6.0-gcd68252d7b4d.img 2023-12-17T11:34:22.903 INFO:teuthology.orchestra.run.smithi100.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-17T11:34:22.903 INFO:teuthology.orchestra.run.smithi100.stdout:kernel-install remove 6.6.0-gcd68252d7b4d 2023-12-17T11:34:22.903 INFO:teuthology.orchestra.run.smithi100.stdout:fi 2023-12-17T11:34:22.903 INFO:teuthology.orchestra.run.smithi100.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-17T11:34:22.903 INFO:teuthology.orchestra.run.smithi100.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-17T11:34:22.903 INFO:teuthology.orchestra.run.smithi100.stdout:/sbin/update-bootloader --remove 6.6.0-gcd68252d7b4d 2023-12-17T11:34:22.903 INFO:teuthology.orchestra.run.smithi100.stdout:fi 2023-12-17T11:34:22.904 DEBUG:teuthology.orchestra.run.smithi100:> sudo rpm -qi grub2-tools 2023-12-17T11:34:22.990 INFO:teuthology.orchestra.run.smithi100.stdout:Name : grub2-tools 2023-12-17T11:34:22.990 INFO:teuthology.orchestra.run.smithi100.stdout:Epoch : 1 2023-12-17T11:34:22.990 INFO:teuthology.orchestra.run.smithi100.stdout:Version : 2.02 2023-12-17T11:34:22.990 INFO:teuthology.orchestra.run.smithi100.stdout:Release : 123.el8 2023-12-17T11:34:22.990 INFO:teuthology.orchestra.run.smithi100.stdout:Architecture: x86_64 2023-12-17T11:34:22.990 INFO:teuthology.orchestra.run.smithi100.stdout:Install Date: Thu 14 Dec 2023 12:39:42 AM UTC 2023-12-17T11:34:22.990 INFO:teuthology.orchestra.run.smithi100.stdout:Group : System Environment/Base 2023-12-17T11:34:22.990 INFO:teuthology.orchestra.run.smithi100.stdout:Size : 9265450 2023-12-17T11:34:22.990 INFO:teuthology.orchestra.run.smithi100.stdout:License : GPLv3+ 2023-12-17T11:34:22.990 INFO:teuthology.orchestra.run.smithi100.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-12-17T11:34:22.990 INFO:teuthology.orchestra.run.smithi100.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-12-17T11:34:22.991 INFO:teuthology.orchestra.run.smithi100.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-12-17T11:34:22.991 INFO:teuthology.orchestra.run.smithi100.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-12-17T11:34:22.991 INFO:teuthology.orchestra.run.smithi100.stdout:Relocations : (not relocatable) 2023-12-17T11:34:22.991 INFO:teuthology.orchestra.run.smithi100.stdout:Packager : Red Hat, Inc. 2023-12-17T11:34:22.991 INFO:teuthology.orchestra.run.smithi100.stdout:Vendor : Red Hat, Inc. 2023-12-17T11:34:22.991 INFO:teuthology.orchestra.run.smithi100.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-17T11:34:22.991 INFO:teuthology.orchestra.run.smithi100.stdout:Summary : Support tools for GRUB. 2023-12-17T11:34:22.991 INFO:teuthology.orchestra.run.smithi100.stdout:Description : 2023-12-17T11:34:22.991 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-17T11:34:22.991 INFO:teuthology.orchestra.run.smithi100.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-17T11:34:22.992 INFO:teuthology.orchestra.run.smithi100.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-17T11:34:22.992 INFO:teuthology.orchestra.run.smithi100.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-17T11:34:22.992 INFO:teuthology.orchestra.run.smithi100.stdout:hardware devices. 2023-12-17T11:34:22.992 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-17T11:34:22.992 INFO:teuthology.orchestra.run.smithi100.stdout:This subpackage provides tools for support of all platforms. 2023-12-17T11:34:22.993 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-17T11:34:22.993 INFO:teuthology.task.kernel:Updating grub on smithi100 to boot 6.6.0-gcd68252d7b4d 2023-12-17T11:34:22.993 DEBUG:teuthology.orchestra.run.smithi100:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-17T11:34:23.721 INFO:teuthology.orchestra.run.smithi100.stderr:Generating grub configuration file ... 2023-12-17T11:34:25.862 INFO:teuthology.orchestra.run.smithi100.stderr:done 2023-12-17T11:34:25.864 DEBUG:teuthology.orchestra.run.smithi100:> mktemp 2023-12-17T11:34:25.888 INFO:teuthology.orchestra.run.smithi100.stdout:/tmp/tmp.QNC0rXKepV 2023-12-17T11:34:25.889 DEBUG:teuthology.orchestra.run.smithi100:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.QNC0rXKepV 2023-12-17T11:34:25.962 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 0666 /tmp/tmp.QNC0rXKepV 2023-12-17T11:34:26.124 DEBUG:teuthology.orchestra.remote:smithi100:/tmp/tmp.QNC0rXKepV is 6KB 2023-12-17T11:34:26.172 DEBUG:teuthology.orchestra.run.smithi100:> rm -fr /tmp/tmp.QNC0rXKepV 2023-12-17T11:34:26.188 DEBUG:teuthology.orchestra.run.smithi100:> sudo /bin/ls /boot/loader/entries || true 2023-12-17T11:34:26.253 INFO:teuthology.orchestra.run.smithi100.stdout:2db68f91c8f90721a6596efe657a5324-0-rescue.conf 2023-12-17T11:34:26.253 INFO:teuthology.orchestra.run.smithi100.stdout:2db68f91c8f90721a6596efe657a5324-6.6.0-gcd68252d7b4d.conf 2023-12-17T11:34:26.253 INFO:teuthology.orchestra.run.smithi100.stdout:963f8b6c99184de696879b3f7da9ecce-0-rescue.conf 2023-12-17T11:34:26.253 INFO:teuthology.orchestra.run.smithi100.stdout:963f8b6c99184de696879b3f7da9ecce-4.18.0-372.9.1.el8.x86_64.conf 2023-12-17T11:34:26.253 INFO:teuthology.orchestra.run.smithi100.stdout:963f8b6c99184de696879b3f7da9ecce-4.18.0-513.9.1.el8_9.x86_64.conf 2023-12-17T11:34:26.254 DEBUG:teuthology.orchestra.run.smithi100:> sudo grub2-set-default 2db68f91c8f90721a6596efe657a5324-6.6.0-gcd68252d7b4d 2023-12-17T11:34:26.403 DEBUG:teuthology.orchestra.run.smithi100:> sudo shutdown -r now 2023-12-17T11:34:56.406 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-12-17T11:34:56.407 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2023-12-17T11:34:56.408 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:35:14.965 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-12-17T11:35:23.967 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2023-12-17T11:35:23.968 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:35:27.025 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-12-17T11:35:39.027 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2023-12-17T11:35:39.028 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:35:53.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17 11:35:53 URL:https://1.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/8/flavors/default/x86_64/kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm [383180176/383180176] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-17T11:35:53.082 INFO:teuthology.orchestra.run.smithi008.stderr:FINISHED --2023-12-17 11:35:53-- 2023-12-17T11:35:53.082 INFO:teuthology.orchestra.run.smithi008.stderr:Total wall clock time: 7m 1s 2023-12-17T11:35:53.082 INFO:teuthology.orchestra.run.smithi008.stderr:Downloaded: 1 files, 365M in 7m 0s (890 KB/s) 2023-12-17T11:35:53.085 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on mon.a... 2023-12-17T11:35:53.085 DEBUG:teuthology.orchestra.run.smithi008:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-17T11:35:55.063 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying... ######################################## 2023-12-17T11:35:55.163 INFO:teuthology.orchestra.run.smithi008.stdout:Preparing... ######################################## 2023-12-17T11:35:55.333 INFO:teuthology.orchestra.run.smithi008.stdout:Updating / installing... 2023-12-17T11:35:57.461 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.100 2023-12-17T11:36:06.734 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17 11:36:06 URL:https://1.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/8/flavors/default/x86_64/kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm [383180176/383180176] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-17T11:36:06.735 INFO:teuthology.orchestra.run.smithi186.stderr:FINISHED --2023-12-17 11:36:06-- 2023-12-17T11:36:06.735 INFO:teuthology.orchestra.run.smithi186.stderr:Total wall clock time: 7m 14s 2023-12-17T11:36:06.735 INFO:teuthology.orchestra.run.smithi186.stderr:Downloaded: 1 files, 365M in 7m 14s (863 KB/s) 2023-12-17T11:36:06.737 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on mon.c... 2023-12-17T11:36:06.738 DEBUG:teuthology.orchestra.run.smithi186:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-17T11:36:08.519 INFO:teuthology.orchestra.run.smithi186.stdout:Verifying... ######################################## 2023-12-17T11:36:08.602 INFO:teuthology.orchestra.run.smithi186.stdout:Preparing... ######################################## 2023-12-17T11:36:08.747 INFO:teuthology.orchestra.run.smithi186.stdout:Updating / installing... 2023-12-17T11:36:12.462 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2023-12-17T11:36:12.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:36:13.064 DEBUG:teuthology.orchestra.run.smithi100:> true 2023-12-17T11:36:13.457 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2023-12-17T11:36:13.458 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.6.0-gcd68252d7b4d"... 2023-12-17T11:36:13.458 DEBUG:teuthology.orchestra.run.smithi100:> uname -r 2023-12-17T11:36:13.499 INFO:teuthology.orchestra.run.smithi100.stdout:6.6.0-gcd68252d7b4d 2023-12-17T11:36:13.499 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-17T11:36:13.500 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-17T11:36:13.500 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-12-17T11:36:14.501 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-12-17T11:36:14.501 DEBUG:teuthology.orchestra.run.smithi100:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-17T11:36:14.644 INFO:teuthology.orchestra.run.smithi100.stdout:ttyS1 2023-12-17T11:36:14.671 DEBUG:teuthology.parallel:result is None 2023-12-17T11:36:37.447 INFO:teuthology.orchestra.run.smithi008.stdout:kernel-6.6.0_gcd68252d7b4d-1 ######################################## 2023-12-17T11:36:39.037 INFO:teuthology.orchestra.run.smithi008.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-17T11:36:47.087 INFO:teuthology.orchestra.run.smithi186.stdout:kernel-6.6.0_gcd68252d7b4d-1 ######################################## 2023-12-17T11:36:48.468 INFO:teuthology.orchestra.run.smithi186.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-17T11:37:02.317 INFO:teuthology.orchestra.run.smithi008.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-17T11:37:08.492 INFO:teuthology.orchestra.run.smithi186.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-17T11:39:12.668 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi186.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-17T11:39:12.668 DEBUG:teuthology.orchestra.run.smithi186:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-17T11:39:12.724 INFO:teuthology.orchestra.run.smithi186.stdout:/boot/System.map-6.6.0-gcd68252d7b4d 2023-12-17T11:39:12.724 INFO:teuthology.orchestra.run.smithi186.stdout:/boot/config-6.6.0-gcd68252d7b4d 2023-12-17T11:39:12.724 INFO:teuthology.orchestra.run.smithi186.stdout:/boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-17T11:39:12.724 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d 2023-12-17T11:39:12.724 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel 2023-12-17T11:39:12.724 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch 2023-12-17T11:39:12.724 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86 2023-12-17T11:39:12.724 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto 2023-12-17T11:39:12.724 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-17T11:39:12.725 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-17T11:39:12.725 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-17T11:39:12.725 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-17T11:39:12.725 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-17T11:39:12.725 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-17T11:39:12.725 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-17T11:39:12.725 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-17T11:39:12.725 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-17T11:39:12.725 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-17T11:39:12.726 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-17T11:39:12.726 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-17T11:39:12.726 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-17T11:39:12.726 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-17T11:39:12.726 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-17T11:39:12.726 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-17T11:39:12.726 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-17T11:39:12.726 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-17T11:39:12.726 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-17T11:39:12.726 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-17T11:39:12.726 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel 2023-12-17T11:39:12.726 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu 2023-12-17T11:39:12.726 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce 2023-12-17T11:39:12.726 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-17T11:39:12.727 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm 2023-12-17T11:39:12.727 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-17T11:39:12.727 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-17T11:39:12.727 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-17T11:39:12.727 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto 2023-12-17T11:39:12.727 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-17T11:39:12.727 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-17T11:39:12.727 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-17T11:39:12.727 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx 2023-12-17T11:39:12.727 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-17T11:39:12.727 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-17T11:39:12.727 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-17T11:39:12.727 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-17T11:39:12.728 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-17T11:39:12.728 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-17T11:39:12.728 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-17T11:39:12.728 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-17T11:39:12.728 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-17T11:39:12.728 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-17T11:39:12.728 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-17T11:39:12.728 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-17T11:39:12.728 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-17T11:39:12.728 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-17T11:39:12.728 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-17T11:39:12.728 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-17T11:39:12.728 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-17T11:39:12.728 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-17T11:39:12.728 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-17T11:39:12.728 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-17T11:39:12.729 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-17T11:39:12.729 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-17T11:39:12.729 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-17T11:39:12.729 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-17T11:39:12.729 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-17T11:39:12.729 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-17T11:39:12.729 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-17T11:39:12.729 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-17T11:39:12.729 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-17T11:39:12.729 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-17T11:39:12.729 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-17T11:39:12.729 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-17T11:39:12.729 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-17T11:39:12.729 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-17T11:39:12.730 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-17T11:39:12.730 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-17T11:39:12.730 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-17T11:39:12.730 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-17T11:39:12.730 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-17T11:39:12.730 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-17T11:39:12.730 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-17T11:39:12.730 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-17T11:39:12.730 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-17T11:39:12.730 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-17T11:39:12.730 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-17T11:39:12.730 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers 2023-12-17T11:39:12.730 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi 2023-12-17T11:39:12.730 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-17T11:39:12.730 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-17T11:39:12.730 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/custom_method.ko 2023-12-17T11:39:12.730 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-17T11:39:12.731 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-17T11:39:12.731 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-17T11:39:12.731 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-17T11:39:12.731 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-17T11:39:12.731 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata 2023-12-17T11:39:12.731 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-17T11:39:12.731 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-17T11:39:12.731 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ata_generic.ko 2023-12-17T11:39:12.731 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-17T11:39:12.731 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-17T11:39:12.731 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-17T11:39:12.731 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-17T11:39:12.731 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-17T11:39:12.731 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-17T11:39:12.732 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-17T11:39:12.732 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-17T11:39:12.732 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-17T11:39:12.732 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-17T11:39:12.733 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-17T11:39:12.733 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-17T11:39:12.733 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-17T11:39:12.733 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-17T11:39:12.733 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-17T11:39:12.733 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-17T11:39:12.733 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-17T11:39:12.733 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-17T11:39:12.733 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-17T11:39:12.733 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-17T11:39:12.733 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-17T11:39:12.733 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-17T11:39:12.733 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-17T11:39:12.733 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-17T11:39:12.733 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-17T11:39:12.734 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-17T11:39:12.734 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-17T11:39:12.734 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-17T11:39:12.734 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-17T11:39:12.734 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-17T11:39:12.734 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-17T11:39:12.734 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-17T11:39:12.734 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-17T11:39:12.734 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-17T11:39:12.734 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-17T11:39:12.734 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sis.ko 2023-12-17T11:39:12.734 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-17T11:39:12.734 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-17T11:39:12.734 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-17T11:39:12.734 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-17T11:39:12.735 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-17T11:39:12.735 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-17T11:39:12.735 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-17T11:39:12.735 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-17T11:39:12.735 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-17T11:39:12.735 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-17T11:39:12.735 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-17T11:39:12.735 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-17T11:39:12.735 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-17T11:39:12.735 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-17T11:39:12.735 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-17T11:39:12.735 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-17T11:39:12.735 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-17T11:39:12.735 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay 2023-12-17T11:39:12.735 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-17T11:39:12.735 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base 2023-12-17T11:39:12.735 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap 2023-12-17T11:39:12.736 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-17T11:39:12.736 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-17T11:39:12.736 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma 2023-12-17T11:39:12.736 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-17T11:39:12.736 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block 2023-12-17T11:39:12.736 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe 2023-12-17T11:39:12.736 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-17T11:39:12.736 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/brd.ko 2023-12-17T11:39:12.736 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd 2023-12-17T11:39:12.736 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-17T11:39:12.736 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-17T11:39:12.736 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/loop.ko 2023-12-17T11:39:12.736 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx 2023-12-17T11:39:12.736 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-17T11:39:12.736 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-17T11:39:12.737 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk 2023-12-17T11:39:12.737 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-17T11:39:12.737 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-17T11:39:12.737 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-17T11:39:12.737 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/virtio_blk.ko 2023-12-17T11:39:12.737 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback 2023-12-17T11:39:12.737 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-17T11:39:12.737 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkfront.ko 2023-12-17T11:39:12.737 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram 2023-12-17T11:39:12.737 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-17T11:39:12.737 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char 2023-12-17T11:39:12.737 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-17T11:39:12.737 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random 2023-12-17T11:39:12.737 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-17T11:39:12.738 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-17T11:39:12.738 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-17T11:39:12.738 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-17T11:39:12.738 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-17T11:39:12.738 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi 2023-12-17T11:39:12.738 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-17T11:39:12.738 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-17T11:39:12.738 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-17T11:39:12.738 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-17T11:39:12.738 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-17T11:39:12.738 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-17T11:39:12.738 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-17T11:39:12.738 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave 2023-12-17T11:39:12.738 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-17T11:39:12.738 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-17T11:39:12.738 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-17T11:39:12.739 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm 2023-12-17T11:39:12.739 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm.ko 2023-12-17T11:39:12.739 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-17T11:39:12.739 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-17T11:39:12.739 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-17T11:39:12.739 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-17T11:39:12.739 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-17T11:39:12.739 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/uv_mmtimer.ko 2023-12-17T11:39:12.739 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/virtio_console.ko 2023-12-17T11:39:12.739 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq 2023-12-17T11:39:12.739 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-17T11:39:12.739 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-17T11:39:12.739 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-17T11:39:12.740 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-17T11:39:12.740 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-17T11:39:12.740 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-17T11:39:12.740 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto 2023-12-17T11:39:12.740 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp 2023-12-17T11:39:12.740 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-17T11:39:12.740 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-17T11:39:12.740 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel 2023-12-17T11:39:12.740 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat 2023-12-17T11:39:12.740 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common 2023-12-17T11:39:12.740 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-17T11:39:12.740 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-17T11:39:12.740 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-17T11:39:12.740 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-17T11:39:12.740 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-17T11:39:12.740 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio 2023-12-17T11:39:12.741 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-17T11:39:12.741 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca 2023-12-17T11:39:12.741 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-17T11:39:12.741 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq 2023-12-17T11:39:12.741 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-17T11:39:12.741 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma 2023-12-17T11:39:12.741 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw 2023-12-17T11:39:12.741 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-17T11:39:12.741 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat 2023-12-17T11:39:12.741 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-17T11:39:12.741 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac 2023-12-17T11:39:12.741 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-17T11:39:12.741 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-17T11:39:12.741 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-17T11:39:12.741 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-17T11:39:12.741 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-17T11:39:12.742 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-17T11:39:12.742 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-17T11:39:12.742 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-17T11:39:12.742 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-17T11:39:12.742 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-17T11:39:12.742 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-17T11:39:12.742 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-17T11:39:12.742 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-17T11:39:12.742 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware 2023-12-17T11:39:12.742 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/edd.ko 2023-12-17T11:39:12.742 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-17T11:39:12.742 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio 2023-12-17T11:39:12.742 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-17T11:39:12.742 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-17T11:39:12.743 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid 2023-12-17T11:39:12.743 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-17T11:39:12.743 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-17T11:39:12.743 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-17T11:39:12.743 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-17T11:39:12.743 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-17T11:39:12.743 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-17T11:39:12.743 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-17T11:39:12.743 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-17T11:39:12.743 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-17T11:39:12.743 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-17T11:39:12.743 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-17T11:39:12.743 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-17T11:39:12.743 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-17T11:39:12.743 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-17T11:39:12.744 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-17T11:39:12.744 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-17T11:39:12.744 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-17T11:39:12.744 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-17T11:39:12.744 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-17T11:39:12.744 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-17T11:39:12.744 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-17T11:39:12.744 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-17T11:39:12.744 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-17T11:39:12.744 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-17T11:39:12.744 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-17T11:39:12.744 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-17T11:39:12.744 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-17T11:39:12.744 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-17T11:39:12.744 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-17T11:39:12.745 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-17T11:39:12.745 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-17T11:39:12.745 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-17T11:39:12.745 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-17T11:39:12.745 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-17T11:39:12.745 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-17T11:39:12.745 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-17T11:39:12.745 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-17T11:39:12.745 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-17T11:39:12.745 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-17T11:39:12.745 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-17T11:39:12.745 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-17T11:39:12.745 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-17T11:39:12.745 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-17T11:39:12.745 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-17T11:39:12.745 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-17T11:39:12.746 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-17T11:39:12.746 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-17T11:39:12.746 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-17T11:39:12.746 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-17T11:39:12.746 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-17T11:39:12.746 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-17T11:39:12.746 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-17T11:39:12.746 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-17T11:39:12.746 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-17T11:39:12.746 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-17T11:39:12.746 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-17T11:39:12.746 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-17T11:39:12.746 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-17T11:39:12.746 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-17T11:39:12.746 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-17T11:39:12.747 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-17T11:39:12.747 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-17T11:39:12.747 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-17T11:39:12.747 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-17T11:39:12.747 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv 2023-12-17T11:39:12.747 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-17T11:39:12.747 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-17T11:39:12.747 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-17T11:39:12.747 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon 2023-12-17T11:39:12.747 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-17T11:39:12.747 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-17T11:39:12.747 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-17T11:39:12.747 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-17T11:39:12.747 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-17T11:39:12.747 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-17T11:39:12.748 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-17T11:39:12.748 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-17T11:39:12.748 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-17T11:39:12.748 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-17T11:39:12.748 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-17T11:39:12.748 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-17T11:39:12.748 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-17T11:39:12.748 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-17T11:39:12.748 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-17T11:39:12.748 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-17T11:39:12.748 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-17T11:39:12.749 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-17T11:39:12.749 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-17T11:39:12.749 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-17T11:39:12.749 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-17T11:39:12.749 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-17T11:39:12.749 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-17T11:39:12.749 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-17T11:39:12.749 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-17T11:39:12.749 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-17T11:39:12.749 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-17T11:39:12.749 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-17T11:39:12.749 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-17T11:39:12.749 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-17T11:39:12.749 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-17T11:39:12.750 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-17T11:39:12.750 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-17T11:39:12.750 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-17T11:39:12.750 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-17T11:39:12.750 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-17T11:39:12.750 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-17T11:39:12.750 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-17T11:39:12.750 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-17T11:39:12.750 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-17T11:39:12.750 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-17T11:39:12.750 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-17T11:39:12.750 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-17T11:39:12.750 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-17T11:39:12.750 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-17T11:39:12.750 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-17T11:39:12.751 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-17T11:39:12.751 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-17T11:39:12.751 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-17T11:39:12.751 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-17T11:39:12.751 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-17T11:39:12.751 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-17T11:39:12.751 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-17T11:39:12.751 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-17T11:39:12.751 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-17T11:39:12.751 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-17T11:39:12.751 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-17T11:39:12.751 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-17T11:39:12.751 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-17T11:39:12.751 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-17T11:39:12.751 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-17T11:39:12.752 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-17T11:39:12.752 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-17T11:39:12.752 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-17T11:39:12.752 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-17T11:39:12.752 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-17T11:39:12.752 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-17T11:39:12.752 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-17T11:39:12.752 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-17T11:39:12.752 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-17T11:39:12.752 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-17T11:39:12.752 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-17T11:39:12.752 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-17T11:39:12.752 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-17T11:39:12.752 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-17T11:39:12.753 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-17T11:39:12.753 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-17T11:39:12.753 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-17T11:39:12.753 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-17T11:39:12.753 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-17T11:39:12.753 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-17T11:39:12.753 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-17T11:39:12.753 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-17T11:39:12.753 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-17T11:39:12.753 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-17T11:39:12.753 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-17T11:39:12.753 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-17T11:39:12.753 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-17T11:39:12.753 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus 2023-12-17T11:39:12.753 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-17T11:39:12.754 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-17T11:39:12.754 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-17T11:39:12.754 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-17T11:39:12.754 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-17T11:39:12.754 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-17T11:39:12.754 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-17T11:39:12.754 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-17T11:39:12.754 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-17T11:39:12.754 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-17T11:39:12.754 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-17T11:39:12.754 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-17T11:39:12.754 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-17T11:39:12.754 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-17T11:39:12.754 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-17T11:39:12.754 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-17T11:39:12.755 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-17T11:39:12.755 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-17T11:39:12.755 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-17T11:39:12.755 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-17T11:39:12.755 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-17T11:39:12.755 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-17T11:39:12.755 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-17T11:39:12.755 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-17T11:39:12.755 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-17T11:39:12.755 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-17T11:39:12.755 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-17T11:39:12.755 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-17T11:39:12.755 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-17T11:39:12.755 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-17T11:39:12.756 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-17T11:39:12.756 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-17T11:39:12.756 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-17T11:39:12.756 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-17T11:39:12.756 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-17T11:39:12.756 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-17T11:39:12.756 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-17T11:39:12.756 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-17T11:39:12.756 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-17T11:39:12.756 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-17T11:39:12.756 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-17T11:39:12.756 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c 2023-12-17T11:39:12.756 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos 2023-12-17T11:39:12.756 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-17T11:39:12.757 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-17T11:39:12.757 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses 2023-12-17T11:39:12.757 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-17T11:39:12.757 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-17T11:39:12.757 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-17T11:39:12.757 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-17T11:39:12.757 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-17T11:39:12.757 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-17T11:39:12.757 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-17T11:39:12.757 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-17T11:39:12.757 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-17T11:39:12.757 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-17T11:39:12.757 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-17T11:39:12.757 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-17T11:39:12.757 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-17T11:39:12.758 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-17T11:39:12.758 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-17T11:39:12.758 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-17T11:39:12.758 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-17T11:39:12.758 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-17T11:39:12.758 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-17T11:39:12.758 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-17T11:39:12.758 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-17T11:39:12.758 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-17T11:39:12.758 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-17T11:39:12.758 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-dev.ko 2023-12-17T11:39:12.758 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-17T11:39:12.758 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-17T11:39:12.758 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-17T11:39:12.759 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-17T11:39:12.759 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband 2023-12-17T11:39:12.759 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core 2023-12-17T11:39:12.759 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-17T11:39:12.759 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-17T11:39:12.759 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-17T11:39:12.759 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-17T11:39:12.759 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-17T11:39:12.759 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-17T11:39:12.759 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-17T11:39:12.759 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw 2023-12-17T11:39:12.759 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4 2023-12-17T11:39:12.759 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-17T11:39:12.760 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4 2023-12-17T11:39:12.760 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-17T11:39:12.760 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5 2023-12-17T11:39:12.760 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-17T11:39:12.760 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca 2023-12-17T11:39:12.760 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-17T11:39:12.760 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp 2023-12-17T11:39:12.760 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib 2023-12-17T11:39:12.760 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-17T11:39:12.760 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser 2023-12-17T11:39:12.760 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-17T11:39:12.760 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert 2023-12-17T11:39:12.760 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-17T11:39:12.760 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp 2023-12-17T11:39:12.760 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-17T11:39:12.761 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt 2023-12-17T11:39:12.761 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-17T11:39:12.761 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input 2023-12-17T11:39:12.761 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport 2023-12-17T11:39:12.761 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-17T11:39:12.761 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-17T11:39:12.761 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-17T11:39:12.761 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-17T11:39:12.761 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard 2023-12-17T11:39:12.761 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-17T11:39:12.761 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse 2023-12-17T11:39:12.761 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-17T11:39:12.761 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-17T11:39:12.761 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-17T11:39:12.762 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-17T11:39:12.762 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-17T11:39:12.762 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-17T11:39:12.762 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-17T11:39:12.762 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-17T11:39:12.762 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4 2023-12-17T11:39:12.762 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-17T11:39:12.762 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio 2023-12-17T11:39:12.762 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-17T11:39:12.762 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-17T11:39:12.762 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-17T11:39:12.762 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-17T11:39:12.762 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-17T11:39:12.762 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu 2023-12-17T11:39:12.762 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd 2023-12-17T11:39:12.763 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-17T11:39:12.763 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds 2023-12-17T11:39:12.763 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-17T11:39:12.763 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-17T11:39:12.763 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-17T11:39:12.763 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-17T11:39:12.763 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger 2023-12-17T11:39:12.763 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-17T11:39:12.763 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-17T11:39:12.763 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-17T11:39:12.763 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-17T11:39:12.763 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-17T11:39:12.763 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-17T11:39:12.763 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-17T11:39:12.764 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-17T11:39:12.764 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md 2023-12-17T11:39:12.764 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache 2023-12-17T11:39:12.764 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-17T11:39:12.764 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-17T11:39:12.764 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-17T11:39:12.764 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-17T11:39:12.764 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-17T11:39:12.764 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-17T11:39:12.764 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-17T11:39:12.764 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-17T11:39:12.764 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-17T11:39:12.764 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-17T11:39:12.764 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-17T11:39:12.765 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-17T11:39:12.765 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-17T11:39:12.765 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-17T11:39:12.765 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-17T11:39:12.765 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-17T11:39:12.765 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-17T11:39:12.765 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-17T11:39:12.765 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-17T11:39:12.765 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data 2023-12-17T11:39:12.765 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-17T11:39:12.765 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-17T11:39:12.765 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-17T11:39:12.765 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-17T11:39:12.765 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-17T11:39:12.766 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message 2023-12-17T11:39:12.766 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion 2023-12-17T11:39:12.766 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-17T11:39:12.766 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-17T11:39:12.766 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-17T11:39:12.766 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-17T11:39:12.766 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-17T11:39:12.766 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-17T11:39:12.766 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-17T11:39:12.766 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd 2023-12-17T11:39:12.766 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-17T11:39:12.766 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-17T11:39:12.766 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mfd-core.ko 2023-12-17T11:39:12.766 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-17T11:39:12.767 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-17T11:39:12.767 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-17T11:39:12.767 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-17T11:39:12.767 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc 2023-12-17T11:39:12.767 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl 2023-12-17T11:39:12.767 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-17T11:39:12.767 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-17T11:39:12.767 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-17T11:39:12.767 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-17T11:39:12.767 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710 2023-12-17T11:39:12.767 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-17T11:39:12.767 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom 2023-12-17T11:39:12.768 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-17T11:39:12.768 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-17T11:39:12.768 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-17T11:39:12.768 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-17T11:39:12.768 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-17T11:39:12.768 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-17T11:39:12.768 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-17T11:39:12.768 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-17T11:39:12.768 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d 2023-12-17T11:39:12.768 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-17T11:39:12.768 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-17T11:39:12.768 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei 2023-12-17T11:39:12.768 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-17T11:39:12.768 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-17T11:39:12.769 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-17T11:39:12.769 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru 2023-12-17T11:39:12.769 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-17T11:39:12.769 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp 2023-12-17T11:39:12.769 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-17T11:39:12.769 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-17T11:39:12.769 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-17T11:39:12.769 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-17T11:39:12.769 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-17T11:39:12.769 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-17T11:39:12.769 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-17T11:39:12.769 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci 2023-12-17T11:39:12.769 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-17T11:39:12.769 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net 2023-12-17T11:39:12.770 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding 2023-12-17T11:39:12.770 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-17T11:39:12.770 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa 2023-12-17T11:39:12.770 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53 2023-12-17T11:39:12.770 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-17T11:39:12.770 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-17T11:39:12.770 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-17T11:39:12.770 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx 2023-12-17T11:39:12.770 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-17T11:39:12.770 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-17T11:39:12.770 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-17T11:39:12.770 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet 2023-12-17T11:39:12.770 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com 2023-12-17T11:39:12.770 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-17T11:39:12.771 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-17T11:39:12.771 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-17T11:39:12.771 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-17T11:39:12.771 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390 2023-12-17T11:39:12.771 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-17T11:39:12.771 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-17T11:39:12.771 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-17T11:39:12.771 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-17T11:39:12.771 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec 2023-12-17T11:39:12.771 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-17T11:39:12.771 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere 2023-12-17T11:39:12.771 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-17T11:39:12.771 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon 2023-12-17T11:39:12.771 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-17T11:39:12.771 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera 2023-12-17T11:39:12.771 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-17T11:39:12.772 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd 2023-12-17T11:39:12.772 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-17T11:39:12.772 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-17T11:39:12.772 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-17T11:39:12.772 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros 2023-12-17T11:39:12.772 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx 2023-12-17T11:39:12.772 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-17T11:39:12.772 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-17T11:39:12.772 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-17T11:39:12.772 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-17T11:39:12.772 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-17T11:39:12.772 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx 2023-12-17T11:39:12.772 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-17T11:39:12.772 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-17T11:39:12.773 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom 2023-12-17T11:39:12.773 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-17T11:39:12.773 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-17T11:39:12.773 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-17T11:39:12.773 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-17T11:39:12.773 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-17T11:39:12.773 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet 2023-12-17T11:39:12.773 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-17T11:39:12.773 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-17T11:39:12.773 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade 2023-12-17T11:39:12.773 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna 2023-12-17T11:39:12.773 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-17T11:39:12.773 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio 2023-12-17T11:39:12.773 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-17T11:39:12.774 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-17T11:39:12.774 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-17T11:39:12.774 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-17T11:39:12.774 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-17T11:39:12.774 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-17T11:39:12.774 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-17T11:39:12.774 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-17T11:39:12.774 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-17T11:39:12.774 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-17T11:39:12.774 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco 2023-12-17T11:39:12.774 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic 2023-12-17T11:39:12.774 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-17T11:39:12.774 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec 2023-12-17T11:39:12.774 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip 2023-12-17T11:39:12.774 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-17T11:39:12.775 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-17T11:39:12.775 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-17T11:39:12.775 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-17T11:39:12.775 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-17T11:39:12.775 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-17T11:39:12.775 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink 2023-12-17T11:39:12.775 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-17T11:39:12.775 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-17T11:39:12.775 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-17T11:39:12.775 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex 2023-12-17T11:39:12.775 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet 2023-12-17T11:39:12.775 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-17T11:39:12.775 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-17T11:39:12.776 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-17T11:39:12.776 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel 2023-12-17T11:39:12.776 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-17T11:39:12.776 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000 2023-12-17T11:39:12.776 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-17T11:39:12.776 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e 2023-12-17T11:39:12.776 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-17T11:39:12.776 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k 2023-12-17T11:39:12.776 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-17T11:39:12.776 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e 2023-12-17T11:39:12.776 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-17T11:39:12.776 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf 2023-12-17T11:39:12.776 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-17T11:39:12.776 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb 2023-12-17T11:39:12.777 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-17T11:39:12.777 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf 2023-12-17T11:39:12.777 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-17T11:39:12.777 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-17T11:39:12.777 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-17T11:39:12.777 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-17T11:39:12.777 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-17T11:39:12.777 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-17T11:39:12.777 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell 2023-12-17T11:39:12.777 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-17T11:39:12.777 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-17T11:39:12.777 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-17T11:39:12.777 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox 2023-12-17T11:39:12.777 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-17T11:39:12.778 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-17T11:39:12.778 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-17T11:39:12.778 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-17T11:39:12.778 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-17T11:39:12.778 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-17T11:39:12.778 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel 2023-12-17T11:39:12.778 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-17T11:39:12.778 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom 2023-12-17T11:39:12.778 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-17T11:39:12.778 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-17T11:39:12.778 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi 2023-12-17T11:39:12.778 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-17T11:39:12.778 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-17T11:39:12.778 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion 2023-12-17T11:39:12.778 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-17T11:39:12.779 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia 2023-12-17T11:39:12.779 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-17T11:39:12.779 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines 2023-12-17T11:39:12.779 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-17T11:39:12.779 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-17T11:39:12.779 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic 2023-12-17T11:39:12.779 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-17T11:39:12.779 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-17T11:39:12.779 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-17T11:39:12.779 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-17T11:39:12.779 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-17T11:39:12.779 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc 2023-12-17T11:39:12.779 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-17T11:39:12.779 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek 2023-12-17T11:39:12.779 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-17T11:39:12.780 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-17T11:39:12.780 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-17T11:39:12.780 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-17T11:39:12.780 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker 2023-12-17T11:39:12.780 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-17T11:39:12.780 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc 2023-12-17T11:39:12.780 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-17T11:39:12.780 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan 2023-12-17T11:39:12.780 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-17T11:39:12.780 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis 2023-12-17T11:39:12.780 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-17T11:39:12.780 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-17T11:39:12.780 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc 2023-12-17T11:39:12.780 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-17T11:39:12.780 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-17T11:39:12.781 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-17T11:39:12.781 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-17T11:39:12.781 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro 2023-12-17T11:39:12.781 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-17T11:39:12.781 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-17T11:39:12.781 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-17T11:39:12.781 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun 2023-12-17T11:39:12.781 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-17T11:39:12.781 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-17T11:39:12.781 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-17T11:39:12.784 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-17T11:39:12.785 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti 2023-12-17T11:39:12.785 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-17T11:39:12.785 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti 2023-12-17T11:39:12.785 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-17T11:39:12.785 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via 2023-12-17T11:39:12.785 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-17T11:39:12.785 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-17T11:39:12.785 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet 2023-12-17T11:39:12.785 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-17T11:39:12.785 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-17T11:39:12.785 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom 2023-12-17T11:39:12.785 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-17T11:39:12.785 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-17T11:39:12.785 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv 2023-12-17T11:39:12.786 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-17T11:39:12.786 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154 2023-12-17T11:39:12.786 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-17T11:39:12.786 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-17T11:39:12.786 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan 2023-12-17T11:39:12.786 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-17T11:39:12.786 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-17T11:39:12.786 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-17T11:39:12.786 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio 2023-12-17T11:39:12.786 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-17T11:39:12.786 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-17T11:39:12.786 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-17T11:39:12.787 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-17T11:39:12.787 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-17T11:39:12.787 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/net_failover.ko 2023-12-17T11:39:12.787 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-17T11:39:12.787 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-17T11:39:12.787 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs 2023-12-17T11:39:12.787 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-17T11:39:12.787 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-17T11:39:12.787 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy 2023-12-17T11:39:12.787 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-17T11:39:12.787 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-17T11:39:12.787 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-17T11:39:12.787 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-17T11:39:12.787 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-17T11:39:12.788 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-17T11:39:12.788 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-17T11:39:12.788 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-17T11:39:12.788 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/dp83640.ko 2023-12-17T11:39:12.788 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-17T11:39:12.788 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-17T11:39:12.788 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-17T11:39:12.788 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-17T11:39:12.788 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-17T11:39:12.788 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-17T11:39:12.788 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-17T11:39:12.788 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-17T11:39:12.788 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-17T11:39:12.788 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-17T11:39:12.788 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-17T11:39:12.789 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-17T11:39:12.789 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp 2023-12-17T11:39:12.789 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-17T11:39:12.789 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-17T11:39:12.789 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-17T11:39:12.789 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-17T11:39:12.789 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-17T11:39:12.789 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-17T11:39:12.789 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-17T11:39:12.789 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-17T11:39:12.789 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-17T11:39:12.789 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip 2023-12-17T11:39:12.789 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slhc.ko 2023-12-17T11:39:12.790 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-17T11:39:12.790 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-17T11:39:12.790 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-17T11:39:12.790 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team 2023-12-17T11:39:12.790 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-17T11:39:12.790 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-17T11:39:12.790 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-17T11:39:12.790 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-17T11:39:12.790 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-17T11:39:12.790 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-17T11:39:12.790 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tun.ko 2023-12-17T11:39:12.790 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-17T11:39:12.790 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/virtio_net.ko 2023-12-17T11:39:12.790 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3 2023-12-17T11:39:12.791 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-17T11:39:12.791 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan 2023-12-17T11:39:12.791 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-17T11:39:12.791 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback 2023-12-17T11:39:12.791 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-17T11:39:12.791 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netfront.ko 2023-12-17T11:39:12.791 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb 2023-12-17T11:39:12.791 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-17T11:39:12.791 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme 2023-12-17T11:39:12.791 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host 2023-12-17T11:39:12.791 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-17T11:39:12.791 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-17T11:39:12.791 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport 2023-12-17T11:39:12.791 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-17T11:39:12.791 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-17T11:39:12.791 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-17T11:39:12.792 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-17T11:39:12.792 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci 2023-12-17T11:39:12.792 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug 2023-12-17T11:39:12.792 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-17T11:39:12.792 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie 2023-12-17T11:39:12.792 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-17T11:39:12.792 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-17T11:39:12.792 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia 2023-12-17T11:39:12.792 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-17T11:39:12.792 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-17T11:39:12.792 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-17T11:39:12.792 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl 2023-12-17T11:39:12.792 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel 2023-12-17T11:39:12.792 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-17T11:39:12.793 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform 2023-12-17T11:39:12.793 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86 2023-12-17T11:39:12.793 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-17T11:39:12.793 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-17T11:39:12.793 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-17T11:39:12.793 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-17T11:39:12.793 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-17T11:39:12.793 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-17T11:39:12.793 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-17T11:39:12.793 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-17T11:39:12.793 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-17T11:39:12.793 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-17T11:39:12.793 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-17T11:39:12.793 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-17T11:39:12.793 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel 2023-12-17T11:39:12.794 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-17T11:39:12.794 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-17T11:39:12.794 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-17T11:39:12.794 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-17T11:39:12.794 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-17T11:39:12.794 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-17T11:39:12.794 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-17T11:39:12.794 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-17T11:39:12.794 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-17T11:39:12.794 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-17T11:39:12.794 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-17T11:39:12.794 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-17T11:39:12.794 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap 2023-12-17T11:39:12.794 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-17T11:39:12.794 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-17T11:39:12.795 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps 2023-12-17T11:39:12.795 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients 2023-12-17T11:39:12.795 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-17T11:39:12.795 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-17T11:39:12.795 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-17T11:39:12.795 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-17T11:39:12.795 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp 2023-12-17T11:39:12.795 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-17T11:39:12.795 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-17T11:39:12.795 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc 2023-12-17T11:39:12.795 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-17T11:39:12.795 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-17T11:39:12.795 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-17T11:39:12.795 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-17T11:39:12.795 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-17T11:39:12.796 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-17T11:39:12.796 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-17T11:39:12.796 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-17T11:39:12.796 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-17T11:39:12.796 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-17T11:39:12.796 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-17T11:39:12.796 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-17T11:39:12.796 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-17T11:39:12.796 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-17T11:39:12.796 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-17T11:39:12.796 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-17T11:39:12.796 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-17T11:39:12.796 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-17T11:39:12.796 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-17T11:39:12.797 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-17T11:39:12.797 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-17T11:39:12.797 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-17T11:39:12.797 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-17T11:39:12.797 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-17T11:39:12.797 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-17T11:39:12.797 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-17T11:39:12.797 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-17T11:39:12.797 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-17T11:39:12.797 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-17T11:39:12.797 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-17T11:39:12.797 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-17T11:39:12.797 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi 2023-12-17T11:39:12.797 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-17T11:39:12.798 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-17T11:39:12.798 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-17T11:39:12.798 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-17T11:39:12.798 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-17T11:39:12.798 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid 2023-12-17T11:39:12.798 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-17T11:39:12.798 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-17T11:39:12.798 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx 2023-12-17T11:39:12.798 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-17T11:39:12.798 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-17T11:39:12.798 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-17T11:39:12.798 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr 2023-12-17T11:39:12.798 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-17T11:39:12.798 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-17T11:39:12.799 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi 2023-12-17T11:39:12.799 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-17T11:39:12.799 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa 2023-12-17T11:39:12.799 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-17T11:39:12.799 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc 2023-12-17T11:39:12.799 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-17T11:39:12.799 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i 2023-12-17T11:39:12.799 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-17T11:39:12.799 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-17T11:39:12.799 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor 2023-12-17T11:39:12.799 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-17T11:39:12.799 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi 2023-12-17T11:39:12.799 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-17T11:39:12.799 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-17T11:39:12.799 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-17T11:39:12.800 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-17T11:39:12.800 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-17T11:39:12.800 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-17T11:39:12.800 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler 2023-12-17T11:39:12.800 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-17T11:39:12.800 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-17T11:39:12.800 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-17T11:39:12.800 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-17T11:39:12.800 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-17T11:39:12.800 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r 2023-12-17T11:39:12.800 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-17T11:39:12.800 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-17T11:39:12.800 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe 2023-12-17T11:39:12.801 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-17T11:39:12.801 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-17T11:39:12.801 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic 2023-12-17T11:39:12.801 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-17T11:39:12.801 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-17T11:39:12.801 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-17T11:39:12.801 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-17T11:39:12.801 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-17T11:39:12.801 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-17T11:39:12.801 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-17T11:39:12.801 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci 2023-12-17T11:39:12.801 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-17T11:39:12.801 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-17T11:39:12.802 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-17T11:39:12.802 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc 2023-12-17T11:39:12.802 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-17T11:39:12.802 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-17T11:39:12.802 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-17T11:39:12.802 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas 2023-12-17T11:39:12.802 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-17T11:39:12.802 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc 2023-12-17T11:39:12.802 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-17T11:39:12.802 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid 2023-12-17T11:39:12.802 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-17T11:39:12.802 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-17T11:39:12.802 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-17T11:39:12.802 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-17T11:39:12.803 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas 2023-12-17T11:39:12.803 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-17T11:39:12.803 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas 2023-12-17T11:39:12.803 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-17T11:39:12.803 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-17T11:39:12.803 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001 2023-12-17T11:39:12.803 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-17T11:39:12.803 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-17T11:39:12.803 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-17T11:39:12.803 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx 2023-12-17T11:39:12.803 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-17T11:39:12.803 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-17T11:39:12.803 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx 2023-12-17T11:39:12.803 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-17T11:39:12.803 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-17T11:39:12.804 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-17T11:39:12.804 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-17T11:39:12.804 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-17T11:39:12.804 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-17T11:39:12.804 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-17T11:39:12.804 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-17T11:39:12.804 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-17T11:39:12.804 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-17T11:39:12.804 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-17T11:39:12.804 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2 2023-12-17T11:39:12.804 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-17T11:39:12.804 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-17T11:39:12.804 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-17T11:39:12.804 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-17T11:39:12.804 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb 2023-12-17T11:39:12.805 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-17T11:39:12.805 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target 2023-12-17T11:39:12.805 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi 2023-12-17T11:39:12.805 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-17T11:39:12.805 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback 2023-12-17T11:39:12.805 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-17T11:39:12.805 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-17T11:39:12.805 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-17T11:39:12.805 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-17T11:39:12.805 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-17T11:39:12.805 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-17T11:39:12.805 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc 2023-12-17T11:39:12.805 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-17T11:39:12.805 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal 2023-12-17T11:39:12.805 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel 2023-12-17T11:39:12.806 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal 2023-12-17T11:39:12.806 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-17T11:39:12.806 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-17T11:39:12.806 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-17T11:39:12.806 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-17T11:39:12.806 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-17T11:39:12.806 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-17T11:39:12.806 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-17T11:39:12.806 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-17T11:39:12.806 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-17T11:39:12.806 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-17T11:39:12.806 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-17T11:39:12.806 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-17T11:39:12.806 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-17T11:39:12.806 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-17T11:39:12.807 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-17T11:39:12.807 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty 2023-12-17T11:39:12.807 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless 2023-12-17T11:39:12.807 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-17T11:39:12.807 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-17T11:39:12.807 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-17T11:39:12.807 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-17T11:39:12.807 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial 2023-12-17T11:39:12.807 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250 2023-12-17T11:39:12.807 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-17T11:39:12.807 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-17T11:39:12.807 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm 2023-12-17T11:39:12.807 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-17T11:39:12.807 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs 2023-12-17T11:39:12.807 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core 2023-12-17T11:39:12.807 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-17T11:39:12.808 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host 2023-12-17T11:39:12.808 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-17T11:39:12.808 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio 2023-12-17T11:39:12.808 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-17T11:39:12.808 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-17T11:39:12.808 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-17T11:39:12.808 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-17T11:39:12.808 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-17T11:39:12.808 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb 2023-12-17T11:39:12.808 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class 2023-12-17T11:39:12.808 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-17T11:39:12.808 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-17T11:39:12.808 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-17T11:39:12.808 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-17T11:39:12.808 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host 2023-12-17T11:39:12.809 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-17T11:39:12.809 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image 2023-12-17T11:39:12.809 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-17T11:39:12.809 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-17T11:39:12.809 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc 2023-12-17T11:39:12.809 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-17T11:39:12.809 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-17T11:39:12.809 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-17T11:39:12.809 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-17T11:39:12.809 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-17T11:39:12.809 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-17T11:39:12.809 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-17T11:39:12.809 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-17T11:39:12.809 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-17T11:39:12.809 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-17T11:39:12.809 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga 2023-12-17T11:39:12.810 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-17T11:39:12.810 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-17T11:39:12.810 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-17T11:39:12.810 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-17T11:39:12.810 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-17T11:39:12.810 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-17T11:39:12.810 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-17T11:39:12.810 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy 2023-12-17T11:39:12.810 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-17T11:39:12.810 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial 2023-12-17T11:39:12.810 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-17T11:39:12.810 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-17T11:39:12.810 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-17T11:39:12.810 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-17T11:39:12.810 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-17T11:39:12.811 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-17T11:39:12.811 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-17T11:39:12.811 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-17T11:39:12.811 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-17T11:39:12.811 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-17T11:39:12.811 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-17T11:39:12.811 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-17T11:39:12.811 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-17T11:39:12.811 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-17T11:39:12.811 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-17T11:39:12.811 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-17T11:39:12.811 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-17T11:39:12.811 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-17T11:39:12.811 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-17T11:39:12.811 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-17T11:39:12.811 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-17T11:39:12.812 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-17T11:39:12.812 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-17T11:39:12.812 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-17T11:39:12.812 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-17T11:39:12.812 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-17T11:39:12.812 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-17T11:39:12.812 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-17T11:39:12.812 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-17T11:39:12.812 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-17T11:39:12.812 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-17T11:39:12.812 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-17T11:39:12.812 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-17T11:39:12.812 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-17T11:39:12.812 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-17T11:39:12.812 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-17T11:39:12.813 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-17T11:39:12.813 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-17T11:39:12.813 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-17T11:39:12.813 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-17T11:39:12.813 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-17T11:39:12.813 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-17T11:39:12.813 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-17T11:39:12.813 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-17T11:39:12.813 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-17T11:39:12.813 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage 2023-12-17T11:39:12.813 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-17T11:39:12.813 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-17T11:39:12.813 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-17T11:39:12.813 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-17T11:39:12.814 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-17T11:39:12.814 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-17T11:39:12.814 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-17T11:39:12.814 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-17T11:39:12.814 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-17T11:39:12.814 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-17T11:39:12.814 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-17T11:39:12.814 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-17T11:39:12.814 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-17T11:39:12.814 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-17T11:39:12.814 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-17T11:39:12.814 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip 2023-12-17T11:39:12.814 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-17T11:39:12.814 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-17T11:39:12.815 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-17T11:39:12.815 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio 2023-12-17T11:39:12.815 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci 2023-12-17T11:39:12.815 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-17T11:39:12.815 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-17T11:39:12.815 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-17T11:39:12.815 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-17T11:39:12.815 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost 2023-12-17T11:39:12.815 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-17T11:39:12.815 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-17T11:39:12.815 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-17T11:39:12.815 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-17T11:39:12.815 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video 2023-12-17T11:39:12.816 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight 2023-12-17T11:39:12.816 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-17T11:39:12.816 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-17T11:39:12.816 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-17T11:39:12.816 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio 2023-12-17T11:39:12.816 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio.ko 2023-12-17T11:39:12.816 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_balloon.ko 2023-12-17T11:39:12.816 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_mmio.ko 2023-12-17T11:39:12.816 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci.ko 2023-12-17T11:39:12.816 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-17T11:39:12.816 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-17T11:39:12.816 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_ring.ko 2023-12-17T11:39:12.816 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1 2023-12-17T11:39:12.816 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters 2023-12-17T11:39:12.817 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-17T11:39:12.817 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-17T11:39:12.817 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves 2023-12-17T11:39:12.817 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-17T11:39:12.817 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-17T11:39:12.817 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-17T11:39:12.817 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-17T11:39:12.817 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-17T11:39:12.817 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-17T11:39:12.817 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-17T11:39:12.817 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-17T11:39:12.817 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-17T11:39:12.817 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-17T11:39:12.817 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-17T11:39:12.818 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-17T11:39:12.818 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog 2023-12-17T11:39:12.818 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-17T11:39:12.818 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-17T11:39:12.818 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-17T11:39:12.818 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-17T11:39:12.818 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-17T11:39:12.818 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-17T11:39:12.818 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-17T11:39:12.818 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-17T11:39:12.818 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-17T11:39:12.818 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-17T11:39:12.818 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-17T11:39:12.818 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-17T11:39:12.819 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-17T11:39:12.819 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-17T11:39:12.819 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-17T11:39:12.819 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-17T11:39:12.819 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-17T11:39:12.819 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-17T11:39:12.819 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-17T11:39:12.819 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-17T11:39:12.819 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-17T11:39:12.819 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-17T11:39:12.819 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-17T11:39:12.819 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-17T11:39:12.819 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-17T11:39:12.820 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-17T11:39:12.820 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen 2023-12-17T11:39:12.820 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-17T11:39:12.820 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-17T11:39:12.820 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-17T11:39:12.820 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-17T11:39:12.820 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback 2023-12-17T11:39:12.820 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-17T11:39:12.820 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-17T11:39:12.820 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs 2023-12-17T11:39:12.820 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-17T11:39:12.820 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs 2023-12-17T11:39:12.820 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p 2023-12-17T11:39:12.820 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-17T11:39:12.820 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs 2023-12-17T11:39:12.821 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-17T11:39:12.821 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs 2023-12-17T11:39:12.821 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-17T11:39:12.821 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-17T11:39:12.821 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs 2023-12-17T11:39:12.821 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-17T11:39:12.821 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles 2023-12-17T11:39:12.821 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-17T11:39:12.821 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph 2023-12-17T11:39:12.821 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-17T11:39:12.821 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda 2023-12-17T11:39:12.821 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-17T11:39:12.821 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs 2023-12-17T11:39:12.821 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-17T11:39:12.821 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm 2023-12-17T11:39:12.822 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-17T11:39:12.822 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs 2023-12-17T11:39:12.822 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-17T11:39:12.822 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs 2023-12-17T11:39:12.822 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-17T11:39:12.822 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat 2023-12-17T11:39:12.822 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/fat.ko 2023-12-17T11:39:12.822 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-17T11:39:12.822 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/vfat.ko 2023-12-17T11:39:12.822 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache 2023-12-17T11:39:12.822 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-17T11:39:12.822 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse 2023-12-17T11:39:12.822 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-17T11:39:12.822 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/fuse.ko 2023-12-17T11:39:12.823 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2 2023-12-17T11:39:12.823 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-17T11:39:12.823 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs 2023-12-17T11:39:12.823 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-17T11:39:12.823 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus 2023-12-17T11:39:12.823 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-17T11:39:12.823 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs 2023-12-17T11:39:12.823 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-17T11:39:12.823 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs 2023-12-17T11:39:12.823 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-17T11:39:12.823 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd 2023-12-17T11:39:12.823 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-17T11:39:12.823 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix 2023-12-17T11:39:12.823 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-17T11:39:12.823 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs 2023-12-17T11:39:12.824 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-17T11:39:12.824 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs 2023-12-17T11:39:12.824 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout 2023-12-17T11:39:12.824 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-17T11:39:12.824 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout 2023-12-17T11:39:12.824 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-17T11:39:12.824 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout 2023-12-17T11:39:12.824 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-17T11:39:12.824 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-17T11:39:12.824 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-17T11:39:12.824 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-17T11:39:12.824 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common 2023-12-17T11:39:12.824 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-17T11:39:12.824 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-17T11:39:12.824 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd 2023-12-17T11:39:12.825 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-17T11:39:12.825 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2 2023-12-17T11:39:12.825 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-17T11:39:12.825 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls 2023-12-17T11:39:12.825 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-17T11:39:12.825 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-17T11:39:12.825 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-17T11:39:12.825 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-17T11:39:12.825 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-17T11:39:12.825 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-17T11:39:12.826 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-17T11:39:12.826 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-17T11:39:12.826 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-17T11:39:12.826 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-17T11:39:12.826 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-17T11:39:12.826 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-17T11:39:12.826 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-17T11:39:12.826 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-17T11:39:12.826 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-17T11:39:12.826 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-17T11:39:12.826 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-17T11:39:12.826 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-17T11:39:12.826 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-17T11:39:12.826 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-17T11:39:12.826 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-17T11:39:12.827 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-17T11:39:12.827 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-17T11:39:12.827 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-17T11:39:12.827 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-17T11:39:12.827 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-17T11:39:12.827 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-17T11:39:12.827 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-17T11:39:12.827 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-17T11:39:12.827 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-17T11:39:12.827 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-17T11:39:12.827 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-17T11:39:12.827 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-17T11:39:12.827 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-17T11:39:12.827 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-17T11:39:12.827 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-17T11:39:12.828 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-17T11:39:12.828 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-17T11:39:12.828 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-17T11:39:12.828 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-17T11:39:12.828 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-17T11:39:12.828 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-17T11:39:12.828 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-17T11:39:12.828 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-17T11:39:12.828 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-17T11:39:12.828 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-17T11:39:12.828 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-17T11:39:12.828 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-17T11:39:12.828 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-17T11:39:12.828 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-17T11:39:12.828 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2 2023-12-17T11:39:12.829 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster 2023-12-17T11:39:12.829 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-17T11:39:12.829 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm 2023-12-17T11:39:12.829 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-17T11:39:12.829 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs 2023-12-17T11:39:12.829 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-17T11:39:12.829 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-17T11:39:12.829 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-17T11:39:12.829 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-17T11:39:12.829 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-17T11:39:12.829 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs 2023-12-17T11:39:12.829 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-17T11:39:12.829 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore 2023-12-17T11:39:12.829 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-17T11:39:12.829 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs 2023-12-17T11:39:12.830 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-17T11:39:12.830 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs 2023-12-17T11:39:12.830 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-17T11:39:12.830 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb 2023-12-17T11:39:12.830 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client 2023-12-17T11:39:12.830 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-17T11:39:12.830 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common 2023-12-17T11:39:12.830 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-17T11:39:12.830 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-17T11:39:12.830 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs 2023-12-17T11:39:12.830 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-17T11:39:12.830 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv 2023-12-17T11:39:12.830 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-17T11:39:12.830 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf 2023-12-17T11:39:12.830 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-17T11:39:12.831 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs 2023-12-17T11:39:12.831 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-17T11:39:12.831 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs 2023-12-17T11:39:12.831 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-17T11:39:12.831 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel 2023-12-17T11:39:12.831 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu 2023-12-17T11:39:12.831 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu/rcutorture.ko 2023-12-17T11:39:12.831 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-17T11:39:12.831 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace 2023-12-17T11:39:12.831 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-17T11:39:12.831 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib 2023-12-17T11:39:12.831 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/asn1_encoder.ko 2023-12-17T11:39:12.831 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-17T11:39:12.831 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-17T11:39:12.832 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto 2023-12-17T11:39:12.832 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-17T11:39:12.832 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-17T11:39:12.832 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-17T11:39:12.832 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-17T11:39:12.832 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4 2023-12-17T11:39:12.832 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-17T11:39:12.832 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-17T11:39:12.832 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math 2023-12-17T11:39:12.832 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-17T11:39:12.832 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6 2023-12-17T11:39:12.832 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-17T11:39:12.832 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon 2023-12-17T11:39:12.832 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-17T11:39:12.832 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-17T11:39:12.833 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-17T11:39:12.833 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-17T11:39:12.833 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd 2023-12-17T11:39:12.833 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd/zstd_compress.ko 2023-12-17T11:39:12.833 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm 2023-12-17T11:39:12.833 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-17T11:39:12.833 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net 2023-12-17T11:39:12.833 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan 2023-12-17T11:39:12.833 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-17T11:39:12.833 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-17T11:39:12.833 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-17T11:39:12.833 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-17T11:39:12.833 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-17T11:39:12.833 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-17T11:39:12.834 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-17T11:39:12.834 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-17T11:39:12.834 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802 2023-12-17T11:39:12.834 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-17T11:39:12.834 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-17T11:39:12.834 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-17T11:39:12.834 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-17T11:39:12.834 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-17T11:39:12.834 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q 2023-12-17T11:39:12.834 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-17T11:39:12.834 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p 2023-12-17T11:39:12.834 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-17T11:39:12.834 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-17T11:39:12.834 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-17T11:39:12.835 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-17T11:39:12.835 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv 2023-12-17T11:39:12.835 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-17T11:39:12.835 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge 2023-12-17T11:39:12.835 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-17T11:39:12.835 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-17T11:39:12.835 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter 2023-12-17T11:39:12.835 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-17T11:39:12.835 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-17T11:39:12.835 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-17T11:39:12.835 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-17T11:39:12.835 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-17T11:39:12.835 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-17T11:39:12.835 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-17T11:39:12.835 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-17T11:39:12.836 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-17T11:39:12.836 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-17T11:39:12.836 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-17T11:39:12.836 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-17T11:39:12.836 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-17T11:39:12.836 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-17T11:39:12.836 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-17T11:39:12.836 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-17T11:39:12.836 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-17T11:39:12.836 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-17T11:39:12.836 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-17T11:39:12.836 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-17T11:39:12.836 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-17T11:39:12.837 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-17T11:39:12.837 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-17T11:39:12.837 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-17T11:39:12.837 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph 2023-12-17T11:39:12.837 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-17T11:39:12.837 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core 2023-12-17T11:39:12.837 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/failover.ko 2023-12-17T11:39:12.837 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-17T11:39:12.837 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp 2023-12-17T11:39:12.837 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-17T11:39:12.837 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-17T11:39:12.837 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-17T11:39:12.837 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-17T11:39:12.837 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver 2023-12-17T11:39:12.838 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver/dns_resolver.ko 2023-12-17T11:39:12.838 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa 2023-12-17T11:39:12.838 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-17T11:39:12.838 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-17T11:39:12.838 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-17T11:39:12.838 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-17T11:39:12.838 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-17T11:39:12.838 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154 2023-12-17T11:39:12.838 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan 2023-12-17T11:39:12.838 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-17T11:39:12.838 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-17T11:39:12.838 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-17T11:39:12.838 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4 2023-12-17T11:39:12.838 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-17T11:39:12.839 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-17T11:39:12.839 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-17T11:39:12.839 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-17T11:39:12.839 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-17T11:39:12.839 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-17T11:39:12.839 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-17T11:39:12.839 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-17T11:39:12.839 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-17T11:39:12.839 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-17T11:39:12.839 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter 2023-12-17T11:39:12.839 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-17T11:39:12.839 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-17T11:39:12.839 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-17T11:39:12.839 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-17T11:39:12.839 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-17T11:39:12.840 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-17T11:39:12.840 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-17T11:39:12.840 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-17T11:39:12.840 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-17T11:39:12.840 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-17T11:39:12.840 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-17T11:39:12.840 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-17T11:39:12.840 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-17T11:39:12.840 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-17T11:39:12.840 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-17T11:39:12.840 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-17T11:39:12.840 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-17T11:39:12.840 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-17T11:39:12.841 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-17T11:39:12.841 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-17T11:39:12.841 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-17T11:39:12.841 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-17T11:39:12.841 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-17T11:39:12.841 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-17T11:39:12.841 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-17T11:39:12.841 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-17T11:39:12.841 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-17T11:39:12.841 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-17T11:39:12.841 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-17T11:39:12.841 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-17T11:39:12.841 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-17T11:39:12.841 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-17T11:39:12.842 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-17T11:39:12.842 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-17T11:39:12.842 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-17T11:39:12.842 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-17T11:39:12.842 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-17T11:39:12.842 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-17T11:39:12.842 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6 2023-12-17T11:39:12.842 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-17T11:39:12.842 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-17T11:39:12.842 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-17T11:39:12.842 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-17T11:39:12.842 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-17T11:39:12.842 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-17T11:39:12.842 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-17T11:39:12.843 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter 2023-12-17T11:39:12.843 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-17T11:39:12.843 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-17T11:39:12.843 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-17T11:39:12.843 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-17T11:39:12.843 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-17T11:39:12.843 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-17T11:39:12.843 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-17T11:39:12.843 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-17T11:39:12.843 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-17T11:39:12.843 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-17T11:39:12.843 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-17T11:39:12.843 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-17T11:39:12.843 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-17T11:39:12.843 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-17T11:39:12.844 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-17T11:39:12.844 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-17T11:39:12.844 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-17T11:39:12.844 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-17T11:39:12.844 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-17T11:39:12.844 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-17T11:39:12.844 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-17T11:39:12.844 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-17T11:39:12.844 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-17T11:39:12.844 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-17T11:39:12.844 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-17T11:39:12.844 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-17T11:39:12.844 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-17T11:39:12.844 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key 2023-12-17T11:39:12.844 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-17T11:39:12.845 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp 2023-12-17T11:39:12.845 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-17T11:39:12.845 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-17T11:39:12.845 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-17T11:39:12.845 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-17T11:39:12.845 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-17T11:39:12.845 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-17T11:39:12.845 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-17T11:39:12.845 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc 2023-12-17T11:39:12.845 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-17T11:39:12.845 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154 2023-12-17T11:39:12.845 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-17T11:39:12.845 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls 2023-12-17T11:39:12.845 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-17T11:39:12.845 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter 2023-12-17T11:39:12.846 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset 2023-12-17T11:39:12.846 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-17T11:39:12.846 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-17T11:39:12.846 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-17T11:39:12.846 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-17T11:39:12.846 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-17T11:39:12.846 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-17T11:39:12.846 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-17T11:39:12.846 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-17T11:39:12.846 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-17T11:39:12.846 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-17T11:39:12.846 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-17T11:39:12.846 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-17T11:39:12.846 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-17T11:39:12.846 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-17T11:39:12.847 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-17T11:39:12.847 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-17T11:39:12.847 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs 2023-12-17T11:39:12.847 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-17T11:39:12.847 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-17T11:39:12.847 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-17T11:39:12.847 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-17T11:39:12.847 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-17T11:39:12.847 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-17T11:39:12.847 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-17T11:39:12.847 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-17T11:39:12.847 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-17T11:39:12.847 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-17T11:39:12.847 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-17T11:39:12.847 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-17T11:39:12.848 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-17T11:39:12.848 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-17T11:39:12.848 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-17T11:39:12.848 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-17T11:39:12.848 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-17T11:39:12.848 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-17T11:39:12.848 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-17T11:39:12.848 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-17T11:39:12.848 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-17T11:39:12.848 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-17T11:39:12.848 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-17T11:39:12.848 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-17T11:39:12.848 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-17T11:39:12.848 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-17T11:39:12.848 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-17T11:39:12.849 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-17T11:39:12.849 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-17T11:39:12.849 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-17T11:39:12.849 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-17T11:39:12.849 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-17T11:39:12.849 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-17T11:39:12.849 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-17T11:39:12.849 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-17T11:39:12.849 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-17T11:39:12.849 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-17T11:39:12.849 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-17T11:39:12.849 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-17T11:39:12.849 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-17T11:39:12.849 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-17T11:39:12.850 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-17T11:39:12.850 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-17T11:39:12.850 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-17T11:39:12.850 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-17T11:39:12.850 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-17T11:39:12.850 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-17T11:39:12.850 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-17T11:39:12.850 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-17T11:39:12.850 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-17T11:39:12.850 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-17T11:39:12.850 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-17T11:39:12.850 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-17T11:39:12.850 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-17T11:39:12.850 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-17T11:39:12.850 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-17T11:39:12.851 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-17T11:39:12.851 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-17T11:39:12.851 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_quota.ko 2023-12-17T11:39:12.851 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-17T11:39:12.851 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-17T11:39:12.851 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-17T11:39:12.851 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-17T11:39:12.851 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tunnel.ko 2023-12-17T11:39:12.851 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-17T11:39:12.851 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-17T11:39:12.851 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-17T11:39:12.851 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-17T11:39:12.851 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-17T11:39:12.851 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-17T11:39:12.851 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-17T11:39:12.852 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-17T11:39:12.852 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-17T11:39:12.852 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-17T11:39:12.852 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-17T11:39:12.852 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-17T11:39:12.852 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-17T11:39:12.852 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-17T11:39:12.852 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-17T11:39:12.852 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-17T11:39:12.852 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-17T11:39:12.852 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-17T11:39:12.852 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-17T11:39:12.852 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-17T11:39:12.852 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-17T11:39:12.852 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-17T11:39:12.853 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-17T11:39:12.853 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-17T11:39:12.853 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-17T11:39:12.853 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-17T11:39:12.853 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-17T11:39:12.853 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-17T11:39:12.853 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-17T11:39:12.853 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-17T11:39:12.853 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-17T11:39:12.853 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-17T11:39:12.853 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-17T11:39:12.853 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-17T11:39:12.853 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-17T11:39:12.853 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-17T11:39:12.853 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-17T11:39:12.854 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-17T11:39:12.854 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-17T11:39:12.854 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-17T11:39:12.854 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-17T11:39:12.854 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-17T11:39:12.854 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-17T11:39:12.854 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-17T11:39:12.854 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-17T11:39:12.854 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-17T11:39:12.854 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-17T11:39:12.854 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-17T11:39:12.854 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-17T11:39:12.854 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-17T11:39:12.854 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-17T11:39:12.854 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-17T11:39:12.855 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-17T11:39:12.855 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-17T11:39:12.855 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-17T11:39:12.855 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-17T11:39:12.855 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-17T11:39:12.855 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-17T11:39:12.855 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-17T11:39:12.855 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-17T11:39:12.855 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-17T11:39:12.855 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-17T11:39:12.855 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-17T11:39:12.855 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-17T11:39:12.855 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-17T11:39:12.855 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-17T11:39:12.856 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-17T11:39:12.856 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-17T11:39:12.856 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-17T11:39:12.856 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-17T11:39:12.856 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-17T11:39:12.856 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink 2023-12-17T11:39:12.856 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-17T11:39:12.856 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh 2023-12-17T11:39:12.856 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-17T11:39:12.856 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch 2023-12-17T11:39:12.856 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-17T11:39:12.857 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-17T11:39:12.857 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-17T11:39:12.857 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-17T11:39:12.857 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet 2023-12-17T11:39:12.857 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-17T11:39:12.857 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds 2023-12-17T11:39:12.857 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-17T11:39:12.857 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-17T11:39:12.857 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-17T11:39:12.857 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched 2023-12-17T11:39:12.857 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-17T11:39:12.857 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-17T11:39:12.857 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-17T11:39:12.857 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-17T11:39:12.858 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-17T11:39:12.858 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-17T11:39:12.858 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-17T11:39:12.858 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-17T11:39:12.858 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-17T11:39:12.858 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-17T11:39:12.858 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-17T11:39:12.858 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-17T11:39:12.858 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-17T11:39:12.858 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-17T11:39:12.858 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-17T11:39:12.858 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-17T11:39:12.858 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-17T11:39:12.858 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-17T11:39:12.859 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-17T11:39:12.859 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-17T11:39:12.859 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-17T11:39:12.859 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-17T11:39:12.859 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-17T11:39:12.859 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-17T11:39:12.859 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-17T11:39:12.859 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-17T11:39:12.859 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-17T11:39:12.859 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-17T11:39:12.859 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-17T11:39:12.859 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-17T11:39:12.860 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-17T11:39:12.860 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-17T11:39:12.860 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-17T11:39:12.860 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-17T11:39:12.860 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-17T11:39:12.860 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-17T11:39:12.860 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-17T11:39:12.860 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-17T11:39:12.860 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-17T11:39:12.860 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-17T11:39:12.860 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-17T11:39:12.860 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-17T11:39:12.860 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-17T11:39:12.860 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-17T11:39:12.860 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp 2023-12-17T11:39:12.861 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-17T11:39:12.861 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-17T11:39:12.861 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc 2023-12-17T11:39:12.861 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss 2023-12-17T11:39:12.861 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-17T11:39:12.861 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-17T11:39:12.861 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-17T11:39:12.861 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma 2023-12-17T11:39:12.861 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-17T11:39:12.861 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc 2023-12-17T11:39:12.861 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-17T11:39:12.861 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-17T11:39:12.861 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix 2023-12-17T11:39:12.861 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-17T11:39:12.861 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock 2023-12-17T11:39:12.862 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-17T11:39:12.862 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-17T11:39:12.862 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-17T11:39:12.862 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-17T11:39:12.862 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-17T11:39:12.862 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm 2023-12-17T11:39:12.862 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-17T11:39:12.862 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security 2023-12-17T11:39:12.862 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys 2023-12-17T11:39:12.862 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys 2023-12-17T11:39:12.862 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-17T11:39:12.862 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys 2023-12-17T11:39:12.862 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys/trusted.ko 2023-12-17T11:39:12.862 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt 2023-12-17T11:39:12.862 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib 2023-12-17T11:39:12.863 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-17T11:39:12.863 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-17T11:39:12.863 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-17T11:39:12.863 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-17T11:39:12.863 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-17T11:39:12.863 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-17T11:39:12.863 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-17T11:39:12.863 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-17T11:39:12.863 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-17T11:39:12.863 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-17T11:39:12.863 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-17T11:39:12.863 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-17T11:39:12.863 INFO:teuthology.orchestra.run.smithi186.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-17T11:39:12.864 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-17T11:39:12.864 DEBUG:teuthology.orchestra.run.smithi186:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-17T11:39:12.888 INFO:teuthology.orchestra.run.smithi186.stdout:postinstall scriptlet (using /bin/sh): 2023-12-17T11:39:12.888 INFO:teuthology.orchestra.run.smithi186.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-gcd68252d7b4d -a -r /boot/System.map-6.6.0-gcd68252d7b4d ]; then 2023-12-17T11:39:12.888 INFO:teuthology.orchestra.run.smithi186.stdout:cp /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm 2023-12-17T11:39:12.888 INFO:teuthology.orchestra.run.smithi186.stdout:cp /boot/System.map-6.6.0-gcd68252d7b4d /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-17T11:39:12.888 INFO:teuthology.orchestra.run.smithi186.stdout:rm -f /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/System.map-6.6.0-gcd68252d7b4d 2023-12-17T11:39:12.888 INFO:teuthology.orchestra.run.smithi186.stdout:/sbin/installkernel 6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-17T11:39:12.888 INFO:teuthology.orchestra.run.smithi186.stdout:rm -f /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-17T11:39:12.888 INFO:teuthology.orchestra.run.smithi186.stdout:fi 2023-12-17T11:39:12.888 INFO:teuthology.orchestra.run.smithi186.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-17T11:39:12.888 INFO:teuthology.orchestra.run.smithi186.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-17T11:39:12.888 INFO:teuthology.orchestra.run.smithi186.stdout:new-kernel-pkg --remove 6.6.0-gcd68252d7b4d --rminitrd --initrdfile=/boot/initramfs-6.6.0-gcd68252d7b4d.img 2023-12-17T11:39:12.889 INFO:teuthology.orchestra.run.smithi186.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-17T11:39:12.889 INFO:teuthology.orchestra.run.smithi186.stdout:kernel-install remove 6.6.0-gcd68252d7b4d 2023-12-17T11:39:12.889 INFO:teuthology.orchestra.run.smithi186.stdout:fi 2023-12-17T11:39:12.889 INFO:teuthology.orchestra.run.smithi186.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-17T11:39:12.889 INFO:teuthology.orchestra.run.smithi186.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-17T11:39:12.889 INFO:teuthology.orchestra.run.smithi186.stdout:/sbin/update-bootloader --remove 6.6.0-gcd68252d7b4d 2023-12-17T11:39:12.889 INFO:teuthology.orchestra.run.smithi186.stdout:fi 2023-12-17T11:39:12.890 DEBUG:teuthology.orchestra.run.smithi186:> sudo rpm -qi grub2-tools 2023-12-17T11:39:12.965 INFO:teuthology.orchestra.run.smithi186.stdout:Name : grub2-tools 2023-12-17T11:39:12.965 INFO:teuthology.orchestra.run.smithi186.stdout:Epoch : 1 2023-12-17T11:39:12.965 INFO:teuthology.orchestra.run.smithi186.stdout:Version : 2.02 2023-12-17T11:39:12.965 INFO:teuthology.orchestra.run.smithi186.stdout:Release : 123.el8 2023-12-17T11:39:12.965 INFO:teuthology.orchestra.run.smithi186.stdout:Architecture: x86_64 2023-12-17T11:39:12.965 INFO:teuthology.orchestra.run.smithi186.stdout:Install Date: Thu 14 Dec 2023 12:39:42 AM UTC 2023-12-17T11:39:12.966 INFO:teuthology.orchestra.run.smithi186.stdout:Group : System Environment/Base 2023-12-17T11:39:12.966 INFO:teuthology.orchestra.run.smithi186.stdout:Size : 9265450 2023-12-17T11:39:12.966 INFO:teuthology.orchestra.run.smithi186.stdout:License : GPLv3+ 2023-12-17T11:39:12.966 INFO:teuthology.orchestra.run.smithi186.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-12-17T11:39:12.966 INFO:teuthology.orchestra.run.smithi186.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-12-17T11:39:12.966 INFO:teuthology.orchestra.run.smithi186.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-12-17T11:39:12.966 INFO:teuthology.orchestra.run.smithi186.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-12-17T11:39:12.966 INFO:teuthology.orchestra.run.smithi186.stdout:Relocations : (not relocatable) 2023-12-17T11:39:12.966 INFO:teuthology.orchestra.run.smithi186.stdout:Packager : Red Hat, Inc. 2023-12-17T11:39:12.966 INFO:teuthology.orchestra.run.smithi186.stdout:Vendor : Red Hat, Inc. 2023-12-17T11:39:12.966 INFO:teuthology.orchestra.run.smithi186.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-17T11:39:12.966 INFO:teuthology.orchestra.run.smithi186.stdout:Summary : Support tools for GRUB. 2023-12-17T11:39:12.966 INFO:teuthology.orchestra.run.smithi186.stdout:Description : 2023-12-17T11:39:12.966 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-12-17T11:39:12.967 INFO:teuthology.orchestra.run.smithi186.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-17T11:39:12.967 INFO:teuthology.orchestra.run.smithi186.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-17T11:39:12.967 INFO:teuthology.orchestra.run.smithi186.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-17T11:39:12.967 INFO:teuthology.orchestra.run.smithi186.stdout:hardware devices. 2023-12-17T11:39:12.967 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-12-17T11:39:12.967 INFO:teuthology.orchestra.run.smithi186.stdout:This subpackage provides tools for support of all platforms. 2023-12-17T11:39:12.968 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-17T11:39:12.968 INFO:teuthology.task.kernel:Updating grub on smithi186 to boot 6.6.0-gcd68252d7b4d 2023-12-17T11:39:12.968 DEBUG:teuthology.orchestra.run.smithi186:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-17T11:39:13.871 INFO:teuthology.orchestra.run.smithi186.stderr:Generating grub configuration file ... 2023-12-17T11:39:15.497 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi008.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-17T11:39:15.497 DEBUG:teuthology.orchestra.run.smithi008:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-17T11:39:15.555 INFO:teuthology.orchestra.run.smithi008.stdout:/boot/System.map-6.6.0-gcd68252d7b4d 2023-12-17T11:39:15.556 INFO:teuthology.orchestra.run.smithi008.stdout:/boot/config-6.6.0-gcd68252d7b4d 2023-12-17T11:39:15.556 INFO:teuthology.orchestra.run.smithi008.stdout:/boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-17T11:39:15.556 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d 2023-12-17T11:39:15.556 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel 2023-12-17T11:39:15.556 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch 2023-12-17T11:39:15.556 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86 2023-12-17T11:39:15.556 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto 2023-12-17T11:39:15.556 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-17T11:39:15.556 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-17T11:39:15.556 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-17T11:39:15.556 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-17T11:39:15.556 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-17T11:39:15.557 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-17T11:39:15.557 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-17T11:39:15.557 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-17T11:39:15.557 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-17T11:39:15.557 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-17T11:39:15.557 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-17T11:39:15.557 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-17T11:39:15.557 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-17T11:39:15.557 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-17T11:39:15.557 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-17T11:39:15.557 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-17T11:39:15.557 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-17T11:39:15.557 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-17T11:39:15.557 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-17T11:39:15.558 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-17T11:39:15.558 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel 2023-12-17T11:39:15.558 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu 2023-12-17T11:39:15.558 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce 2023-12-17T11:39:15.558 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-17T11:39:15.558 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm 2023-12-17T11:39:15.558 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-17T11:39:15.558 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-17T11:39:15.558 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-17T11:39:15.558 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto 2023-12-17T11:39:15.558 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-17T11:39:15.558 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-17T11:39:15.558 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-17T11:39:15.558 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx 2023-12-17T11:39:15.558 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-17T11:39:15.559 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-17T11:39:15.559 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-17T11:39:15.559 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-17T11:39:15.559 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-17T11:39:15.559 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-17T11:39:15.559 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-17T11:39:15.559 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-17T11:39:15.559 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-17T11:39:15.559 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-17T11:39:15.559 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-17T11:39:15.559 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-17T11:39:15.559 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-17T11:39:15.559 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-17T11:39:15.559 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-17T11:39:15.560 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-17T11:39:15.560 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-17T11:39:15.560 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-17T11:39:15.560 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-17T11:39:15.560 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-17T11:39:15.560 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-17T11:39:15.560 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-17T11:39:15.560 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-17T11:39:15.560 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-17T11:39:15.560 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-17T11:39:15.560 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-17T11:39:15.560 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-17T11:39:15.560 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-17T11:39:15.560 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-17T11:39:15.561 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-17T11:39:15.561 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-17T11:39:15.561 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-17T11:39:15.561 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-17T11:39:15.561 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-17T11:39:15.561 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-17T11:39:15.561 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-17T11:39:15.561 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-17T11:39:15.561 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-17T11:39:15.561 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-17T11:39:15.561 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-17T11:39:15.561 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-17T11:39:15.561 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-17T11:39:15.561 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-17T11:39:15.562 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-17T11:39:15.562 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-17T11:39:15.562 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers 2023-12-17T11:39:15.562 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi 2023-12-17T11:39:15.562 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-17T11:39:15.562 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-17T11:39:15.562 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/custom_method.ko 2023-12-17T11:39:15.562 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-17T11:39:15.562 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-17T11:39:15.562 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-17T11:39:15.562 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-17T11:39:15.562 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-17T11:39:15.562 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata 2023-12-17T11:39:15.562 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-17T11:39:15.562 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-17T11:39:15.563 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ata_generic.ko 2023-12-17T11:39:15.563 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-17T11:39:15.563 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-17T11:39:15.563 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-17T11:39:15.563 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-17T11:39:15.563 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-17T11:39:15.563 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-17T11:39:15.563 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-17T11:39:15.563 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-17T11:39:15.563 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-17T11:39:15.563 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-17T11:39:15.563 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-17T11:39:15.563 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-17T11:39:15.563 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-17T11:39:15.563 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-17T11:39:15.563 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-17T11:39:15.564 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-17T11:39:15.564 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-17T11:39:15.564 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-17T11:39:15.564 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-17T11:39:15.564 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-17T11:39:15.564 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-17T11:39:15.564 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-17T11:39:15.564 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-17T11:39:15.564 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-17T11:39:15.564 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-17T11:39:15.564 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-17T11:39:15.564 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-17T11:39:15.564 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-17T11:39:15.564 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-17T11:39:15.564 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-17T11:39:15.565 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-17T11:39:15.565 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-17T11:39:15.565 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-17T11:39:15.565 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-17T11:39:15.565 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-17T11:39:15.565 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sis.ko 2023-12-17T11:39:15.565 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-17T11:39:15.565 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-17T11:39:15.565 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-17T11:39:15.565 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-17T11:39:15.565 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-17T11:39:15.565 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-17T11:39:15.565 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-17T11:39:15.566 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-17T11:39:15.566 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-17T11:39:15.566 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-17T11:39:15.566 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-17T11:39:15.566 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-17T11:39:15.566 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-17T11:39:15.566 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-17T11:39:15.566 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-17T11:39:15.566 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-17T11:39:15.566 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-17T11:39:15.566 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay 2023-12-17T11:39:15.566 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-17T11:39:15.566 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base 2023-12-17T11:39:15.566 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap 2023-12-17T11:39:15.566 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-17T11:39:15.566 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-17T11:39:15.567 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma 2023-12-17T11:39:15.567 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-17T11:39:15.567 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block 2023-12-17T11:39:15.567 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe 2023-12-17T11:39:15.567 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-17T11:39:15.567 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/brd.ko 2023-12-17T11:39:15.567 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd 2023-12-17T11:39:15.567 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-17T11:39:15.567 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-17T11:39:15.567 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/loop.ko 2023-12-17T11:39:15.567 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx 2023-12-17T11:39:15.567 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-17T11:39:15.567 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-17T11:39:15.567 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk 2023-12-17T11:39:15.567 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-17T11:39:15.568 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-17T11:39:15.568 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-17T11:39:15.568 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/virtio_blk.ko 2023-12-17T11:39:15.568 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback 2023-12-17T11:39:15.568 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-17T11:39:15.568 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkfront.ko 2023-12-17T11:39:15.568 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram 2023-12-17T11:39:15.568 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-17T11:39:15.568 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char 2023-12-17T11:39:15.568 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-17T11:39:15.568 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random 2023-12-17T11:39:15.568 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-17T11:39:15.568 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-17T11:39:15.568 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-17T11:39:15.569 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-17T11:39:15.569 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-17T11:39:15.569 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi 2023-12-17T11:39:15.569 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-17T11:39:15.569 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-17T11:39:15.569 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-17T11:39:15.569 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-17T11:39:15.569 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-17T11:39:15.569 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-17T11:39:15.569 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-17T11:39:15.569 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave 2023-12-17T11:39:15.569 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-17T11:39:15.570 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-17T11:39:15.570 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-17T11:39:15.570 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm 2023-12-17T11:39:15.570 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm.ko 2023-12-17T11:39:15.570 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-17T11:39:15.570 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-17T11:39:15.570 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-17T11:39:15.570 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-17T11:39:15.570 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-17T11:39:15.570 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/uv_mmtimer.ko 2023-12-17T11:39:15.570 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/virtio_console.ko 2023-12-17T11:39:15.570 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq 2023-12-17T11:39:15.570 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-17T11:39:15.570 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-17T11:39:15.570 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-17T11:39:15.571 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-17T11:39:15.571 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-17T11:39:15.571 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-17T11:39:15.571 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto 2023-12-17T11:39:15.571 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp 2023-12-17T11:39:15.571 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-17T11:39:15.571 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-17T11:39:15.571 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel 2023-12-17T11:39:15.571 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat 2023-12-17T11:39:15.571 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common 2023-12-17T11:39:15.571 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-17T11:39:15.571 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-17T11:39:15.571 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-17T11:39:15.571 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-17T11:39:15.572 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-17T11:39:15.572 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio 2023-12-17T11:39:15.572 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-17T11:39:15.572 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca 2023-12-17T11:39:15.572 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-17T11:39:15.572 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq 2023-12-17T11:39:15.572 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-17T11:39:15.572 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma 2023-12-17T11:39:15.572 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw 2023-12-17T11:39:15.572 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-17T11:39:15.572 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat 2023-12-17T11:39:15.572 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-17T11:39:15.572 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac 2023-12-17T11:39:15.572 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-17T11:39:15.572 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-17T11:39:15.573 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-17T11:39:15.573 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-17T11:39:15.573 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-17T11:39:15.573 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-17T11:39:15.573 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-17T11:39:15.573 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-17T11:39:15.573 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-17T11:39:15.573 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-17T11:39:15.573 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-17T11:39:15.573 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-17T11:39:15.573 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-17T11:39:15.573 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware 2023-12-17T11:39:15.573 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/edd.ko 2023-12-17T11:39:15.574 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-17T11:39:15.574 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio 2023-12-17T11:39:15.574 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-17T11:39:15.574 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-17T11:39:15.574 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid 2023-12-17T11:39:15.574 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-17T11:39:15.574 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-17T11:39:15.574 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-17T11:39:15.574 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-17T11:39:15.574 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-17T11:39:15.574 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-17T11:39:15.574 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-17T11:39:15.574 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-17T11:39:15.574 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-17T11:39:15.575 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-17T11:39:15.575 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-17T11:39:15.575 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-17T11:39:15.575 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-17T11:39:15.575 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-17T11:39:15.575 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-17T11:39:15.575 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-17T11:39:15.575 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-17T11:39:15.575 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-17T11:39:15.575 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-17T11:39:15.575 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-17T11:39:15.575 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-17T11:39:15.575 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-17T11:39:15.575 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-17T11:39:15.575 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-17T11:39:15.576 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-17T11:39:15.576 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-17T11:39:15.576 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-17T11:39:15.576 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-17T11:39:15.576 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-17T11:39:15.576 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-17T11:39:15.576 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-17T11:39:15.576 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-17T11:39:15.576 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-17T11:39:15.576 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-17T11:39:15.576 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-17T11:39:15.576 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-17T11:39:15.576 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-17T11:39:15.577 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-17T11:39:15.577 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-17T11:39:15.577 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-17T11:39:15.577 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-17T11:39:15.577 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-17T11:39:15.577 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-17T11:39:15.577 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-17T11:39:15.577 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-17T11:39:15.577 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-17T11:39:15.577 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-17T11:39:15.577 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-17T11:39:15.577 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-17T11:39:15.577 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-17T11:39:15.577 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-17T11:39:15.578 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-17T11:39:15.578 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-17T11:39:15.578 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-17T11:39:15.578 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-17T11:39:15.578 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-17T11:39:15.578 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-17T11:39:15.578 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-17T11:39:15.578 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-17T11:39:15.578 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-17T11:39:15.578 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-17T11:39:15.578 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-17T11:39:15.578 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-17T11:39:15.578 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-17T11:39:15.579 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv 2023-12-17T11:39:15.579 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-17T11:39:15.579 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-17T11:39:15.579 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-17T11:39:15.579 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon 2023-12-17T11:39:15.579 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-17T11:39:15.579 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-17T11:39:15.579 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-17T11:39:15.579 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-17T11:39:15.579 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-17T11:39:15.579 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-17T11:39:15.579 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-17T11:39:15.579 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-17T11:39:15.579 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-17T11:39:15.579 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-17T11:39:15.579 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-17T11:39:15.580 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-17T11:39:15.580 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-17T11:39:15.580 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-17T11:39:15.580 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-17T11:39:15.580 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-17T11:39:15.580 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-17T11:39:15.580 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-17T11:39:15.580 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-17T11:39:15.580 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-17T11:39:15.580 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-17T11:39:15.580 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-17T11:39:15.580 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-17T11:39:15.580 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-17T11:39:15.580 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-17T11:39:15.580 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-17T11:39:15.581 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-17T11:39:15.581 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-17T11:39:15.581 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-17T11:39:15.581 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-17T11:39:15.581 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-17T11:39:15.581 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-17T11:39:15.581 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-17T11:39:15.581 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-17T11:39:15.581 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-17T11:39:15.581 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-17T11:39:15.581 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-17T11:39:15.581 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-17T11:39:15.581 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-17T11:39:15.582 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-17T11:39:15.582 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-17T11:39:15.582 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-17T11:39:15.582 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-17T11:39:15.582 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-17T11:39:15.582 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-17T11:39:15.582 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-17T11:39:15.582 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-17T11:39:15.582 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-17T11:39:15.582 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-17T11:39:15.582 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-17T11:39:15.582 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-17T11:39:15.582 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-17T11:39:15.583 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-17T11:39:15.583 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-17T11:39:15.583 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-17T11:39:15.583 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-17T11:39:15.583 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-17T11:39:15.583 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-17T11:39:15.583 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-17T11:39:15.583 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-17T11:39:15.583 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-17T11:39:15.583 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-17T11:39:15.583 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-17T11:39:15.583 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-17T11:39:15.583 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-17T11:39:15.584 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-17T11:39:15.584 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-17T11:39:15.584 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-17T11:39:15.584 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-17T11:39:15.584 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-17T11:39:15.584 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-17T11:39:15.584 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-17T11:39:15.584 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-17T11:39:15.584 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-17T11:39:15.584 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-17T11:39:15.584 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-17T11:39:15.584 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-17T11:39:15.584 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-17T11:39:15.585 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-17T11:39:15.585 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-17T11:39:15.585 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-17T11:39:15.585 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-17T11:39:15.585 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-17T11:39:15.585 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-17T11:39:15.585 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-17T11:39:15.585 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-17T11:39:15.585 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-17T11:39:15.585 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-17T11:39:15.585 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus 2023-12-17T11:39:15.585 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-17T11:39:15.585 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-17T11:39:15.585 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-17T11:39:15.586 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-17T11:39:15.586 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-17T11:39:15.586 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-17T11:39:15.586 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-17T11:39:15.586 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-17T11:39:15.586 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-17T11:39:15.586 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-17T11:39:15.586 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-17T11:39:15.586 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-17T11:39:15.586 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-17T11:39:15.586 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-17T11:39:15.586 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-17T11:39:15.586 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-17T11:39:15.586 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-17T11:39:15.586 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-17T11:39:15.587 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-17T11:39:15.587 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-17T11:39:15.587 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-17T11:39:15.587 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-17T11:39:15.587 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-17T11:39:15.587 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-17T11:39:15.587 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-17T11:39:15.587 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-17T11:39:15.587 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-17T11:39:15.587 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-17T11:39:15.587 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-17T11:39:15.587 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-17T11:39:15.587 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-17T11:39:15.587 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-17T11:39:15.587 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-17T11:39:15.588 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-17T11:39:15.588 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-17T11:39:15.588 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-17T11:39:15.588 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-17T11:39:15.588 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-17T11:39:15.588 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-17T11:39:15.588 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-17T11:39:15.588 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-17T11:39:15.588 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c 2023-12-17T11:39:15.588 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos 2023-12-17T11:39:15.588 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-17T11:39:15.588 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-17T11:39:15.588 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses 2023-12-17T11:39:15.588 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-17T11:39:15.588 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-17T11:39:15.589 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-17T11:39:15.589 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-17T11:39:15.589 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-17T11:39:15.589 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-17T11:39:15.589 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-17T11:39:15.589 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-17T11:39:15.589 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-17T11:39:15.589 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-17T11:39:15.589 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-17T11:39:15.589 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-17T11:39:15.589 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-17T11:39:15.589 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-17T11:39:15.589 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-17T11:39:15.590 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-17T11:39:15.590 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-17T11:39:15.590 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-17T11:39:15.590 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-17T11:39:15.590 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-17T11:39:15.590 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-17T11:39:15.590 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-17T11:39:15.590 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-17T11:39:15.590 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-dev.ko 2023-12-17T11:39:15.590 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-17T11:39:15.590 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-17T11:39:15.590 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-17T11:39:15.590 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-17T11:39:15.590 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband 2023-12-17T11:39:15.590 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core 2023-12-17T11:39:15.590 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-17T11:39:15.591 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-17T11:39:15.591 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-17T11:39:15.591 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-17T11:39:15.591 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-17T11:39:15.591 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-17T11:39:15.591 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-17T11:39:15.591 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw 2023-12-17T11:39:15.591 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4 2023-12-17T11:39:15.591 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-17T11:39:15.591 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4 2023-12-17T11:39:15.591 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-17T11:39:15.591 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5 2023-12-17T11:39:15.591 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-17T11:39:15.591 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca 2023-12-17T11:39:15.592 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-17T11:39:15.592 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp 2023-12-17T11:39:15.592 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib 2023-12-17T11:39:15.592 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-17T11:39:15.592 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser 2023-12-17T11:39:15.592 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-17T11:39:15.592 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert 2023-12-17T11:39:15.592 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-17T11:39:15.592 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp 2023-12-17T11:39:15.592 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-17T11:39:15.592 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt 2023-12-17T11:39:15.592 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-17T11:39:15.592 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input 2023-12-17T11:39:15.592 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport 2023-12-17T11:39:15.592 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-17T11:39:15.593 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-17T11:39:15.593 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-17T11:39:15.593 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-17T11:39:15.593 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard 2023-12-17T11:39:15.593 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-17T11:39:15.593 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse 2023-12-17T11:39:15.593 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-17T11:39:15.593 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-17T11:39:15.593 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-17T11:39:15.593 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-17T11:39:15.593 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-17T11:39:15.593 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-17T11:39:15.593 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-17T11:39:15.593 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-17T11:39:15.594 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4 2023-12-17T11:39:15.594 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-17T11:39:15.594 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio 2023-12-17T11:39:15.594 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-17T11:39:15.594 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-17T11:39:15.594 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-17T11:39:15.594 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-17T11:39:15.594 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-17T11:39:15.594 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu 2023-12-17T11:39:15.594 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd 2023-12-17T11:39:15.594 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-17T11:39:15.594 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds 2023-12-17T11:39:15.594 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-17T11:39:15.594 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-17T11:39:15.595 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-17T11:39:15.595 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-17T11:39:15.595 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger 2023-12-17T11:39:15.595 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-17T11:39:15.595 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-17T11:39:15.595 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-17T11:39:15.595 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-17T11:39:15.595 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-17T11:39:15.595 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-17T11:39:15.595 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-17T11:39:15.595 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-17T11:39:15.595 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md 2023-12-17T11:39:15.595 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache 2023-12-17T11:39:15.595 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-17T11:39:15.596 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-17T11:39:15.596 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-17T11:39:15.596 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-17T11:39:15.596 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-17T11:39:15.596 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-17T11:39:15.596 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-17T11:39:15.596 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-17T11:39:15.596 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-17T11:39:15.596 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-17T11:39:15.596 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-17T11:39:15.596 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-17T11:39:15.596 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-17T11:39:15.596 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-17T11:39:15.596 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-17T11:39:15.596 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-17T11:39:15.597 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-17T11:39:15.597 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-17T11:39:15.597 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-17T11:39:15.597 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data 2023-12-17T11:39:15.597 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-17T11:39:15.597 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-17T11:39:15.597 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-17T11:39:15.597 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-17T11:39:15.597 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-17T11:39:15.597 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message 2023-12-17T11:39:15.597 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion 2023-12-17T11:39:15.597 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-17T11:39:15.597 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-17T11:39:15.597 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-17T11:39:15.597 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-17T11:39:15.598 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-17T11:39:15.598 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-17T11:39:15.598 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-17T11:39:15.598 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd 2023-12-17T11:39:15.598 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-17T11:39:15.598 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-17T11:39:15.598 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mfd-core.ko 2023-12-17T11:39:15.598 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-17T11:39:15.598 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-17T11:39:15.598 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-17T11:39:15.598 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-17T11:39:15.598 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc 2023-12-17T11:39:15.598 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl 2023-12-17T11:39:15.598 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-17T11:39:15.598 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-17T11:39:15.599 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-17T11:39:15.599 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-17T11:39:15.599 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710 2023-12-17T11:39:15.599 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-17T11:39:15.599 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom 2023-12-17T11:39:15.599 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-17T11:39:15.599 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-17T11:39:15.599 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-17T11:39:15.599 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-17T11:39:15.599 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-17T11:39:15.599 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-17T11:39:15.599 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-17T11:39:15.599 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-17T11:39:15.599 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d 2023-12-17T11:39:15.600 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-17T11:39:15.600 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-17T11:39:15.600 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei 2023-12-17T11:39:15.600 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-17T11:39:15.600 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-17T11:39:15.600 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-17T11:39:15.600 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru 2023-12-17T11:39:15.600 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-17T11:39:15.600 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp 2023-12-17T11:39:15.600 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-17T11:39:15.600 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-17T11:39:15.600 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-17T11:39:15.600 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-17T11:39:15.600 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-17T11:39:15.600 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-17T11:39:15.601 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-17T11:39:15.601 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci 2023-12-17T11:39:15.601 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-17T11:39:15.601 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net 2023-12-17T11:39:15.601 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding 2023-12-17T11:39:15.601 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-17T11:39:15.601 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa 2023-12-17T11:39:15.601 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53 2023-12-17T11:39:15.601 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-17T11:39:15.601 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-17T11:39:15.601 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-17T11:39:15.601 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx 2023-12-17T11:39:15.601 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-17T11:39:15.601 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-17T11:39:15.602 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-17T11:39:15.602 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet 2023-12-17T11:39:15.602 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com 2023-12-17T11:39:15.602 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-17T11:39:15.602 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-17T11:39:15.602 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-17T11:39:15.602 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-17T11:39:15.602 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390 2023-12-17T11:39:15.602 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-17T11:39:15.602 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-17T11:39:15.602 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-17T11:39:15.602 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-17T11:39:15.602 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec 2023-12-17T11:39:15.602 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-17T11:39:15.602 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere 2023-12-17T11:39:15.603 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-17T11:39:15.603 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon 2023-12-17T11:39:15.603 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-17T11:39:15.603 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera 2023-12-17T11:39:15.603 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-17T11:39:15.603 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd 2023-12-17T11:39:15.603 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-17T11:39:15.603 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-17T11:39:15.603 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-17T11:39:15.603 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros 2023-12-17T11:39:15.603 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx 2023-12-17T11:39:15.603 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-17T11:39:15.603 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-17T11:39:15.603 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-17T11:39:15.603 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-17T11:39:15.604 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-17T11:39:15.604 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx 2023-12-17T11:39:15.604 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-17T11:39:15.604 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-17T11:39:15.604 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom 2023-12-17T11:39:15.604 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-17T11:39:15.604 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-17T11:39:15.604 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-17T11:39:15.604 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-17T11:39:15.604 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-17T11:39:15.604 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet 2023-12-17T11:39:15.604 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-17T11:39:15.604 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-17T11:39:15.604 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade 2023-12-17T11:39:15.605 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna 2023-12-17T11:39:15.605 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-17T11:39:15.605 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio 2023-12-17T11:39:15.605 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-17T11:39:15.605 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-17T11:39:15.605 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-17T11:39:15.605 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-17T11:39:15.605 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-17T11:39:15.605 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-17T11:39:15.605 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-17T11:39:15.605 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-17T11:39:15.605 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-17T11:39:15.605 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-17T11:39:15.605 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco 2023-12-17T11:39:15.606 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic 2023-12-17T11:39:15.606 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-17T11:39:15.606 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec 2023-12-17T11:39:15.606 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip 2023-12-17T11:39:15.606 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-17T11:39:15.606 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-17T11:39:15.606 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-17T11:39:15.606 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-17T11:39:15.606 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-17T11:39:15.606 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-17T11:39:15.606 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink 2023-12-17T11:39:15.606 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-17T11:39:15.606 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-17T11:39:15.606 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-17T11:39:15.606 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex 2023-12-17T11:39:15.607 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet 2023-12-17T11:39:15.607 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-17T11:39:15.607 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-17T11:39:15.607 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-17T11:39:15.607 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel 2023-12-17T11:39:15.607 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-17T11:39:15.607 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000 2023-12-17T11:39:15.607 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-17T11:39:15.607 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e 2023-12-17T11:39:15.607 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-17T11:39:15.607 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k 2023-12-17T11:39:15.607 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-17T11:39:15.607 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e 2023-12-17T11:39:15.607 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-17T11:39:15.608 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf 2023-12-17T11:39:15.608 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-17T11:39:15.608 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb 2023-12-17T11:39:15.608 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-17T11:39:15.608 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf 2023-12-17T11:39:15.608 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-17T11:39:15.608 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-17T11:39:15.608 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-17T11:39:15.608 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-17T11:39:15.608 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-17T11:39:15.608 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-17T11:39:15.608 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell 2023-12-17T11:39:15.608 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-17T11:39:15.609 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-17T11:39:15.609 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-17T11:39:15.609 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox 2023-12-17T11:39:15.609 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-17T11:39:15.609 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-17T11:39:15.609 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-17T11:39:15.609 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-17T11:39:15.609 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-17T11:39:15.609 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-17T11:39:15.609 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel 2023-12-17T11:39:15.609 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-17T11:39:15.609 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom 2023-12-17T11:39:15.609 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-17T11:39:15.610 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-17T11:39:15.610 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi 2023-12-17T11:39:15.610 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-17T11:39:15.610 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-17T11:39:15.610 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion 2023-12-17T11:39:15.610 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-17T11:39:15.610 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia 2023-12-17T11:39:15.610 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-17T11:39:15.610 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines 2023-12-17T11:39:15.610 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-17T11:39:15.610 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-17T11:39:15.610 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic 2023-12-17T11:39:15.610 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-17T11:39:15.610 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-17T11:39:15.611 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-17T11:39:15.611 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-17T11:39:15.611 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-17T11:39:15.611 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc 2023-12-17T11:39:15.611 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-17T11:39:15.611 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek 2023-12-17T11:39:15.611 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-17T11:39:15.611 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-17T11:39:15.611 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-17T11:39:15.611 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-17T11:39:15.611 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker 2023-12-17T11:39:15.611 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-17T11:39:15.611 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc 2023-12-17T11:39:15.611 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-17T11:39:15.612 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan 2023-12-17T11:39:15.612 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-17T11:39:15.612 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis 2023-12-17T11:39:15.612 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-17T11:39:15.612 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-17T11:39:15.612 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc 2023-12-17T11:39:15.612 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-17T11:39:15.612 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-17T11:39:15.612 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-17T11:39:15.612 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-17T11:39:15.612 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro 2023-12-17T11:39:15.612 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-17T11:39:15.612 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-17T11:39:15.612 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-17T11:39:15.612 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun 2023-12-17T11:39:15.612 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-17T11:39:15.612 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-17T11:39:15.613 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-17T11:39:15.613 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-17T11:39:15.613 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti 2023-12-17T11:39:15.613 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-17T11:39:15.613 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti 2023-12-17T11:39:15.613 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-17T11:39:15.613 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via 2023-12-17T11:39:15.613 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-17T11:39:15.613 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-17T11:39:15.613 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet 2023-12-17T11:39:15.613 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-17T11:39:15.613 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-17T11:39:15.613 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom 2023-12-17T11:39:15.613 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-17T11:39:15.614 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-17T11:39:15.614 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv 2023-12-17T11:39:15.614 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-17T11:39:15.614 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154 2023-12-17T11:39:15.614 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-17T11:39:15.614 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-17T11:39:15.614 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan 2023-12-17T11:39:15.614 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-17T11:39:15.614 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-17T11:39:15.614 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-17T11:39:15.614 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio 2023-12-17T11:39:15.614 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-17T11:39:15.614 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-17T11:39:15.614 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-17T11:39:15.614 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-17T11:39:15.614 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-17T11:39:15.615 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/net_failover.ko 2023-12-17T11:39:15.615 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-17T11:39:15.615 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-17T11:39:15.615 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs 2023-12-17T11:39:15.615 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-17T11:39:15.615 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-17T11:39:15.615 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy 2023-12-17T11:39:15.615 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-17T11:39:15.615 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-17T11:39:15.615 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-17T11:39:15.615 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-17T11:39:15.615 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-17T11:39:15.615 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-17T11:39:15.615 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-17T11:39:15.616 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-17T11:39:15.616 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/dp83640.ko 2023-12-17T11:39:15.616 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-17T11:39:15.616 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-17T11:39:15.616 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-17T11:39:15.616 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-17T11:39:15.616 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-17T11:39:15.616 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-17T11:39:15.616 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-17T11:39:15.616 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-17T11:39:15.616 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-17T11:39:15.616 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-17T11:39:15.616 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-17T11:39:15.616 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-17T11:39:15.616 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp 2023-12-17T11:39:15.617 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-17T11:39:15.617 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-17T11:39:15.617 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-17T11:39:15.617 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-17T11:39:15.617 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-17T11:39:15.617 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-17T11:39:15.617 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-17T11:39:15.617 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-17T11:39:15.617 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-17T11:39:15.617 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip 2023-12-17T11:39:15.617 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slhc.ko 2023-12-17T11:39:15.617 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-17T11:39:15.617 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-17T11:39:15.617 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-17T11:39:15.618 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team 2023-12-17T11:39:15.618 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-17T11:39:15.618 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-17T11:39:15.618 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-17T11:39:15.618 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-17T11:39:15.618 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-17T11:39:15.618 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-17T11:39:15.618 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tun.ko 2023-12-17T11:39:15.618 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-17T11:39:15.618 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/virtio_net.ko 2023-12-17T11:39:15.618 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3 2023-12-17T11:39:15.618 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-17T11:39:15.618 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan 2023-12-17T11:39:15.618 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-17T11:39:15.618 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback 2023-12-17T11:39:15.619 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-17T11:39:15.619 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netfront.ko 2023-12-17T11:39:15.619 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb 2023-12-17T11:39:15.619 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-17T11:39:15.619 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme 2023-12-17T11:39:15.619 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host 2023-12-17T11:39:15.619 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-17T11:39:15.619 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-17T11:39:15.619 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport 2023-12-17T11:39:15.619 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-17T11:39:15.619 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-17T11:39:15.619 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-17T11:39:15.619 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-17T11:39:15.619 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci 2023-12-17T11:39:15.619 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug 2023-12-17T11:39:15.619 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-17T11:39:15.620 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie 2023-12-17T11:39:15.620 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-17T11:39:15.620 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-17T11:39:15.620 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia 2023-12-17T11:39:15.620 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-17T11:39:15.620 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-17T11:39:15.620 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-17T11:39:15.620 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl 2023-12-17T11:39:15.620 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel 2023-12-17T11:39:15.620 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-17T11:39:15.620 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform 2023-12-17T11:39:15.620 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86 2023-12-17T11:39:15.620 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-17T11:39:15.620 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-17T11:39:15.620 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-17T11:39:15.620 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-17T11:39:15.621 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-17T11:39:15.621 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-17T11:39:15.621 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-17T11:39:15.621 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-17T11:39:15.621 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-17T11:39:15.621 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-17T11:39:15.621 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-17T11:39:15.621 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-17T11:39:15.621 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel 2023-12-17T11:39:15.621 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-17T11:39:15.621 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-17T11:39:15.621 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-17T11:39:15.621 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-17T11:39:15.621 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-17T11:39:15.622 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-17T11:39:15.622 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-17T11:39:15.622 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-17T11:39:15.622 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-17T11:39:15.622 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-17T11:39:15.622 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-17T11:39:15.622 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-17T11:39:15.622 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap 2023-12-17T11:39:15.622 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-17T11:39:15.622 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-17T11:39:15.622 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps 2023-12-17T11:39:15.622 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients 2023-12-17T11:39:15.622 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-17T11:39:15.622 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-17T11:39:15.622 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-17T11:39:15.623 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-17T11:39:15.623 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp 2023-12-17T11:39:15.623 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-17T11:39:15.623 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-17T11:39:15.623 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc 2023-12-17T11:39:15.623 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-17T11:39:15.623 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-17T11:39:15.623 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-17T11:39:15.623 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-17T11:39:15.623 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-17T11:39:15.623 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-17T11:39:15.623 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-17T11:39:15.623 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-17T11:39:15.623 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-17T11:39:15.624 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-17T11:39:15.624 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-17T11:39:15.624 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-17T11:39:15.624 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-17T11:39:15.624 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-17T11:39:15.624 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-17T11:39:15.624 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-17T11:39:15.624 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-17T11:39:15.624 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-17T11:39:15.624 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-17T11:39:15.624 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-17T11:39:15.624 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-17T11:39:15.624 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-17T11:39:15.625 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-17T11:39:15.625 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-17T11:39:15.625 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-17T11:39:15.625 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-17T11:39:15.625 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-17T11:39:15.625 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-17T11:39:15.625 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-17T11:39:15.625 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-17T11:39:15.625 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-17T11:39:15.625 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi 2023-12-17T11:39:15.625 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-17T11:39:15.625 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-17T11:39:15.625 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-17T11:39:15.625 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-17T11:39:15.626 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-17T11:39:15.626 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid 2023-12-17T11:39:15.626 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-17T11:39:15.626 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-17T11:39:15.626 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx 2023-12-17T11:39:15.626 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-17T11:39:15.626 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-17T11:39:15.626 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-17T11:39:15.626 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr 2023-12-17T11:39:15.626 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-17T11:39:15.626 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-17T11:39:15.626 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi 2023-12-17T11:39:15.626 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-17T11:39:15.626 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa 2023-12-17T11:39:15.627 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-17T11:39:15.627 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc 2023-12-17T11:39:15.627 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-17T11:39:15.627 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i 2023-12-17T11:39:15.627 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-17T11:39:15.627 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-17T11:39:15.627 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor 2023-12-17T11:39:15.627 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-17T11:39:15.627 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi 2023-12-17T11:39:15.627 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-17T11:39:15.627 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-17T11:39:15.627 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-17T11:39:15.627 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-17T11:39:15.627 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-17T11:39:15.628 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-17T11:39:15.628 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler 2023-12-17T11:39:15.628 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-17T11:39:15.628 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-17T11:39:15.628 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-17T11:39:15.628 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-17T11:39:15.628 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-17T11:39:15.628 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r 2023-12-17T11:39:15.628 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-17T11:39:15.628 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-17T11:39:15.628 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe 2023-12-17T11:39:15.628 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-17T11:39:15.628 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-17T11:39:15.628 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic 2023-12-17T11:39:15.629 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-17T11:39:15.629 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-17T11:39:15.629 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-17T11:39:15.629 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-17T11:39:15.629 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-17T11:39:15.629 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-17T11:39:15.629 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-17T11:39:15.629 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci 2023-12-17T11:39:15.629 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-17T11:39:15.629 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-17T11:39:15.629 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-17T11:39:15.629 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc 2023-12-17T11:39:15.629 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-17T11:39:15.629 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-17T11:39:15.630 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-17T11:39:15.630 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas 2023-12-17T11:39:15.630 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-17T11:39:15.630 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc 2023-12-17T11:39:15.630 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-17T11:39:15.630 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid 2023-12-17T11:39:15.630 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-17T11:39:15.630 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-17T11:39:15.630 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-17T11:39:15.630 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-17T11:39:15.630 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas 2023-12-17T11:39:15.630 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-17T11:39:15.630 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas 2023-12-17T11:39:15.630 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-17T11:39:15.631 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-17T11:39:15.631 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001 2023-12-17T11:39:15.631 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-17T11:39:15.631 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-17T11:39:15.631 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-17T11:39:15.631 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx 2023-12-17T11:39:15.631 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-17T11:39:15.631 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-17T11:39:15.631 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx 2023-12-17T11:39:15.631 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-17T11:39:15.631 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-17T11:39:15.631 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-17T11:39:15.631 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-17T11:39:15.631 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-17T11:39:15.631 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-17T11:39:15.632 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-17T11:39:15.632 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-17T11:39:15.632 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-17T11:39:15.632 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-17T11:39:15.632 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-17T11:39:15.632 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2 2023-12-17T11:39:15.632 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-17T11:39:15.632 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-17T11:39:15.632 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-17T11:39:15.632 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-17T11:39:15.632 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb 2023-12-17T11:39:15.632 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-17T11:39:15.632 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target 2023-12-17T11:39:15.632 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi 2023-12-17T11:39:15.633 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-17T11:39:15.633 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback 2023-12-17T11:39:15.633 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-17T11:39:15.633 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-17T11:39:15.633 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-17T11:39:15.633 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-17T11:39:15.633 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-17T11:39:15.633 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-17T11:39:15.633 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc 2023-12-17T11:39:15.633 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-17T11:39:15.633 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal 2023-12-17T11:39:15.633 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel 2023-12-17T11:39:15.634 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal 2023-12-17T11:39:15.634 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-17T11:39:15.634 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-17T11:39:15.634 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-17T11:39:15.634 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-17T11:39:15.634 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-17T11:39:15.634 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-17T11:39:15.634 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-17T11:39:15.634 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-17T11:39:15.634 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-17T11:39:15.634 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-17T11:39:15.634 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-17T11:39:15.634 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-17T11:39:15.635 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-17T11:39:15.635 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-17T11:39:15.635 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-17T11:39:15.635 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty 2023-12-17T11:39:15.635 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless 2023-12-17T11:39:15.635 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-17T11:39:15.635 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-17T11:39:15.635 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-17T11:39:15.635 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-17T11:39:15.635 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial 2023-12-17T11:39:15.635 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250 2023-12-17T11:39:15.635 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-17T11:39:15.635 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-17T11:39:15.636 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm 2023-12-17T11:39:15.636 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-17T11:39:15.636 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs 2023-12-17T11:39:15.636 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core 2023-12-17T11:39:15.636 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-17T11:39:15.636 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host 2023-12-17T11:39:15.636 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-17T11:39:15.636 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio 2023-12-17T11:39:15.636 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-17T11:39:15.636 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-17T11:39:15.636 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-17T11:39:15.636 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-17T11:39:15.636 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-17T11:39:15.637 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb 2023-12-17T11:39:15.637 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class 2023-12-17T11:39:15.637 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-17T11:39:15.637 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-17T11:39:15.637 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-17T11:39:15.637 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-17T11:39:15.637 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host 2023-12-17T11:39:15.637 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-17T11:39:15.637 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image 2023-12-17T11:39:15.637 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-17T11:39:15.637 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-17T11:39:15.637 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc 2023-12-17T11:39:15.637 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-17T11:39:15.637 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-17T11:39:15.637 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-17T11:39:15.638 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-17T11:39:15.638 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-17T11:39:15.638 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-17T11:39:15.638 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-17T11:39:15.638 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-17T11:39:15.638 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-17T11:39:15.638 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-17T11:39:15.638 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga 2023-12-17T11:39:15.638 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-17T11:39:15.638 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-17T11:39:15.638 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-17T11:39:15.638 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-17T11:39:15.638 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-17T11:39:15.638 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-17T11:39:15.639 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-17T11:39:15.639 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy 2023-12-17T11:39:15.639 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-17T11:39:15.639 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial 2023-12-17T11:39:15.639 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-17T11:39:15.639 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-17T11:39:15.639 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-17T11:39:15.639 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-17T11:39:15.639 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-17T11:39:15.639 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-17T11:39:15.639 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-17T11:39:15.639 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-17T11:39:15.639 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-17T11:39:15.639 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-17T11:39:15.639 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-17T11:39:15.640 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-17T11:39:15.640 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-17T11:39:15.640 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-17T11:39:15.640 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-17T11:39:15.640 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-17T11:39:15.640 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-17T11:39:15.640 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-17T11:39:15.640 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-17T11:39:15.640 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-17T11:39:15.640 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-17T11:39:15.640 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-17T11:39:15.640 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-17T11:39:15.640 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-17T11:39:15.640 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-17T11:39:15.640 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-17T11:39:15.641 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-17T11:39:15.641 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-17T11:39:15.641 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-17T11:39:15.641 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-17T11:39:15.641 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-17T11:39:15.641 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-17T11:39:15.641 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-17T11:39:15.641 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-17T11:39:15.641 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-17T11:39:15.641 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-17T11:39:15.641 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-17T11:39:15.641 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-17T11:39:15.641 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-17T11:39:15.641 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-17T11:39:15.642 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-17T11:39:15.642 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-17T11:39:15.642 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-17T11:39:15.642 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-17T11:39:15.642 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-17T11:39:15.642 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage 2023-12-17T11:39:15.642 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-17T11:39:15.642 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-17T11:39:15.642 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-17T11:39:15.642 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-17T11:39:15.642 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-17T11:39:15.642 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-17T11:39:15.642 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-17T11:39:15.642 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-17T11:39:15.642 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-17T11:39:15.643 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-17T11:39:15.643 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-17T11:39:15.643 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-17T11:39:15.643 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-17T11:39:15.643 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-17T11:39:15.643 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-17T11:39:15.643 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip 2023-12-17T11:39:15.643 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-17T11:39:15.643 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-17T11:39:15.643 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-17T11:39:15.643 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio 2023-12-17T11:39:15.643 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci 2023-12-17T11:39:15.643 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-17T11:39:15.643 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-17T11:39:15.643 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-17T11:39:15.643 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-17T11:39:15.644 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost 2023-12-17T11:39:15.644 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-17T11:39:15.644 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-17T11:39:15.644 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-17T11:39:15.644 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-17T11:39:15.644 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video 2023-12-17T11:39:15.644 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight 2023-12-17T11:39:15.644 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-17T11:39:15.644 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-17T11:39:15.644 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-17T11:39:15.644 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio 2023-12-17T11:39:15.644 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio.ko 2023-12-17T11:39:15.644 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_balloon.ko 2023-12-17T11:39:15.644 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_mmio.ko 2023-12-17T11:39:15.645 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci.ko 2023-12-17T11:39:15.645 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-17T11:39:15.645 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-17T11:39:15.645 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_ring.ko 2023-12-17T11:39:15.645 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1 2023-12-17T11:39:15.645 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters 2023-12-17T11:39:15.645 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-17T11:39:15.645 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-17T11:39:15.645 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves 2023-12-17T11:39:15.645 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-17T11:39:15.645 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-17T11:39:15.645 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-17T11:39:15.645 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-17T11:39:15.645 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-17T11:39:15.645 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-17T11:39:15.646 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-17T11:39:15.646 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-17T11:39:15.646 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-17T11:39:15.646 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-17T11:39:15.646 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-17T11:39:15.646 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-17T11:39:15.646 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog 2023-12-17T11:39:15.646 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-17T11:39:15.646 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-17T11:39:15.646 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-17T11:39:15.646 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-17T11:39:15.646 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-17T11:39:15.646 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-17T11:39:15.646 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-17T11:39:15.646 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-17T11:39:15.647 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-17T11:39:15.647 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-17T11:39:15.647 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-17T11:39:15.647 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-17T11:39:15.647 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-17T11:39:15.647 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-17T11:39:15.647 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-17T11:39:15.647 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-17T11:39:15.647 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-17T11:39:15.647 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-17T11:39:15.647 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-17T11:39:15.647 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-17T11:39:15.647 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-17T11:39:15.647 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-17T11:39:15.648 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-17T11:39:15.648 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-17T11:39:15.648 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-17T11:39:15.648 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-17T11:39:15.648 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen 2023-12-17T11:39:15.648 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-17T11:39:15.648 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-17T11:39:15.648 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-17T11:39:15.648 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-17T11:39:15.648 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback 2023-12-17T11:39:15.648 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-17T11:39:15.648 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-17T11:39:15.648 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs 2023-12-17T11:39:15.648 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-17T11:39:15.648 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs 2023-12-17T11:39:15.649 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p 2023-12-17T11:39:15.649 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-17T11:39:15.649 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs 2023-12-17T11:39:15.649 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-17T11:39:15.649 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs 2023-12-17T11:39:15.649 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-17T11:39:15.649 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-17T11:39:15.649 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs 2023-12-17T11:39:15.649 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-17T11:39:15.649 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles 2023-12-17T11:39:15.649 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-17T11:39:15.649 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph 2023-12-17T11:39:15.649 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-17T11:39:15.650 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda 2023-12-17T11:39:15.650 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-17T11:39:15.650 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs 2023-12-17T11:39:15.650 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-17T11:39:15.650 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm 2023-12-17T11:39:15.650 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-17T11:39:15.650 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs 2023-12-17T11:39:15.650 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-17T11:39:15.650 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs 2023-12-17T11:39:15.650 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-17T11:39:15.650 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat 2023-12-17T11:39:15.650 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/fat.ko 2023-12-17T11:39:15.650 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-17T11:39:15.650 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/vfat.ko 2023-12-17T11:39:15.650 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache 2023-12-17T11:39:15.651 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-17T11:39:15.651 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse 2023-12-17T11:39:15.651 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-17T11:39:15.651 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/fuse.ko 2023-12-17T11:39:15.651 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2 2023-12-17T11:39:15.651 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-17T11:39:15.651 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs 2023-12-17T11:39:15.651 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-17T11:39:15.651 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus 2023-12-17T11:39:15.651 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-17T11:39:15.651 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs 2023-12-17T11:39:15.651 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-17T11:39:15.651 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs 2023-12-17T11:39:15.651 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-17T11:39:15.652 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd 2023-12-17T11:39:15.652 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-17T11:39:15.652 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix 2023-12-17T11:39:15.652 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-17T11:39:15.652 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs 2023-12-17T11:39:15.652 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-17T11:39:15.652 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs 2023-12-17T11:39:15.652 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout 2023-12-17T11:39:15.652 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-17T11:39:15.652 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout 2023-12-17T11:39:15.652 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-17T11:39:15.652 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout 2023-12-17T11:39:15.652 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-17T11:39:15.652 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-17T11:39:15.653 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-17T11:39:15.653 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-17T11:39:15.653 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common 2023-12-17T11:39:15.653 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-17T11:39:15.653 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-17T11:39:15.653 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd 2023-12-17T11:39:15.653 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-17T11:39:15.653 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2 2023-12-17T11:39:15.653 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-17T11:39:15.653 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls 2023-12-17T11:39:15.653 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-17T11:39:15.653 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-17T11:39:15.653 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-17T11:39:15.653 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-17T11:39:15.654 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-17T11:39:15.654 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-17T11:39:15.654 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-17T11:39:15.654 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-17T11:39:15.654 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-17T11:39:15.654 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-17T11:39:15.654 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-17T11:39:15.654 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-17T11:39:15.654 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-17T11:39:15.654 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-17T11:39:15.654 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-17T11:39:15.654 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-17T11:39:15.654 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-17T11:39:15.654 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-17T11:39:15.654 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-17T11:39:15.655 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-17T11:39:15.655 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-17T11:39:15.655 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-17T11:39:15.655 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-17T11:39:15.655 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-17T11:39:15.655 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-17T11:39:15.655 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-17T11:39:15.655 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-17T11:39:15.655 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-17T11:39:15.655 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-17T11:39:15.655 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-17T11:39:15.655 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-17T11:39:15.655 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-17T11:39:15.655 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-17T11:39:15.656 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-17T11:39:15.656 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-17T11:39:15.656 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-17T11:39:15.656 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-17T11:39:15.656 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-17T11:39:15.656 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-17T11:39:15.656 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-17T11:39:15.656 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-17T11:39:15.656 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-17T11:39:15.656 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-17T11:39:15.656 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-17T11:39:15.656 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-17T11:39:15.656 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-17T11:39:15.656 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-17T11:39:15.656 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-17T11:39:15.656 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-17T11:39:15.657 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-17T11:39:15.657 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2 2023-12-17T11:39:15.657 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster 2023-12-17T11:39:15.657 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-17T11:39:15.657 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm 2023-12-17T11:39:15.657 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-17T11:39:15.657 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs 2023-12-17T11:39:15.657 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-17T11:39:15.657 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-17T11:39:15.657 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-17T11:39:15.657 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-17T11:39:15.657 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-17T11:39:15.657 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs 2023-12-17T11:39:15.658 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-17T11:39:15.658 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore 2023-12-17T11:39:15.658 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-17T11:39:15.658 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs 2023-12-17T11:39:15.658 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-17T11:39:15.658 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs 2023-12-17T11:39:15.658 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-17T11:39:15.658 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb 2023-12-17T11:39:15.658 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client 2023-12-17T11:39:15.658 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-17T11:39:15.658 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common 2023-12-17T11:39:15.658 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-17T11:39:15.658 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-17T11:39:15.658 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs 2023-12-17T11:39:15.658 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-17T11:39:15.659 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv 2023-12-17T11:39:15.659 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-17T11:39:15.659 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf 2023-12-17T11:39:15.659 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-17T11:39:15.659 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs 2023-12-17T11:39:15.659 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-17T11:39:15.659 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs 2023-12-17T11:39:15.659 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-17T11:39:15.659 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel 2023-12-17T11:39:15.659 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu 2023-12-17T11:39:15.659 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu/rcutorture.ko 2023-12-17T11:39:15.659 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-17T11:39:15.659 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace 2023-12-17T11:39:15.659 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-17T11:39:15.660 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib 2023-12-17T11:39:15.660 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/asn1_encoder.ko 2023-12-17T11:39:15.660 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-17T11:39:15.660 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-17T11:39:15.660 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto 2023-12-17T11:39:15.660 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-17T11:39:15.660 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-17T11:39:15.660 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-17T11:39:15.660 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-17T11:39:15.660 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4 2023-12-17T11:39:15.660 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-17T11:39:15.660 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-17T11:39:15.660 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math 2023-12-17T11:39:15.660 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-17T11:39:15.660 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6 2023-12-17T11:39:15.661 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-17T11:39:15.661 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon 2023-12-17T11:39:15.661 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-17T11:39:15.661 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-17T11:39:15.661 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-17T11:39:15.661 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-17T11:39:15.661 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd 2023-12-17T11:39:15.661 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd/zstd_compress.ko 2023-12-17T11:39:15.661 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm 2023-12-17T11:39:15.661 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-17T11:39:15.661 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net 2023-12-17T11:39:15.661 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan 2023-12-17T11:39:15.661 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-17T11:39:15.661 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-17T11:39:15.664 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-17T11:39:15.665 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-17T11:39:15.665 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-17T11:39:15.665 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-17T11:39:15.665 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-17T11:39:15.665 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-17T11:39:15.665 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802 2023-12-17T11:39:15.665 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-17T11:39:15.665 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-17T11:39:15.665 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-17T11:39:15.665 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-17T11:39:15.665 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-17T11:39:15.665 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q 2023-12-17T11:39:15.665 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-17T11:39:15.666 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p 2023-12-17T11:39:15.666 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-17T11:39:15.666 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-17T11:39:15.666 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-17T11:39:15.666 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-17T11:39:15.666 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv 2023-12-17T11:39:15.666 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-17T11:39:15.666 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge 2023-12-17T11:39:15.666 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-17T11:39:15.666 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-17T11:39:15.666 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter 2023-12-17T11:39:15.666 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-17T11:39:15.666 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-17T11:39:15.666 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-17T11:39:15.667 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-17T11:39:15.667 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-17T11:39:15.667 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-17T11:39:15.667 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-17T11:39:15.667 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-17T11:39:15.667 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-17T11:39:15.667 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-17T11:39:15.667 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-17T11:39:15.667 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-17T11:39:15.667 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-17T11:39:15.667 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-17T11:39:15.667 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-17T11:39:15.667 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-17T11:39:15.667 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-17T11:39:15.668 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-17T11:39:15.668 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-17T11:39:15.668 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-17T11:39:15.668 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-17T11:39:15.668 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-17T11:39:15.668 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-17T11:39:15.668 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-17T11:39:15.668 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph 2023-12-17T11:39:15.668 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-17T11:39:15.668 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core 2023-12-17T11:39:15.668 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/failover.ko 2023-12-17T11:39:15.668 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-17T11:39:15.668 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp 2023-12-17T11:39:15.668 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-17T11:39:15.668 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-17T11:39:15.669 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-17T11:39:15.669 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-17T11:39:15.669 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver 2023-12-17T11:39:15.669 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver/dns_resolver.ko 2023-12-17T11:39:15.669 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa 2023-12-17T11:39:15.669 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-17T11:39:15.669 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-17T11:39:15.669 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-17T11:39:15.669 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-17T11:39:15.669 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-17T11:39:15.669 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154 2023-12-17T11:39:15.669 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan 2023-12-17T11:39:15.669 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-17T11:39:15.670 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-17T11:39:15.670 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-17T11:39:15.670 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4 2023-12-17T11:39:15.670 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-17T11:39:15.670 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-17T11:39:15.670 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-17T11:39:15.670 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-17T11:39:15.670 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-17T11:39:15.670 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-17T11:39:15.670 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-17T11:39:15.670 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-17T11:39:15.670 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-17T11:39:15.670 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-17T11:39:15.671 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter 2023-12-17T11:39:15.671 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-17T11:39:15.671 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-17T11:39:15.671 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-17T11:39:15.671 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-17T11:39:15.671 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-17T11:39:15.671 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-17T11:39:15.671 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-17T11:39:15.671 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-17T11:39:15.671 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-17T11:39:15.671 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-17T11:39:15.671 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-17T11:39:15.671 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-17T11:39:15.671 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-17T11:39:15.671 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-17T11:39:15.672 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-17T11:39:15.672 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-17T11:39:15.672 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-17T11:39:15.672 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-17T11:39:15.672 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-17T11:39:15.672 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-17T11:39:15.672 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-17T11:39:15.672 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-17T11:39:15.672 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-17T11:39:15.672 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-17T11:39:15.672 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-17T11:39:15.672 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-17T11:39:15.672 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-17T11:39:15.672 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-17T11:39:15.672 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-17T11:39:15.673 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-17T11:39:15.673 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-17T11:39:15.673 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-17T11:39:15.673 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-17T11:39:15.673 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-17T11:39:15.673 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-17T11:39:15.673 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-17T11:39:15.673 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-17T11:39:15.673 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-17T11:39:15.673 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6 2023-12-17T11:39:15.673 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-17T11:39:15.673 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-17T11:39:15.673 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-17T11:39:15.673 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-17T11:39:15.673 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-17T11:39:15.674 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-17T11:39:15.674 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-17T11:39:15.674 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter 2023-12-17T11:39:15.674 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-17T11:39:15.674 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-17T11:39:15.674 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-17T11:39:15.674 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-17T11:39:15.674 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-17T11:39:15.674 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-17T11:39:15.674 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-17T11:39:15.674 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-17T11:39:15.674 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-17T11:39:15.674 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-17T11:39:15.674 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-17T11:39:15.674 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-17T11:39:15.674 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-17T11:39:15.675 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-17T11:39:15.675 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-17T11:39:15.675 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-17T11:39:15.675 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-17T11:39:15.675 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-17T11:39:15.675 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-17T11:39:15.675 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-17T11:39:15.675 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-17T11:39:15.675 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-17T11:39:15.675 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-17T11:39:15.675 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-17T11:39:15.675 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-17T11:39:15.675 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-17T11:39:15.675 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-17T11:39:15.675 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key 2023-12-17T11:39:15.676 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-17T11:39:15.676 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp 2023-12-17T11:39:15.676 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-17T11:39:15.676 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-17T11:39:15.676 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-17T11:39:15.676 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-17T11:39:15.676 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-17T11:39:15.676 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-17T11:39:15.676 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-17T11:39:15.676 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc 2023-12-17T11:39:15.676 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-17T11:39:15.676 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154 2023-12-17T11:39:15.676 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-17T11:39:15.676 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls 2023-12-17T11:39:15.676 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-17T11:39:15.676 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter 2023-12-17T11:39:15.677 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset 2023-12-17T11:39:15.677 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-17T11:39:15.677 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-17T11:39:15.677 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-17T11:39:15.677 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-17T11:39:15.677 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-17T11:39:15.677 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-17T11:39:15.677 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-17T11:39:15.677 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-17T11:39:15.677 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-17T11:39:15.677 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-17T11:39:15.677 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-17T11:39:15.677 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-17T11:39:15.677 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-17T11:39:15.677 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-17T11:39:15.678 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-17T11:39:15.678 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-17T11:39:15.678 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs 2023-12-17T11:39:15.678 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-17T11:39:15.678 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-17T11:39:15.678 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-17T11:39:15.678 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-17T11:39:15.678 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-17T11:39:15.678 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-17T11:39:15.678 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-17T11:39:15.678 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-17T11:39:15.678 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-17T11:39:15.678 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-17T11:39:15.678 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-17T11:39:15.678 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-17T11:39:15.679 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-17T11:39:15.679 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-17T11:39:15.679 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-17T11:39:15.679 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-17T11:39:15.679 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-17T11:39:15.679 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-17T11:39:15.679 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-17T11:39:15.679 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-17T11:39:15.679 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-17T11:39:15.679 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-17T11:39:15.679 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-17T11:39:15.679 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-17T11:39:15.679 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-17T11:39:15.679 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-17T11:39:15.680 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-17T11:39:15.680 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-17T11:39:15.680 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-17T11:39:15.680 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-17T11:39:15.680 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-17T11:39:15.680 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-17T11:39:15.680 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-17T11:39:15.680 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-17T11:39:15.680 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-17T11:39:15.680 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-17T11:39:15.680 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-17T11:39:15.680 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-17T11:39:15.680 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-17T11:39:15.680 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-17T11:39:15.680 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-17T11:39:15.681 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-17T11:39:15.681 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-17T11:39:15.681 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-17T11:39:15.681 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-17T11:39:15.681 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-17T11:39:15.681 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-17T11:39:15.681 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-17T11:39:15.681 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-17T11:39:15.681 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-17T11:39:15.681 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-17T11:39:15.681 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-17T11:39:15.681 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-17T11:39:15.681 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-17T11:39:15.682 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-17T11:39:15.682 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-17T11:39:15.682 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-17T11:39:15.682 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-17T11:39:15.682 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_quota.ko 2023-12-17T11:39:15.682 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-17T11:39:15.682 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-17T11:39:15.682 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-17T11:39:15.682 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-17T11:39:15.682 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tunnel.ko 2023-12-17T11:39:15.682 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-17T11:39:15.682 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-17T11:39:15.682 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-17T11:39:15.682 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-17T11:39:15.682 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-17T11:39:15.682 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-17T11:39:15.683 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-17T11:39:15.683 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-17T11:39:15.683 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-17T11:39:15.683 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-17T11:39:15.683 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-17T11:39:15.683 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-17T11:39:15.683 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-17T11:39:15.683 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-17T11:39:15.683 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-17T11:39:15.683 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-17T11:39:15.683 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-17T11:39:15.683 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-17T11:39:15.683 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-17T11:39:15.683 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-17T11:39:15.684 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-17T11:39:15.684 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-17T11:39:15.684 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-17T11:39:15.684 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-17T11:39:15.684 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-17T11:39:15.684 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-17T11:39:15.684 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-17T11:39:15.684 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-17T11:39:15.684 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-17T11:39:15.684 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-17T11:39:15.684 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-17T11:39:15.684 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-17T11:39:15.684 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-17T11:39:15.684 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-17T11:39:15.684 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-17T11:39:15.685 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-17T11:39:15.685 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-17T11:39:15.685 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-17T11:39:15.685 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-17T11:39:15.685 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-17T11:39:15.685 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-17T11:39:15.685 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-17T11:39:15.685 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-17T11:39:15.685 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-17T11:39:15.685 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-17T11:39:15.685 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-17T11:39:15.685 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-17T11:39:15.685 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-17T11:39:15.685 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-17T11:39:15.686 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-17T11:39:15.686 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-17T11:39:15.686 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-17T11:39:15.686 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-17T11:39:15.686 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-17T11:39:15.686 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-17T11:39:15.686 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-17T11:39:15.686 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-17T11:39:15.686 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-17T11:39:15.686 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-17T11:39:15.686 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-17T11:39:15.686 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-17T11:39:15.686 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-17T11:39:15.686 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-17T11:39:15.686 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-17T11:39:15.687 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-17T11:39:15.687 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-17T11:39:15.687 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-17T11:39:15.687 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-17T11:39:15.687 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-17T11:39:15.687 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-17T11:39:15.687 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-17T11:39:15.687 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink 2023-12-17T11:39:15.687 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-17T11:39:15.687 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh 2023-12-17T11:39:15.687 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-17T11:39:15.687 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch 2023-12-17T11:39:15.687 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-17T11:39:15.687 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-17T11:39:15.688 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-17T11:39:15.688 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-17T11:39:15.688 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet 2023-12-17T11:39:15.688 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-17T11:39:15.688 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds 2023-12-17T11:39:15.688 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-17T11:39:15.688 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-17T11:39:15.688 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-17T11:39:15.688 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched 2023-12-17T11:39:15.688 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-17T11:39:15.688 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-17T11:39:15.688 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-17T11:39:15.688 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-17T11:39:15.688 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-17T11:39:15.689 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-17T11:39:15.689 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-17T11:39:15.689 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-17T11:39:15.689 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-17T11:39:15.689 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-17T11:39:15.689 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-17T11:39:15.689 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-17T11:39:15.689 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-17T11:39:15.689 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-17T11:39:15.689 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-17T11:39:15.689 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-17T11:39:15.689 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-17T11:39:15.689 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-17T11:39:15.690 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-17T11:39:15.690 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-17T11:39:15.690 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-17T11:39:15.690 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-17T11:39:15.690 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-17T11:39:15.690 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-17T11:39:15.690 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-17T11:39:15.690 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-17T11:39:15.690 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-17T11:39:15.690 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-17T11:39:15.690 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-17T11:39:15.690 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-17T11:39:15.690 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-17T11:39:15.691 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-17T11:39:15.691 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-17T11:39:15.691 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-17T11:39:15.691 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-17T11:39:15.691 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-17T11:39:15.691 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-17T11:39:15.691 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-17T11:39:15.691 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-17T11:39:15.691 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-17T11:39:15.691 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-17T11:39:15.691 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-17T11:39:15.691 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-17T11:39:15.691 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-17T11:39:15.691 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp 2023-12-17T11:39:15.692 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-17T11:39:15.692 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-17T11:39:15.692 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc 2023-12-17T11:39:15.692 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss 2023-12-17T11:39:15.692 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-17T11:39:15.692 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-17T11:39:15.692 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-17T11:39:15.692 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma 2023-12-17T11:39:15.692 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-17T11:39:15.692 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc 2023-12-17T11:39:15.692 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-17T11:39:15.692 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-17T11:39:15.692 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix 2023-12-17T11:39:15.692 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-17T11:39:15.692 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock 2023-12-17T11:39:15.693 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-17T11:39:15.693 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-17T11:39:15.693 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-17T11:39:15.693 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-17T11:39:15.693 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-17T11:39:15.693 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm 2023-12-17T11:39:15.693 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-17T11:39:15.693 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security 2023-12-17T11:39:15.693 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys 2023-12-17T11:39:15.693 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys 2023-12-17T11:39:15.693 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-17T11:39:15.693 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys 2023-12-17T11:39:15.693 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys/trusted.ko 2023-12-17T11:39:15.694 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt 2023-12-17T11:39:15.694 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib 2023-12-17T11:39:15.694 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-17T11:39:15.694 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-17T11:39:15.694 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-17T11:39:15.694 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-17T11:39:15.694 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-17T11:39:15.694 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-17T11:39:15.694 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-17T11:39:15.694 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-17T11:39:15.694 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-17T11:39:15.694 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-17T11:39:15.694 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-17T11:39:15.694 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-17T11:39:15.694 INFO:teuthology.orchestra.run.smithi008.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-17T11:39:15.695 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-17T11:39:15.695 DEBUG:teuthology.orchestra.run.smithi008:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-17T11:39:15.724 INFO:teuthology.orchestra.run.smithi008.stdout:postinstall scriptlet (using /bin/sh): 2023-12-17T11:39:15.724 INFO:teuthology.orchestra.run.smithi008.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-gcd68252d7b4d -a -r /boot/System.map-6.6.0-gcd68252d7b4d ]; then 2023-12-17T11:39:15.724 INFO:teuthology.orchestra.run.smithi008.stdout:cp /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm 2023-12-17T11:39:15.725 INFO:teuthology.orchestra.run.smithi008.stdout:cp /boot/System.map-6.6.0-gcd68252d7b4d /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-17T11:39:15.725 INFO:teuthology.orchestra.run.smithi008.stdout:rm -f /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/System.map-6.6.0-gcd68252d7b4d 2023-12-17T11:39:15.725 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/installkernel 6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-17T11:39:15.725 INFO:teuthology.orchestra.run.smithi008.stdout:rm -f /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-17T11:39:15.725 INFO:teuthology.orchestra.run.smithi008.stdout:fi 2023-12-17T11:39:15.725 INFO:teuthology.orchestra.run.smithi008.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-17T11:39:15.725 INFO:teuthology.orchestra.run.smithi008.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-17T11:39:15.725 INFO:teuthology.orchestra.run.smithi008.stdout:new-kernel-pkg --remove 6.6.0-gcd68252d7b4d --rminitrd --initrdfile=/boot/initramfs-6.6.0-gcd68252d7b4d.img 2023-12-17T11:39:15.725 INFO:teuthology.orchestra.run.smithi008.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-17T11:39:15.725 INFO:teuthology.orchestra.run.smithi008.stdout:kernel-install remove 6.6.0-gcd68252d7b4d 2023-12-17T11:39:15.725 INFO:teuthology.orchestra.run.smithi008.stdout:fi 2023-12-17T11:39:15.725 INFO:teuthology.orchestra.run.smithi008.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-17T11:39:15.725 INFO:teuthology.orchestra.run.smithi008.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-17T11:39:15.725 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/update-bootloader --remove 6.6.0-gcd68252d7b4d 2023-12-17T11:39:15.726 INFO:teuthology.orchestra.run.smithi008.stdout:fi 2023-12-17T11:39:15.726 DEBUG:teuthology.orchestra.run.smithi008:> sudo rpm -qi grub2-tools 2023-12-17T11:39:15.811 INFO:teuthology.orchestra.run.smithi008.stdout:Name : grub2-tools 2023-12-17T11:39:15.811 INFO:teuthology.orchestra.run.smithi008.stdout:Epoch : 1 2023-12-17T11:39:15.812 INFO:teuthology.orchestra.run.smithi008.stdout:Version : 2.02 2023-12-17T11:39:15.812 INFO:teuthology.orchestra.run.smithi008.stdout:Release : 123.el8 2023-12-17T11:39:15.812 INFO:teuthology.orchestra.run.smithi008.stdout:Architecture: x86_64 2023-12-17T11:39:15.812 INFO:teuthology.orchestra.run.smithi008.stdout:Install Date: Thu 14 Dec 2023 12:39:42 AM UTC 2023-12-17T11:39:15.812 INFO:teuthology.orchestra.run.smithi008.stdout:Group : System Environment/Base 2023-12-17T11:39:15.812 INFO:teuthology.orchestra.run.smithi008.stdout:Size : 9265450 2023-12-17T11:39:15.812 INFO:teuthology.orchestra.run.smithi008.stdout:License : GPLv3+ 2023-12-17T11:39:15.812 INFO:teuthology.orchestra.run.smithi008.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-12-17T11:39:15.812 INFO:teuthology.orchestra.run.smithi008.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-12-17T11:39:15.812 INFO:teuthology.orchestra.run.smithi008.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-12-17T11:39:15.812 INFO:teuthology.orchestra.run.smithi008.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-12-17T11:39:15.812 INFO:teuthology.orchestra.run.smithi008.stdout:Relocations : (not relocatable) 2023-12-17T11:39:15.813 INFO:teuthology.orchestra.run.smithi008.stdout:Packager : Red Hat, Inc. 2023-12-17T11:39:15.813 INFO:teuthology.orchestra.run.smithi008.stdout:Vendor : Red Hat, Inc. 2023-12-17T11:39:15.813 INFO:teuthology.orchestra.run.smithi008.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-17T11:39:15.813 INFO:teuthology.orchestra.run.smithi008.stdout:Summary : Support tools for GRUB. 2023-12-17T11:39:15.813 INFO:teuthology.orchestra.run.smithi008.stdout:Description : 2023-12-17T11:39:15.813 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T11:39:15.813 INFO:teuthology.orchestra.run.smithi008.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-17T11:39:15.813 INFO:teuthology.orchestra.run.smithi008.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-17T11:39:15.813 INFO:teuthology.orchestra.run.smithi008.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-17T11:39:15.813 INFO:teuthology.orchestra.run.smithi008.stdout:hardware devices. 2023-12-17T11:39:15.813 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T11:39:15.813 INFO:teuthology.orchestra.run.smithi008.stdout:This subpackage provides tools for support of all platforms. 2023-12-17T11:39:15.814 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-17T11:39:15.815 INFO:teuthology.task.kernel:Updating grub on smithi008 to boot 6.6.0-gcd68252d7b4d 2023-12-17T11:39:15.815 DEBUG:teuthology.orchestra.run.smithi008:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-17T11:39:16.250 INFO:teuthology.orchestra.run.smithi186.stderr:done 2023-12-17T11:39:16.251 DEBUG:teuthology.orchestra.run.smithi186:> mktemp 2023-12-17T11:39:16.278 INFO:teuthology.orchestra.run.smithi186.stdout:/tmp/tmp.aea055AchW 2023-12-17T11:39:16.278 DEBUG:teuthology.orchestra.run.smithi186:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.aea055AchW 2023-12-17T11:39:16.351 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 0666 /tmp/tmp.aea055AchW 2023-12-17T11:39:16.512 DEBUG:teuthology.orchestra.remote:smithi186:/tmp/tmp.aea055AchW is 6KB 2023-12-17T11:39:16.542 INFO:teuthology.orchestra.run.smithi008.stderr:Generating grub configuration file ... 2023-12-17T11:39:16.560 DEBUG:teuthology.orchestra.run.smithi186:> rm -fr /tmp/tmp.aea055AchW 2023-12-17T11:39:16.577 DEBUG:teuthology.orchestra.run.smithi186:> sudo /bin/ls /boot/loader/entries || true 2023-12-17T11:39:16.642 INFO:teuthology.orchestra.run.smithi186.stdout:2db68f91c8f90721a6596efe657a5324-0-rescue.conf 2023-12-17T11:39:16.642 INFO:teuthology.orchestra.run.smithi186.stdout:2db68f91c8f90721a6596efe657a5324-6.6.0-gcd68252d7b4d.conf 2023-12-17T11:39:16.642 INFO:teuthology.orchestra.run.smithi186.stdout:963f8b6c99184de696879b3f7da9ecce-0-rescue.conf 2023-12-17T11:39:16.642 INFO:teuthology.orchestra.run.smithi186.stdout:963f8b6c99184de696879b3f7da9ecce-4.18.0-372.9.1.el8.x86_64.conf 2023-12-17T11:39:16.642 INFO:teuthology.orchestra.run.smithi186.stdout:963f8b6c99184de696879b3f7da9ecce-4.18.0-513.9.1.el8_9.x86_64.conf 2023-12-17T11:39:16.643 DEBUG:teuthology.orchestra.run.smithi186:> sudo grub2-set-default 2db68f91c8f90721a6596efe657a5324-6.6.0-gcd68252d7b4d 2023-12-17T11:39:16.811 DEBUG:teuthology.orchestra.run.smithi186:> sudo shutdown -r now 2023-12-17T11:39:18.792 INFO:teuthology.orchestra.run.smithi008.stderr:done 2023-12-17T11:39:18.795 DEBUG:teuthology.orchestra.run.smithi008:> mktemp 2023-12-17T11:39:18.816 INFO:teuthology.orchestra.run.smithi008.stdout:/tmp/tmp.N0KDl3kNJ3 2023-12-17T11:39:18.816 DEBUG:teuthology.orchestra.run.smithi008:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.N0KDl3kNJ3 2023-12-17T11:39:18.903 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0666 /tmp/tmp.N0KDl3kNJ3 2023-12-17T11:39:19.051 DEBUG:teuthology.orchestra.remote:smithi008:/tmp/tmp.N0KDl3kNJ3 is 6KB 2023-12-17T11:39:19.101 DEBUG:teuthology.orchestra.run.smithi008:> rm -fr /tmp/tmp.N0KDl3kNJ3 2023-12-17T11:39:19.122 DEBUG:teuthology.orchestra.run.smithi008:> sudo /bin/ls /boot/loader/entries || true 2023-12-17T11:39:19.195 INFO:teuthology.orchestra.run.smithi008.stdout:2db68f91c8f90721a6596efe657a5324-0-rescue.conf 2023-12-17T11:39:19.195 INFO:teuthology.orchestra.run.smithi008.stdout:2db68f91c8f90721a6596efe657a5324-6.6.0-gcd68252d7b4d.conf 2023-12-17T11:39:19.195 INFO:teuthology.orchestra.run.smithi008.stdout:963f8b6c99184de696879b3f7da9ecce-0-rescue.conf 2023-12-17T11:39:19.195 INFO:teuthology.orchestra.run.smithi008.stdout:963f8b6c99184de696879b3f7da9ecce-4.18.0-372.9.1.el8.x86_64.conf 2023-12-17T11:39:19.196 INFO:teuthology.orchestra.run.smithi008.stdout:963f8b6c99184de696879b3f7da9ecce-4.18.0-513.9.1.el8_9.x86_64.conf 2023-12-17T11:39:19.197 DEBUG:teuthology.orchestra.run.smithi008:> sudo grub2-set-default 2db68f91c8f90721a6596efe657a5324-6.6.0-gcd68252d7b4d 2023-12-17T11:39:19.356 DEBUG:teuthology.orchestra.run.smithi008:> sudo shutdown -r now 2023-12-17T11:39:46.814 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2023-12-17T11:39:46.815 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-12-17T11:39:46.816 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:39:49.359 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-12-17T11:39:49.360 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-12-17T11:39:49.360 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:40:21.394 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-12-17T11:40:30.395 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-12-17T11:40:30.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:40:48.790 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-12-17T11:40:49.363 DEBUG:teuthology.orchestra.remote:timed out 2023-12-17T11:40:58.363 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-12-17T11:40:58.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:40:58.896 DEBUG:teuthology.orchestra.run.smithi008:> true 2023-12-17T11:40:59.316 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-12-17T11:40:59.316 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.6.0-gcd68252d7b4d"... 2023-12-17T11:40:59.316 DEBUG:teuthology.orchestra.run.smithi008:> uname -r 2023-12-17T11:40:59.358 INFO:teuthology.orchestra.run.smithi008.stdout:6.6.0-gcd68252d7b4d 2023-12-17T11:40:59.358 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-17T11:40:59.358 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-17T11:40:59.358 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-12-17T11:41:00.359 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-12-17T11:41:00.359 DEBUG:teuthology.orchestra.run.smithi008:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-17T11:41:00.502 INFO:teuthology.orchestra.run.smithi008.stdout:ttyS1 2023-12-17T11:41:00.526 DEBUG:teuthology.parallel:result is None 2023-12-17T11:41:00.790 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-12-17T11:41:00.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:41:03.861 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.186 2023-12-17T11:41:18.863 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-12-17T11:41:18.864 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:41:19.243 DEBUG:teuthology.orchestra.run.smithi186:> true 2023-12-17T11:41:19.685 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-12-17T11:41:19.685 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "6.6.0-gcd68252d7b4d"... 2023-12-17T11:41:19.686 DEBUG:teuthology.orchestra.run.smithi186:> uname -r 2023-12-17T11:41:19.729 INFO:teuthology.orchestra.run.smithi186.stdout:6.6.0-gcd68252d7b4d 2023-12-17T11:41:19.729 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-17T11:41:19.732 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-17T11:41:19.732 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-12-17T11:41:20.733 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2023-12-17T11:41:20.733 DEBUG:teuthology.orchestra.run.smithi186:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-17T11:41:20.887 INFO:teuthology.orchestra.run.smithi186.stdout:ttyS1 2023-12-17T11:41:20.918 DEBUG:teuthology.parallel:result is None 2023-12-17T11:41:20.918 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-17T11:41:20.931 INFO:teuthology.task.internal:Creating test directory... 2023-12-17T11:41:20.931 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-17T11:41:20.936 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-17T11:41:20.942 DEBUG:teuthology.orchestra.run.smithi186:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-17T11:41:20.987 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-17T11:41:20.994 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-17T11:41:21.004 INFO:teuthology.task.internal:Creating archive directory... 2023-12-17T11:41:21.004 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-17T11:41:21.012 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-17T11:41:21.017 DEBUG:teuthology.orchestra.run.smithi186:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-17T11:41:21.093 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-17T11:41:21.101 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-17T11:41:21.101 DEBUG:teuthology.orchestra.run.smithi008:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-17T11:41:21.106 DEBUG:teuthology.orchestra.run.smithi100:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-17T11:41:21.111 DEBUG:teuthology.orchestra.run.smithi186:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-17T11:41:21.185 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-17T11:41:21.201 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-17T11:41:21.205 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-17T11:41:21.212 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-17T11:41:21.232 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-17T11:41:21.233 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-17T11:41:21.236 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-17T11:41:21.243 INFO:teuthology.task.internal:Configuring sudo... 2023-12-17T11:41:21.243 DEBUG:teuthology.orchestra.run.smithi008:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-17T11:41:21.248 DEBUG:teuthology.orchestra.run.smithi100:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-17T11:41:21.252 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-17T11:41:21.320 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-17T11:41:21.330 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-17T11:41:21.330 DEBUG:teuthology.orchestra.run.smithi008:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-17T11:41:21.334 DEBUG:teuthology.orchestra.run.smithi100:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-17T11:41:21.339 DEBUG:teuthology.orchestra.run.smithi186:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-17T11:41:21.381 DEBUG:teuthology.orchestra.run.smithi008:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-17T11:41:21.487 DEBUG:teuthology.orchestra.run.smithi008:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-17T11:41:21.566 DEBUG:teuthology.orchestra.run.smithi008:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-17T11:41:21.636 DEBUG:teuthology.orchestra.run.smithi008:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-17T11:41:21.722 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-12-17T11:41:21.722 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-17T11:41:21.790 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-17T11:41:21.864 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-17T11:41:21.943 DEBUG:teuthology.orchestra.run.smithi100:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-17T11:41:22.014 DEBUG:teuthology.orchestra.run.smithi100:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-17T11:41:22.097 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-12-17T11:41:22.098 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-17T11:41:22.165 DEBUG:teuthology.orchestra.run.smithi186:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-17T11:41:22.240 DEBUG:teuthology.orchestra.run.smithi186:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-17T11:41:22.311 DEBUG:teuthology.orchestra.run.smithi186:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-17T11:41:22.380 DEBUG:teuthology.orchestra.run.smithi186:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-17T11:41:22.466 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-12-17T11:41:22.466 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-17T11:41:22.535 DEBUG:teuthology.orchestra.run.smithi008:> sudo service rsyslog restart 2023-12-17T11:41:22.539 DEBUG:teuthology.orchestra.run.smithi100:> sudo service rsyslog restart 2023-12-17T11:41:22.544 DEBUG:teuthology.orchestra.run.smithi186:> sudo service rsyslog restart 2023-12-17T11:41:22.655 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-17T11:41:22.667 INFO:teuthology.orchestra.run.smithi008.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-17T11:41:22.687 INFO:teuthology.orchestra.run.smithi186.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-17T11:41:23.031 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-17T11:41:23.039 INFO:teuthology.task.internal:Starting timer... 2023-12-17T11:41:23.039 INFO:teuthology.run_tasks:Running task pcp... 2023-12-17T11:41:23.050 INFO:teuthology.run_tasks:Running task selinux... 2023-12-17T11:41:23.059 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-12-17T11:41:23.060 DEBUG:teuthology.orchestra.run.smithi008:> sudo service auditd rotate 2023-12-17T11:41:23.194 INFO:teuthology.orchestra.run.smithi008.stdout:Rotating logs: 2023-12-17T11:41:23.198 DEBUG:teuthology.orchestra.run.smithi100:> sudo service auditd rotate 2023-12-17T11:41:23.347 INFO:teuthology.orchestra.run.smithi100.stdout:Rotating logs: 2023-12-17T11:41:23.350 DEBUG:teuthology.orchestra.run.smithi186:> sudo service auditd rotate 2023-12-17T11:41:23.499 INFO:teuthology.orchestra.run.smithi186.stdout:Rotating logs: 2023-12-17T11:41:23.502 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-17T11:41:23.502 DEBUG:teuthology.orchestra.run.smithi008:> /usr/sbin/getenforce 2023-12-17T11:41:23.554 INFO:teuthology.orchestra.run.smithi008.stdout:Permissive 2023-12-17T11:41:23.555 DEBUG:teuthology.orchestra.run.smithi100:> /usr/sbin/getenforce 2023-12-17T11:41:23.600 INFO:teuthology.orchestra.run.smithi100.stdout:Permissive 2023-12-17T11:41:23.601 DEBUG:teuthology.orchestra.run.smithi186:> /usr/sbin/getenforce 2023-12-17T11:41:23.654 INFO:teuthology.orchestra.run.smithi186.stdout:Permissive 2023-12-17T11:41:23.654 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi008.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi100.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi186.front.sepia.ceph.com': 'permissive'} 2023-12-17T11:41:23.655 DEBUG:teuthology.orchestra.run.smithi008:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-17T11:41:23.724 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-17T11:41:23.725 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-17T11:41:23.794 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-17T11:41:23.795 DEBUG:teuthology.orchestra.run.smithi186:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-17T11:41:23.864 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-17T11:41:23.865 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-17T11:41:23.865 DEBUG:teuthology.orchestra.run.smithi008:> sudo /usr/sbin/setenforce permissive 2023-12-17T11:41:23.941 DEBUG:teuthology.orchestra.run.smithi100:> sudo /usr/sbin/setenforce permissive 2023-12-17T11:41:24.022 DEBUG:teuthology.orchestra.run.smithi186:> sudo /usr/sbin/setenforce permissive 2023-12-17T11:41:24.092 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-17T11:41:24.102 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-17T11:41:24.102 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-17T11:41:24.121 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-17T11:41:24.122 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi008.front.sepia.ceph.com,smithi100.front.sepia.ceph.com,smithi186.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-17T11:49:46.772 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi008.front.sepia.ceph.com'), Remote(name='ubuntu@smithi100.front.sepia.ceph.com'), Remote(name='ubuntu@smithi186.front.sepia.ceph.com')] 2023-12-17T11:49:46.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-12-17T11:49:46.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi008.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:49:46.861 DEBUG:teuthology.orchestra.run.smithi008:> true 2023-12-17T11:49:46.968 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi008.front.sepia.ceph.com' 2023-12-17T11:49:46.968 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi100.front.sepia.ceph.com' 2023-12-17T11:49:46.969 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi100.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:49:47.056 DEBUG:teuthology.orchestra.run.smithi100:> true 2023-12-17T11:49:47.169 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi100.front.sepia.ceph.com' 2023-12-17T11:49:47.169 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-12-17T11:49:47.169 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-17T11:49:47.260 DEBUG:teuthology.orchestra.run.smithi186:> true 2023-12-17T11:49:47.373 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com' 2023-12-17T11:49:47.374 INFO:teuthology.run_tasks:Running task clock... 2023-12-17T11:49:47.383 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-17T11:49:47.384 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-17T11:49:47.384 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-17T11:49:47.389 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-17T11:49:47.389 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-17T11:49:47.393 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-17T11:49:47.393 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-17T11:49:47.461 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-17T11:49:47.464 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-17T11:49:47.488 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-17T11:49:47.495 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-17T11:49:47.498 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-17T11:49:47.522 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-17T11:49:47.590 INFO:teuthology.orchestra.run.smithi008.stderr:sudo: ntpd: command not found 2023-12-17T11:49:47.591 INFO:teuthology.orchestra.run.smithi100.stderr:sudo: ntpd: command not found 2023-12-17T11:49:47.616 INFO:teuthology.orchestra.run.smithi186.stderr:sudo: ntpd: command not found 2023-12-17T11:49:47.620 INFO:teuthology.orchestra.run.smithi100.stdout:506 Cannot talk to daemon 2023-12-17T11:49:47.620 INFO:teuthology.orchestra.run.smithi008.stdout:506 Cannot talk to daemon 2023-12-17T11:49:47.645 INFO:teuthology.orchestra.run.smithi186.stdout:506 Cannot talk to daemon 2023-12-17T11:49:47.654 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-17T11:49:47.655 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-17T11:49:47.679 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-17T11:49:47.688 INFO:teuthology.orchestra.run.smithi100.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-17T11:49:47.690 INFO:teuthology.orchestra.run.smithi008.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-17T11:49:47.713 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-17T11:49:47.783 INFO:teuthology.orchestra.run.smithi008.stderr:bash: ntpq: command not found 2023-12-17T11:49:47.787 INFO:teuthology.orchestra.run.smithi100.stderr:bash: ntpq: command not found 2023-12-17T11:49:47.791 INFO:teuthology.orchestra.run.smithi008.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-17T11:49:47.791 INFO:teuthology.orchestra.run.smithi008.stdout:=============================================================================== 2023-12-17T11:49:47.791 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-17T11:49:47.791 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-17T11:49:47.791 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-17T11:49:47.791 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-17T11:49:47.794 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-17T11:49:47.794 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2023-12-17T11:49:47.794 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-17T11:49:47.794 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-17T11:49:47.794 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-17T11:49:47.794 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-17T11:49:47.803 INFO:teuthology.orchestra.run.smithi186.stderr:bash: ntpq: command not found 2023-12-17T11:49:47.811 INFO:teuthology.orchestra.run.smithi186.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-17T11:49:47.811 INFO:teuthology.orchestra.run.smithi186.stdout:=============================================================================== 2023-12-17T11:49:47.811 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-17T11:49:47.811 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-17T11:49:47.811 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-17T11:49:47.812 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-17T11:49:47.813 INFO:teuthology.run_tasks:Running task pexec... 2023-12-17T11:49:47.822 INFO:teuthology.task.pexec:Executing custom commands... 2023-12-17T11:49:47.823 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi008.front.sepia.ceph.com 2023-12-17T11:49:47.823 DEBUG:teuthology.orchestra.run.smithi008:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-17T11:49:47.823 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi100.front.sepia.ceph.com 2023-12-17T11:49:47.823 DEBUG:teuthology.orchestra.run.smithi100:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-17T11:49:47.824 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi186.front.sepia.ceph.com 2023-12-17T11:49:47.824 DEBUG:teuthology.orchestra.run.smithi186:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-12-17T11:49:48.312 INFO:teuthology.orchestra.run.smithi100.stdout:Updating Subscription Management repositories. 2023-12-17T11:49:48.316 INFO:teuthology.orchestra.run.smithi186.stdout:Updating Subscription Management repositories. 2023-12-17T11:49:48.347 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-12-17T11:49:50.262 INFO:teuthology.orchestra.run.smithi186.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 42 kB/s | 4.5 kB 00:00 2023-12-17T11:49:50.323 INFO:teuthology.orchestra.run.smithi100.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 38 kB/s | 4.1 kB 00:00 2023-12-17T11:49:50.348 INFO:teuthology.orchestra.run.smithi008.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 26 kB/s | 4.1 kB 00:00 2023-12-17T11:49:50.702 INFO:teuthology.orchestra.run.smithi100.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 41 kB/s | 4.5 kB 00:00 2023-12-17T11:49:50.819 INFO:teuthology.orchestra.run.smithi008.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 26 kB/s | 4.5 kB 00:00 2023-12-17T11:49:50.909 INFO:teuthology.orchestra.run.smithi186.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 33 kB/s | 4.1 kB 00:00 2023-12-17T11:49:53.666 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2023-12-17T11:49:53.667 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-17T11:49:53.667 INFO:teuthology.orchestra.run.smithi100.stdout: Package Architecture Version Repository Size 2023-12-17T11:49:53.667 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-17T11:49:53.667 INFO:teuthology.orchestra.run.smithi100.stdout:Resetting modules: 2023-12-17T11:49:53.667 INFO:teuthology.orchestra.run.smithi100.stdout: container-tools 2023-12-17T11:49:53.667 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-17T11:49:53.668 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2023-12-17T11:49:53.668 INFO:teuthology.orchestra.run.smithi100.stdout:================================================================================ 2023-12-17T11:49:53.668 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-17T11:49:53.940 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2023-12-17T11:49:53.941 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2023-12-17T11:49:53.941 INFO:teuthology.orchestra.run.smithi186.stdout: Package Architecture Version Repository Size 2023-12-17T11:49:53.941 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2023-12-17T11:49:53.941 INFO:teuthology.orchestra.run.smithi186.stdout:Resetting modules: 2023-12-17T11:49:53.941 INFO:teuthology.orchestra.run.smithi186.stdout: container-tools 2023-12-17T11:49:53.941 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-12-17T11:49:53.941 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction Summary 2023-12-17T11:49:53.941 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2023-12-17T11:49:53.941 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-12-17T11:49:54.356 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-12-17T11:49:54.358 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-12-17T11:49:54.358 INFO:teuthology.orchestra.run.smithi008.stdout: Package Architecture Version Repository Size 2023-12-17T11:49:54.358 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-12-17T11:49:54.358 INFO:teuthology.orchestra.run.smithi008.stdout:Resetting modules: 2023-12-17T11:49:54.358 INFO:teuthology.orchestra.run.smithi008.stdout: container-tools 2023-12-17T11:49:54.358 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T11:49:54.358 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-12-17T11:49:54.358 INFO:teuthology.orchestra.run.smithi008.stdout:================================================================================ 2023-12-17T11:49:54.358 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T11:50:04.074 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-12-17T11:50:04.727 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-12-17T11:50:06.568 INFO:teuthology.orchestra.run.smithi008.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 38 kB/s | 4.1 kB 00:00 2023-12-17T11:50:06.984 INFO:teuthology.orchestra.run.smithi008.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 35 kB/s | 4.5 kB 00:00 2023-12-17T11:50:08.252 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2023-12-17T11:50:08.854 INFO:teuthology.orchestra.run.smithi100.stdout:Updating Subscription Management repositories. 2023-12-17T11:50:09.002 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2023-12-17T11:50:09.627 INFO:teuthology.orchestra.run.smithi186.stdout:Updating Subscription Management repositories. 2023-12-17T11:50:10.481 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-12-17T11:50:10.653 INFO:teuthology.orchestra.run.smithi008.stdout:========================================================================================================== 2023-12-17T11:50:10.653 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-12-17T11:50:10.653 INFO:teuthology.orchestra.run.smithi008.stdout:========================================================================================================== 2023-12-17T11:50:10.653 INFO:teuthology.orchestra.run.smithi008.stdout:Installing group/module packages: 2023-12-17T11:50:10.653 INFO:teuthology.orchestra.run.smithi008.stdout: aardvark-dns x86_64 2:1.7.0-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 1.0 M 2023-12-17T11:50:10.653 INFO:teuthology.orchestra.run.smithi008.stdout: buildah x86_64 1:1.31.3-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 8.8 M 2023-12-17T11:50:10.653 INFO:teuthology.orchestra.run.smithi008.stdout: cockpit-podman noarch 75-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 739 k 2023-12-17T11:50:10.653 INFO:teuthology.orchestra.run.smithi008.stdout: crun x86_64 1.8.7-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 239 k 2023-12-17T11:50:10.653 INFO:teuthology.orchestra.run.smithi008.stdout: netavark x86_64 2:1.7.0-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-12-17T11:50:10.654 INFO:teuthology.orchestra.run.smithi008.stdout: python3-podman noarch 4.6.0-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 153 k 2023-12-17T11:50:10.654 INFO:teuthology.orchestra.run.smithi008.stdout: skopeo x86_64 2:1.13.3-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 8.1 M 2023-12-17T11:50:10.654 INFO:teuthology.orchestra.run.smithi008.stdout: toolbox x86_64 0.0.99.4-5.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 2.5 M 2023-12-17T11:50:10.654 INFO:teuthology.orchestra.run.smithi008.stdout: udica noarch 0.2.6-20.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 49 k 2023-12-17T11:50:10.654 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-12-17T11:50:10.654 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-12-17T11:50:10.654 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-12-17T11:50:10.654 INFO:teuthology.orchestra.run.smithi008.stdout: yajl x86_64 2.1.0-12.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-12-17T11:50:10.654 INFO:teuthology.orchestra.run.smithi008.stdout:Installing weak dependencies: 2023-12-17T11:50:10.654 INFO:teuthology.orchestra.run.smithi008.stdout: criu-libs x86_64 3.18-4.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 39 k 2023-12-17T11:50:10.654 INFO:teuthology.orchestra.run.smithi008.stdout:Installing module profiles: 2023-12-17T11:50:10.654 INFO:teuthology.orchestra.run.smithi008.stdout: container-tools/common 2023-12-17T11:50:10.654 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T11:50:10.654 INFO:teuthology.orchestra.run.smithi008.stdout:Enabling module streams: 2023-12-17T11:50:10.654 INFO:teuthology.orchestra.run.smithi008.stdout: container-tools rhel8 2023-12-17T11:50:10.655 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T11:50:10.655 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-12-17T11:50:10.655 INFO:teuthology.orchestra.run.smithi008.stdout:========================================================================================================== 2023-12-17T11:50:10.655 INFO:teuthology.orchestra.run.smithi008.stdout:Install 13 Packages 2023-12-17T11:50:10.655 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T11:50:10.655 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 26 M 2023-12-17T11:50:10.656 INFO:teuthology.orchestra.run.smithi008.stdout:Installed size: 87 M 2023-12-17T11:50:10.656 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-12-17T11:50:10.745 INFO:teuthology.orchestra.run.smithi100.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 41 kB/s | 4.1 kB 00:00 2023-12-17T11:50:10.828 INFO:teuthology.orchestra.run.smithi008.stdout:(1/13): python3-pyxdg-0.25-16.el8.noarch.rpm 548 kB/s | 94 kB 00:00 2023-12-17T11:50:10.853 INFO:teuthology.orchestra.run.smithi008.stdout:(2/13): python3-pytoml-0.1.14-5.git7dea353.el8. 126 kB/s | 25 kB 00:00 2023-12-17T11:50:10.879 INFO:teuthology.orchestra.run.smithi008.stdout:(3/13): yajl-2.1.0-12.el8.x86_64.rpm 185 kB/s | 41 kB 00:00 2023-12-17T11:50:11.012 INFO:teuthology.orchestra.run.smithi008.stdout:(4/13): aardvark-dns-1.7.0-1.module+el8.9.0+203 5.5 MB/s | 1.0 MB 00:00 2023-12-17T11:50:11.054 INFO:teuthology.orchestra.run.smithi008.stdout:(5/13): cockpit-podman-75-1.module+el8.9.0+2032 4.1 MB/s | 739 kB 00:00 2023-12-17T11:50:11.146 INFO:teuthology.orchestra.run.smithi100.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 33 kB/s | 4.5 kB 00:00 2023-12-17T11:50:11.154 INFO:teuthology.orchestra.run.smithi008.stdout:(6/13): criu-libs-3.18-4.module+el8.9.0+20326+3 277 kB/s | 39 kB 00:00 2023-12-17T11:50:11.221 INFO:teuthology.orchestra.run.smithi008.stdout:(7/13): crun-1.8.7-1.module+el8.9.0+20326+38708 1.4 MB/s | 239 kB 00:00 2023-12-17T11:50:11.322 INFO:teuthology.orchestra.run.smithi008.stdout:(8/13): buildah-1.31.3-1.module+el8.9.0+20326+3 19 MB/s | 8.8 MB 00:00 2023-12-17T11:50:11.363 INFO:teuthology.orchestra.run.smithi008.stdout:(9/13): python3-podman-4.6.0-1.module+el8.9.0+2 1.1 MB/s | 153 kB 00:00 2023-12-17T11:50:11.455 INFO:teuthology.orchestra.run.smithi008.stdout:(10/13): netavark-1.7.0-1.module+el8.9.0+20326+ 12 MB/s | 3.7 MB 00:00 2023-12-17T11:50:11.514 INFO:teuthology.orchestra.run.smithi008.stdout:(11/13): udica-0.2.6-20.module+el8.9.0+20326+38 847 kB/s | 49 kB 00:00 2023-12-17T11:50:11.623 INFO:teuthology.orchestra.run.smithi008.stdout:(12/13): toolbox-0.0.99.4-5.module+el8.9.0+2032 9.8 MB/s | 2.5 MB 00:00 2023-12-17T11:50:11.675 INFO:teuthology.orchestra.run.smithi186.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 29 kB/s | 4.5 kB 00:00 2023-12-17T11:50:11.761 INFO:teuthology.orchestra.run.smithi008.stdout:(13/13): skopeo-1.13.3-1.module+el8.9.0+20326+3 19 MB/s | 8.1 MB 00:00 2023-12-17T11:50:11.762 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:50:11.762 INFO:teuthology.orchestra.run.smithi008.stdout:Total 23 MB/s | 26 MB 00:01 2023-12-17T11:50:12.236 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-12-17T11:50:12.263 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-12-17T11:50:12.263 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-12-17T11:50:12.281 INFO:teuthology.orchestra.run.smithi186.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 54 kB/s | 4.1 kB 00:00 2023-12-17T11:50:12.858 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-12-17T11:50:12.868 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-12-17T11:50:13.555 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-12-17T11:50:13.801 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 1/13 2023-12-17T11:50:14.063 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2023-12-17T11:50:14.222 INFO:teuthology.orchestra.run.smithi100.stdout:========================================================================================================== 2023-12-17T11:50:14.222 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2023-12-17T11:50:14.222 INFO:teuthology.orchestra.run.smithi100.stdout:========================================================================================================== 2023-12-17T11:50:14.222 INFO:teuthology.orchestra.run.smithi100.stdout:Installing group/module packages: 2023-12-17T11:50:14.222 INFO:teuthology.orchestra.run.smithi100.stdout: aardvark-dns x86_64 2:1.7.0-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 1.0 M 2023-12-17T11:50:14.222 INFO:teuthology.orchestra.run.smithi100.stdout: buildah x86_64 1:1.31.3-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 8.8 M 2023-12-17T11:50:14.222 INFO:teuthology.orchestra.run.smithi100.stdout: cockpit-podman noarch 75-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 739 k 2023-12-17T11:50:14.222 INFO:teuthology.orchestra.run.smithi100.stdout: crun x86_64 1.8.7-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 239 k 2023-12-17T11:50:14.222 INFO:teuthology.orchestra.run.smithi100.stdout: netavark x86_64 2:1.7.0-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-12-17T11:50:14.222 INFO:teuthology.orchestra.run.smithi100.stdout: python3-podman noarch 4.6.0-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 153 k 2023-12-17T11:50:14.222 INFO:teuthology.orchestra.run.smithi100.stdout: skopeo x86_64 2:1.13.3-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 8.1 M 2023-12-17T11:50:14.222 INFO:teuthology.orchestra.run.smithi100.stdout: toolbox x86_64 0.0.99.4-5.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 2.5 M 2023-12-17T11:50:14.223 INFO:teuthology.orchestra.run.smithi100.stdout: udica noarch 0.2.6-20.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 49 k 2023-12-17T11:50:14.223 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2023-12-17T11:50:14.223 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-12-17T11:50:14.223 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-12-17T11:50:14.223 INFO:teuthology.orchestra.run.smithi100.stdout: yajl x86_64 2.1.0-12.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-12-17T11:50:14.223 INFO:teuthology.orchestra.run.smithi100.stdout:Installing weak dependencies: 2023-12-17T11:50:14.223 INFO:teuthology.orchestra.run.smithi100.stdout: criu-libs x86_64 3.18-4.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 39 k 2023-12-17T11:50:14.223 INFO:teuthology.orchestra.run.smithi100.stdout:Installing module profiles: 2023-12-17T11:50:14.223 INFO:teuthology.orchestra.run.smithi100.stdout: container-tools/common 2023-12-17T11:50:14.223 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-17T11:50:14.223 INFO:teuthology.orchestra.run.smithi100.stdout:Enabling module streams: 2023-12-17T11:50:14.223 INFO:teuthology.orchestra.run.smithi100.stdout: container-tools rhel8 2023-12-17T11:50:14.223 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-17T11:50:14.223 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2023-12-17T11:50:14.223 INFO:teuthology.orchestra.run.smithi100.stdout:========================================================================================================== 2023-12-17T11:50:14.223 INFO:teuthology.orchestra.run.smithi100.stdout:Install 13 Packages 2023-12-17T11:50:14.224 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-17T11:50:14.224 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 26 M 2023-12-17T11:50:14.224 INFO:teuthology.orchestra.run.smithi100.stdout:Installed size: 87 M 2023-12-17T11:50:14.224 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2023-12-17T11:50:14.382 INFO:teuthology.orchestra.run.smithi100.stdout:(1/13): python3-pytoml-0.1.14-5.git7dea353.el8. 158 kB/s | 25 kB 00:00 2023-12-17T11:50:14.405 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : aardvark-dns-2:1.7.0-1.module+el8.9.0+20326+387084 2/13 2023-12-17T11:50:14.407 INFO:teuthology.orchestra.run.smithi100.stdout:(2/13): yajl-2.1.0-12.el8.x86_64.rpm 225 kB/s | 41 kB 00:00 2023-12-17T11:50:14.433 INFO:teuthology.orchestra.run.smithi100.stdout:(3/13): python3-pyxdg-0.25-16.el8.noarch.rpm 453 kB/s | 94 kB 00:00 2023-12-17T11:50:14.575 INFO:teuthology.orchestra.run.smithi100.stdout:(4/13): aardvark-dns-1.7.0-1.module+el8.9.0+203 5.2 MB/s | 1.0 MB 00:00 2023-12-17T11:50:14.625 INFO:teuthology.orchestra.run.smithi100.stdout:(5/13): cockpit-podman-75-1.module+el8.9.0+2032 3.8 MB/s | 739 kB 00:00 2023-12-17T11:50:14.654 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : netavark-2:1.7.0-1.module+el8.9.0+20326+387084d0.x 3/13 2023-12-17T11:50:14.683 INFO:teuthology.orchestra.run.smithi100.stdout:(6/13): criu-libs-3.18-4.module+el8.9.0+20326+3 363 kB/s | 39 kB 00:00 2023-12-17T11:50:14.792 INFO:teuthology.orchestra.run.smithi100.stdout:(7/13): crun-1.8.7-1.module+el8.9.0+20326+38708 1.4 MB/s | 239 kB 00:00 2023-12-17T11:50:14.901 INFO:teuthology.orchestra.run.smithi100.stdout:(8/13): buildah-1.31.3-1.module+el8.9.0+20326+3 18 MB/s | 8.8 MB 00:00 2023-12-17T11:50:14.926 INFO:teuthology.orchestra.run.smithi100.stdout:(9/13): python3-podman-4.6.0-1.module+el8.9.0+2 1.1 MB/s | 153 kB 00:00 2023-12-17T11:50:14.948 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : yajl-2.1.0-12.el8.x86_64 4/13 2023-12-17T11:50:15.026 INFO:teuthology.orchestra.run.smithi100.stdout:(10/13): netavark-1.7.0-1.module+el8.9.0+20326+ 11 MB/s | 3.7 MB 00:00 2023-12-17T11:50:15.131 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 5/13 2023-12-17T11:50:15.135 INFO:teuthology.orchestra.run.smithi100.stdout:(11/13): toolbox-0.0.99.4-5.module+el8.9.0+2032 12 MB/s | 2.5 MB 00:00 2023-12-17T11:50:15.160 INFO:teuthology.orchestra.run.smithi100.stdout:(12/13): udica-0.2.6-20.module+el8.9.0+20326+38 371 kB/s | 49 kB 00:00 2023-12-17T11:50:15.172 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2023-12-17T11:50:15.310 INFO:teuthology.orchestra.run.smithi100.stdout:(13/13): skopeo-1.13.3-1.module+el8.9.0+20326+3 20 MB/s | 8.1 MB 00:00 2023-12-17T11:50:15.311 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:50:15.311 INFO:teuthology.orchestra.run.smithi100.stdout:Total 24 MB/s | 26 MB 00:01 2023-12-17T11:50:15.330 INFO:teuthology.orchestra.run.smithi186.stdout:========================================================================================================== 2023-12-17T11:50:15.330 INFO:teuthology.orchestra.run.smithi186.stdout: Package Arch Version Repository Size 2023-12-17T11:50:15.330 INFO:teuthology.orchestra.run.smithi186.stdout:========================================================================================================== 2023-12-17T11:50:15.331 INFO:teuthology.orchestra.run.smithi186.stdout:Installing group/module packages: 2023-12-17T11:50:15.331 INFO:teuthology.orchestra.run.smithi186.stdout: aardvark-dns x86_64 2:1.7.0-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 1.0 M 2023-12-17T11:50:15.331 INFO:teuthology.orchestra.run.smithi186.stdout: buildah x86_64 1:1.31.3-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 8.8 M 2023-12-17T11:50:15.331 INFO:teuthology.orchestra.run.smithi186.stdout: cockpit-podman noarch 75-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 739 k 2023-12-17T11:50:15.331 INFO:teuthology.orchestra.run.smithi186.stdout: crun x86_64 1.8.7-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 239 k 2023-12-17T11:50:15.331 INFO:teuthology.orchestra.run.smithi186.stdout: netavark x86_64 2:1.7.0-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-12-17T11:50:15.331 INFO:teuthology.orchestra.run.smithi186.stdout: python3-podman noarch 4.6.0-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 153 k 2023-12-17T11:50:15.331 INFO:teuthology.orchestra.run.smithi186.stdout: skopeo x86_64 2:1.13.3-1.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 8.1 M 2023-12-17T11:50:15.331 INFO:teuthology.orchestra.run.smithi186.stdout: toolbox x86_64 0.0.99.4-5.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 2.5 M 2023-12-17T11:50:15.331 INFO:teuthology.orchestra.run.smithi186.stdout: udica noarch 0.2.6-20.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 49 k 2023-12-17T11:50:15.331 INFO:teuthology.orchestra.run.smithi186.stdout:Installing dependencies: 2023-12-17T11:50:15.331 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-12-17T11:50:15.332 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-12-17T11:50:15.332 INFO:teuthology.orchestra.run.smithi186.stdout: yajl x86_64 2.1.0-12.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-12-17T11:50:15.332 INFO:teuthology.orchestra.run.smithi186.stdout:Installing weak dependencies: 2023-12-17T11:50:15.332 INFO:teuthology.orchestra.run.smithi186.stdout: criu-libs x86_64 3.18-4.module+el8.9.0+20326+387084d0 rhel-8-for-x86_64-appstream-rpms 39 k 2023-12-17T11:50:15.332 INFO:teuthology.orchestra.run.smithi186.stdout:Installing module profiles: 2023-12-17T11:50:15.332 INFO:teuthology.orchestra.run.smithi186.stdout: container-tools/common 2023-12-17T11:50:15.332 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-12-17T11:50:15.332 INFO:teuthology.orchestra.run.smithi186.stdout:Enabling module streams: 2023-12-17T11:50:15.332 INFO:teuthology.orchestra.run.smithi186.stdout: container-tools rhel8 2023-12-17T11:50:15.332 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-12-17T11:50:15.332 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction Summary 2023-12-17T11:50:15.332 INFO:teuthology.orchestra.run.smithi186.stdout:========================================================================================================== 2023-12-17T11:50:15.332 INFO:teuthology.orchestra.run.smithi186.stdout:Install 13 Packages 2023-12-17T11:50:15.332 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-12-17T11:50:15.333 INFO:teuthology.orchestra.run.smithi186.stdout:Total download size: 26 M 2023-12-17T11:50:15.333 INFO:teuthology.orchestra.run.smithi186.stdout:Installed size: 87 M 2023-12-17T11:50:15.333 INFO:teuthology.orchestra.run.smithi186.stdout:Downloading Packages: 2023-12-17T11:50:15.415 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 6/13 2023-12-17T11:50:15.520 INFO:teuthology.orchestra.run.smithi186.stdout:(1/13): python3-pyxdg-0.25-16.el8.noarch.rpm 504 kB/s | 94 kB 00:00 2023-12-17T11:50:15.545 INFO:teuthology.orchestra.run.smithi186.stdout:(2/13): python3-pytoml-0.1.14-5.git7dea353.el8. 117 kB/s | 25 kB 00:00 2023-12-17T11:50:15.571 INFO:teuthology.orchestra.run.smithi186.stdout:(3/13): yajl-2.1.0-12.el8.x86_64.rpm 173 kB/s | 41 kB 00:00 2023-12-17T11:50:15.668 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-podman-4.6.0-1.module+el8.9.0+20326+387084 7/13 2023-12-17T11:50:15.738 INFO:teuthology.orchestra.run.smithi186.stdout:(4/13): cockpit-podman-75-1.module+el8.9.0+2032 4.3 MB/s | 739 kB 00:00 2023-12-17T11:50:15.771 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2023-12-17T11:50:15.771 INFO:teuthology.orchestra.run.smithi186.stdout:(5/13): aardvark-dns-1.7.0-1.module+el8.9.0+203 4.0 MB/s | 1.0 MB 00:00 2023-12-17T11:50:15.797 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2023-12-17T11:50:15.797 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2023-12-17T11:50:15.955 INFO:teuthology.orchestra.run.smithi186.stdout:(6/13): buildah-1.31.3-1.module+el8.9.0+20326+3 23 MB/s | 8.8 MB 00:00 2023-12-17T11:50:15.971 INFO:teuthology.orchestra.run.smithi186.stdout:(7/13): criu-libs-3.18-4.module+el8.9.0+20326+3 168 kB/s | 39 kB 00:00 2023-12-17T11:50:16.080 INFO:teuthology.orchestra.run.smithi186.stdout:(8/13): python3-podman-4.6.0-1.module+el8.9.0+2 1.4 MB/s | 153 kB 00:00 2023-12-17T11:50:16.148 INFO:teuthology.orchestra.run.smithi186.stdout:(9/13): crun-1.8.7-1.module+el8.9.0+20326+38708 636 kB/s | 239 kB 00:00 2023-12-17T11:50:16.223 INFO:teuthology.orchestra.run.smithi186.stdout:(10/13): netavark-1.7.0-1.module+el8.9.0+20326+ 14 MB/s | 3.7 MB 00:00 2023-12-17T11:50:16.307 INFO:teuthology.orchestra.run.smithi186.stdout:(11/13): udica-0.2.6-20.module+el8.9.0+20326+38 593 kB/s | 49 kB 00:00 2023-12-17T11:50:16.357 INFO:teuthology.orchestra.run.smithi186.stdout:(12/13): toolbox-0.0.99.4-5.module+el8.9.0+2032 12 MB/s | 2.5 MB 00:00 2023-12-17T11:50:16.406 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2023-12-17T11:50:16.415 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2023-12-17T11:50:16.499 INFO:teuthology.orchestra.run.smithi186.stdout:(13/13): skopeo-1.13.3-1.module+el8.9.0+20326+3 19 MB/s | 8.1 MB 00:00 2023-12-17T11:50:16.500 INFO:teuthology.orchestra.run.smithi186.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:50:16.500 INFO:teuthology.orchestra.run.smithi186.stdout:Total 22 MB/s | 26 MB 00:01 2023-12-17T11:50:16.718 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : crun-1.8.7-1.module+el8.9.0+20326+387084d0.x86_64 8/13 2023-12-17T11:50:16.965 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction check 2023-12-17T11:50:16.991 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction check succeeded. 2023-12-17T11:50:16.991 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction test 2023-12-17T11:50:17.002 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : buildah-1:1.31.3-1.module+el8.9.0+20326+387084d0.x 9/13 2023-12-17T11:50:17.068 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2023-12-17T11:50:17.304 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 1/13 2023-12-17T11:50:17.425 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : udica-0.2.6-20.module+el8.9.0+20326+387084d0.noarc 10/13 2023-12-17T11:50:17.608 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction test succeeded. 2023-12-17T11:50:17.618 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction 2023-12-17T11:50:17.847 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : aardvark-dns-2:1.7.0-1.module+el8.9.0+20326+387084 2/13 2023-12-17T11:50:18.019 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : netavark-2:1.7.0-1.module+el8.9.0+20326+387084d0.x 3/13 2023-12-17T11:50:18.254 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : yajl-2.1.0-12.el8.x86_64 4/13 2023-12-17T11:50:18.309 INFO:teuthology.orchestra.run.smithi186.stdout: Preparing : 1/1 2023-12-17T11:50:18.447 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 5/13 2023-12-17T11:50:18.448 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : toolbox-0.0.99.4-5.module+el8.9.0+20326+387084d0.x 11/13 2023-12-17T11:50:18.588 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 1/13 2023-12-17T11:50:18.708 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 6/13 2023-12-17T11:50:18.736 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : skopeo-2:1.13.3-1.module+el8.9.0+20326+387084d0.x8 12/13 2023-12-17T11:50:18.912 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cockpit-podman-75-1.module+el8.9.0+20326+387084d0. 13/13 2023-12-17T11:50:18.971 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-podman-4.6.0-1.module+el8.9.0+20326+387084 7/13 2023-12-17T11:50:19.208 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : aardvark-dns-2:1.7.0-1.module+el8.9.0+20326+387084 2/13 2023-12-17T11:50:19.486 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : netavark-2:1.7.0-1.module+el8.9.0+20326+387084d0.x 3/13 2023-12-17T11:50:19.685 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: cockpit-podman-75-1.module+el8.9.0+20326+387084d0. 13/13 2023-12-17T11:50:19.685 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/13 2023-12-17T11:50:19.685 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 2/13 2023-12-17T11:50:19.685 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 3/13 2023-12-17T11:50:19.686 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : aardvark-dns-2:1.7.0-1.module+el8.9.0+20326+387084 4/13 2023-12-17T11:50:19.686 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : buildah-1:1.31.3-1.module+el8.9.0+20326+387084d0.x 5/13 2023-12-17T11:50:19.686 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cockpit-podman-75-1.module+el8.9.0+20326+387084d0. 6/13 2023-12-17T11:50:19.686 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 7/13 2023-12-17T11:50:19.686 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : crun-1.8.7-1.module+el8.9.0+20326+387084d0.x86_64 8/13 2023-12-17T11:50:19.686 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : netavark-2:1.7.0-1.module+el8.9.0+20326+387084d0.x 9/13 2023-12-17T11:50:19.686 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-podman-4.6.0-1.module+el8.9.0+20326+387084 10/13 2023-12-17T11:50:19.686 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : skopeo-2:1.13.3-1.module+el8.9.0+20326+387084d0.x8 11/13 2023-12-17T11:50:19.686 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : toolbox-0.0.99.4-5.module+el8.9.0+20326+387084d0.x 12/13 2023-12-17T11:50:19.714 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : yajl-2.1.0-12.el8.x86_64 4/13 2023-12-17T11:50:19.910 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : crun-1.8.7-1.module+el8.9.0+20326+387084d0.x86_64 8/13 2023-12-17T11:50:19.973 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 5/13 2023-12-17T11:50:20.158 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : buildah-1:1.31.3-1.module+el8.9.0+20326+387084d0.x 9/13 2023-12-17T11:50:20.310 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 6/13 2023-12-17T11:50:20.546 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : udica-0.2.6-20.module+el8.9.0+20326+387084d0.noarc 10/13 2023-12-17T11:50:20.622 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-podman-4.6.0-1.module+el8.9.0+20326+387084 7/13 2023-12-17T11:50:21.482 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : toolbox-0.0.99.4-5.module+el8.9.0+20326+387084d0.x 11/13 2023-12-17T11:50:21.608 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : crun-1.8.7-1.module+el8.9.0+20326+387084d0.x86_64 8/13 2023-12-17T11:50:21.734 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : skopeo-2:1.13.3-1.module+el8.9.0+20326+387084d0.x8 12/13 2023-12-17T11:50:21.903 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cockpit-podman-75-1.module+el8.9.0+20326+387084d0. 13/13 2023-12-17T11:50:21.917 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : buildah-1:1.31.3-1.module+el8.9.0+20326+387084d0.x 9/13 2023-12-17T11:50:22.386 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : udica-0.2.6-20.module+el8.9.0+20326+387084d0.noarc 10/13 2023-12-17T11:50:22.593 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cockpit-podman-75-1.module+el8.9.0+20326+387084d0. 13/13 2023-12-17T11:50:22.593 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/13 2023-12-17T11:50:22.593 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 2/13 2023-12-17T11:50:22.593 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 3/13 2023-12-17T11:50:22.593 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : aardvark-dns-2:1.7.0-1.module+el8.9.0+20326+387084 4/13 2023-12-17T11:50:22.593 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : buildah-1:1.31.3-1.module+el8.9.0+20326+387084d0.x 5/13 2023-12-17T11:50:22.593 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cockpit-podman-75-1.module+el8.9.0+20326+387084d0. 6/13 2023-12-17T11:50:22.593 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 7/13 2023-12-17T11:50:22.593 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : crun-1.8.7-1.module+el8.9.0+20326+387084d0.x86_64 8/13 2023-12-17T11:50:22.593 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : netavark-2:1.7.0-1.module+el8.9.0+20326+387084d0.x 9/13 2023-12-17T11:50:22.594 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-podman-4.6.0-1.module+el8.9.0+20326+387084 10/13 2023-12-17T11:50:22.594 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : skopeo-2:1.13.3-1.module+el8.9.0+20326+387084d0.x8 11/13 2023-12-17T11:50:22.594 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : toolbox-0.0.99.4-5.module+el8.9.0+20326+387084d0.x 12/13 2023-12-17T11:50:23.393 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : toolbox-0.0.99.4-5.module+el8.9.0+20326+387084d0.x 11/13 2023-12-17T11:50:23.701 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : skopeo-2:1.13.3-1.module+el8.9.0+20326+387084d0.x8 12/13 2023-12-17T11:50:23.920 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : cockpit-podman-75-1.module+el8.9.0+20326+387084d0. 13/13 2023-12-17T11:50:24.689 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: cockpit-podman-75-1.module+el8.9.0+20326+387084d0. 13/13 2023-12-17T11:50:24.689 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/13 2023-12-17T11:50:24.689 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 2/13 2023-12-17T11:50:24.689 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 3/13 2023-12-17T11:50:24.689 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : aardvark-dns-2:1.7.0-1.module+el8.9.0+20326+387084 4/13 2023-12-17T11:50:24.689 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : buildah-1:1.31.3-1.module+el8.9.0+20326+387084d0.x 5/13 2023-12-17T11:50:24.689 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : cockpit-podman-75-1.module+el8.9.0+20326+387084d0. 6/13 2023-12-17T11:50:24.690 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86 7/13 2023-12-17T11:50:24.690 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : crun-1.8.7-1.module+el8.9.0+20326+387084d0.x86_64 8/13 2023-12-17T11:50:24.690 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : netavark-2:1.7.0-1.module+el8.9.0+20326+387084d0.x 9/13 2023-12-17T11:50:24.690 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-podman-4.6.0-1.module+el8.9.0+20326+387084 10/13 2023-12-17T11:50:24.690 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : skopeo-2:1.13.3-1.module+el8.9.0+20326+387084d0.x8 11/13 2023-12-17T11:50:24.690 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : toolbox-0.0.99.4-5.module+el8.9.0+20326+387084d0.x 12/13 2023-12-17T11:50:32.685 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : udica-0.2.6-20.module+el8.9.0+20326+387084d0.noarc 13/13 2023-12-17T11:50:32.685 INFO:teuthology.orchestra.run.smithi008.stdout:Installed products updated. 2023-12-17T11:50:33.331 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T11:50:33.331 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-12-17T11:50:33.331 INFO:teuthology.orchestra.run.smithi008.stdout: aardvark-dns-2:1.7.0-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-17T11:50:33.331 INFO:teuthology.orchestra.run.smithi008.stdout: buildah-1:1.31.3-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-17T11:50:33.331 INFO:teuthology.orchestra.run.smithi008.stdout: cockpit-podman-75-1.module+el8.9.0+20326+387084d0.noarch 2023-12-17T11:50:33.331 INFO:teuthology.orchestra.run.smithi008.stdout: criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86_64 2023-12-17T11:50:33.331 INFO:teuthology.orchestra.run.smithi008.stdout: crun-1.8.7-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-17T11:50:33.331 INFO:teuthology.orchestra.run.smithi008.stdout: netavark-2:1.7.0-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-17T11:50:33.331 INFO:teuthology.orchestra.run.smithi008.stdout: python3-podman-4.6.0-1.module+el8.9.0+20326+387084d0.noarch 2023-12-17T11:50:33.331 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-17T11:50:33.331 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-17T11:50:33.332 INFO:teuthology.orchestra.run.smithi008.stdout: skopeo-2:1.13.3-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-17T11:50:33.332 INFO:teuthology.orchestra.run.smithi008.stdout: toolbox-0.0.99.4-5.module+el8.9.0+20326+387084d0.x86_64 2023-12-17T11:50:33.332 INFO:teuthology.orchestra.run.smithi008.stdout: udica-0.2.6-20.module+el8.9.0+20326+387084d0.noarch 2023-12-17T11:50:33.332 INFO:teuthology.orchestra.run.smithi008.stdout: yajl-2.1.0-12.el8.x86_64 2023-12-17T11:50:33.332 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T11:50:33.332 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-12-17T11:50:33.611 DEBUG:teuthology.parallel:result is None 2023-12-17T11:50:37.239 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : udica-0.2.6-20.module+el8.9.0+20326+387084d0.noarc 13/13 2023-12-17T11:50:37.239 INFO:teuthology.orchestra.run.smithi100.stdout:Installed products updated. 2023-12-17T11:50:37.704 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : udica-0.2.6-20.module+el8.9.0+20326+387084d0.noarc 13/13 2023-12-17T11:50:37.704 INFO:teuthology.orchestra.run.smithi186.stdout:Installed products updated. 2023-12-17T11:50:37.868 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-17T11:50:37.868 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2023-12-17T11:50:37.868 INFO:teuthology.orchestra.run.smithi100.stdout: aardvark-dns-2:1.7.0-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-17T11:50:37.868 INFO:teuthology.orchestra.run.smithi100.stdout: buildah-1:1.31.3-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-17T11:50:37.868 INFO:teuthology.orchestra.run.smithi100.stdout: cockpit-podman-75-1.module+el8.9.0+20326+387084d0.noarch 2023-12-17T11:50:37.868 INFO:teuthology.orchestra.run.smithi100.stdout: criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86_64 2023-12-17T11:50:37.868 INFO:teuthology.orchestra.run.smithi100.stdout: crun-1.8.7-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-17T11:50:37.868 INFO:teuthology.orchestra.run.smithi100.stdout: netavark-2:1.7.0-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-17T11:50:37.868 INFO:teuthology.orchestra.run.smithi100.stdout: python3-podman-4.6.0-1.module+el8.9.0+20326+387084d0.noarch 2023-12-17T11:50:37.868 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-17T11:50:37.869 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-17T11:50:37.869 INFO:teuthology.orchestra.run.smithi100.stdout: skopeo-2:1.13.3-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-17T11:50:37.869 INFO:teuthology.orchestra.run.smithi100.stdout: toolbox-0.0.99.4-5.module+el8.9.0+20326+387084d0.x86_64 2023-12-17T11:50:37.869 INFO:teuthology.orchestra.run.smithi100.stdout: udica-0.2.6-20.module+el8.9.0+20326+387084d0.noarch 2023-12-17T11:50:37.869 INFO:teuthology.orchestra.run.smithi100.stdout: yajl-2.1.0-12.el8.x86_64 2023-12-17T11:50:37.869 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-17T11:50:37.869 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2023-12-17T11:50:38.112 DEBUG:teuthology.parallel:result is None 2023-12-17T11:50:38.323 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-12-17T11:50:38.323 INFO:teuthology.orchestra.run.smithi186.stdout:Installed: 2023-12-17T11:50:38.323 INFO:teuthology.orchestra.run.smithi186.stdout: aardvark-dns-2:1.7.0-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-17T11:50:38.323 INFO:teuthology.orchestra.run.smithi186.stdout: buildah-1:1.31.3-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-17T11:50:38.323 INFO:teuthology.orchestra.run.smithi186.stdout: cockpit-podman-75-1.module+el8.9.0+20326+387084d0.noarch 2023-12-17T11:50:38.323 INFO:teuthology.orchestra.run.smithi186.stdout: criu-libs-3.18-4.module+el8.9.0+20326+387084d0.x86_64 2023-12-17T11:50:38.323 INFO:teuthology.orchestra.run.smithi186.stdout: crun-1.8.7-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-17T11:50:38.324 INFO:teuthology.orchestra.run.smithi186.stdout: netavark-2:1.7.0-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-17T11:50:38.324 INFO:teuthology.orchestra.run.smithi186.stdout: python3-podman-4.6.0-1.module+el8.9.0+20326+387084d0.noarch 2023-12-17T11:50:38.324 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-12-17T11:50:38.324 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-12-17T11:50:38.324 INFO:teuthology.orchestra.run.smithi186.stdout: skopeo-2:1.13.3-1.module+el8.9.0+20326+387084d0.x86_64 2023-12-17T11:50:38.324 INFO:teuthology.orchestra.run.smithi186.stdout: toolbox-0.0.99.4-5.module+el8.9.0+20326+387084d0.x86_64 2023-12-17T11:50:38.324 INFO:teuthology.orchestra.run.smithi186.stdout: udica-0.2.6-20.module+el8.9.0+20326+387084d0.noarch 2023-12-17T11:50:38.324 INFO:teuthology.orchestra.run.smithi186.stdout: yajl-2.1.0-12.el8.x86_64 2023-12-17T11:50:38.324 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-12-17T11:50:38.324 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2023-12-17T11:50:38.585 DEBUG:teuthology.parallel:result is None 2023-12-17T11:50:38.585 INFO:teuthology.run_tasks:Running task install... 2023-12-17T11:50:38.595 DEBUG:teuthology.task.install:project ceph 2023-12-17T11:50:38.595 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d'}} 2023-12-17T11:50:38.595 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d'} 2023-12-17T11:50:38.595 INFO:teuthology.task.install:Using flavor: default 2023-12-17T11:50:38.601 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-17T11:50:38.601 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-12-17T11:50:38.602 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d', 'tag': None, 'wait_for_package': False} 2023-12-17T11:50:38.602 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-17T11:50:38.604 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d', 'tag': None, 'wait_for_package': False} 2023-12-17T11:50:38.604 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-17T11:50:38.605 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d', 'tag': None, 'wait_for_package': False} 2023-12-17T11:50:38.605 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-17T11:50:38.853 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/flavors/default/ 2023-12-17T11:50:38.854 INFO:teuthology.task.install.rpm:Package version is 19.0.0-119.ga62fda73 2023-12-17T11:50:38.883 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/flavors/default/ 2023-12-17T11:50:38.883 INFO:teuthology.task.install.rpm:Package version is 19.0.0-119.ga62fda73 2023-12-17T11:50:38.887 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/flavors/default/ 2023-12-17T11:50:38.887 INFO:teuthology.task.install.rpm:Package version is 19.0.0-119.ga62fda73 2023-12-17T11:50:39.087 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-17T11:50:39.088 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-12-17T11:50:39.088 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-17T11:50:39.132 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-17T11:50:39.132 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-12-17T11:50:39.132 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-17T11:50:39.157 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-17T11:50:39.158 DEBUG:teuthology.orchestra.run.smithi186:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a62fda73efba5520d409bb5a21bd8373289dda5d/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-17T11:50:39.183 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-17T11:50:39.183 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-12-17T11:50:39.183 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-17T11:50:39.208 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-17T11:50:39.209 DEBUG:teuthology.orchestra.run.smithi008:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a62fda73efba5520d409bb5a21bd8373289dda5d/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-17T11:50:39.257 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-17T11:50:39.257 DEBUG:teuthology.orchestra.run.smithi100:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a62fda73efba5520d409bb5a21bd8373289dda5d/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-17T11:50:39.268 DEBUG:teuthology.orchestra.run.smithi186:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-17T11:50:39.321 DEBUG:teuthology.orchestra.run.smithi008:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-17T11:50:39.363 DEBUG:teuthology.orchestra.run.smithi186:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-17T11:50:39.369 DEBUG:teuthology.orchestra.run.smithi100:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-17T11:50:39.419 DEBUG:teuthology.orchestra.run.smithi008:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-17T11:50:39.430 INFO:teuthology.orchestra.run.smithi186.stdout:check_obsoletes = 1 2023-12-17T11:50:39.434 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum clean all 2023-12-17T11:50:39.464 DEBUG:teuthology.orchestra.run.smithi100:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-17T11:50:39.488 INFO:teuthology.orchestra.run.smithi008.stdout:check_obsoletes = 1 2023-12-17T11:50:39.491 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum clean all 2023-12-17T11:50:39.531 INFO:teuthology.orchestra.run.smithi100.stdout:check_obsoletes = 1 2023-12-17T11:50:39.534 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum clean all 2023-12-17T11:50:39.888 INFO:teuthology.orchestra.run.smithi186.stdout:Updating Subscription Management repositories. 2023-12-17T11:50:39.980 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-12-17T11:50:39.984 INFO:teuthology.orchestra.run.smithi100.stdout:Updating Subscription Management repositories. 2023-12-17T11:50:41.363 INFO:teuthology.orchestra.run.smithi186.stdout:52 files removed 2023-12-17T11:50:41.420 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-17T11:50:41.533 INFO:teuthology.orchestra.run.smithi008.stdout:52 files removed 2023-12-17T11:50:41.592 DEBUG:teuthology.orchestra.run.smithi008:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-17T11:50:41.750 INFO:teuthology.orchestra.run.smithi100.stdout:52 files removed 2023-12-17T11:50:41.808 DEBUG:teuthology.orchestra.run.smithi100:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-17T11:50:41.876 INFO:teuthology.orchestra.run.smithi186.stdout:Updating Subscription Management repositories. 2023-12-17T11:50:42.076 INFO:teuthology.orchestra.run.smithi008.stdout:Updating Subscription Management repositories. 2023-12-17T11:50:42.260 INFO:teuthology.orchestra.run.smithi100.stdout:Updating Subscription Management repositories. 2023-12-17T11:50:43.870 INFO:teuthology.orchestra.run.smithi186.stdout:ceph packages for x86_64 204 kB/s | 81 kB 00:00 2023-12-17T11:50:44.121 INFO:teuthology.orchestra.run.smithi008.stdout:ceph packages for x86_64 121 kB/s | 81 kB 00:00 2023-12-17T11:50:44.365 INFO:teuthology.orchestra.run.smithi100.stdout:ceph packages for x86_64 144 kB/s | 81 kB 00:00 2023-12-17T11:50:44.466 INFO:teuthology.orchestra.run.smithi186.stdout:ceph noarch packages 17 kB/s | 9.5 kB 00:00 2023-12-17T11:50:44.788 INFO:teuthology.orchestra.run.smithi008.stdout:ceph noarch packages 15 kB/s | 9.5 kB 00:00 2023-12-17T11:50:44.899 INFO:teuthology.orchestra.run.smithi100.stdout:ceph noarch packages 19 kB/s | 9.5 kB 00:00 2023-12-17T11:50:44.983 INFO:teuthology.orchestra.run.smithi186.stdout:ceph source packages 3.0 kB/s | 1.5 kB 00:00 2023-12-17T11:50:45.134 INFO:teuthology.orchestra.run.smithi186.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2023-12-17T11:50:45.347 INFO:teuthology.orchestra.run.smithi008.stdout:ceph source packages 2.8 kB/s | 1.5 kB 00:00 2023-12-17T11:50:45.467 INFO:teuthology.orchestra.run.smithi100.stdout:ceph source packages 2.7 kB/s | 1.5 kB 00:00 2023-12-17T11:50:45.523 INFO:teuthology.orchestra.run.smithi008.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2023-12-17T11:50:45.692 INFO:teuthology.orchestra.run.smithi100.stdout:Copr repo for python3-asyncssh owned by ceph 17 kB/s | 3.5 kB 00:00 2023-12-17T11:50:45.869 INFO:teuthology.orchestra.run.smithi186.stdout:Extra Packages for Enterprise Linux 23 MB/s | 16 MB 00:00 2023-12-17T11:50:47.442 INFO:teuthology.orchestra.run.smithi008.stdout:Extra Packages for Enterprise Linux 8.5 MB/s | 16 MB 00:01 2023-12-17T11:50:50.013 INFO:teuthology.orchestra.run.smithi186.stdout:lab-extras 367 kB/s | 24 kB 00:00 2023-12-17T11:50:50.385 INFO:teuthology.orchestra.run.smithi100.stdout:Extra Packages for Enterprise Linux 3.4 MB/s | 16 MB 00:04 2023-12-17T11:50:50.712 INFO:teuthology.orchestra.run.smithi186.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 14 MB/s | 8.8 MB 00:00 2023-12-17T11:50:51.901 INFO:teuthology.orchestra.run.smithi008.stdout:lab-extras 388 kB/s | 24 kB 00:00 2023-12-17T11:50:53.479 INFO:teuthology.orchestra.run.smithi008.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 43 MB/s | 64 MB 00:01 2023-12-17T11:50:54.273 INFO:teuthology.orchestra.run.smithi186.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 30 MB/s | 58 MB 00:01 2023-12-17T11:50:54.552 INFO:teuthology.orchestra.run.smithi100.stdout:lab-extras 366 kB/s | 24 kB 00:00 2023-12-17T11:50:55.312 INFO:teuthology.orchestra.run.smithi100.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 13 MB/s | 8.8 MB 00:00 2023-12-17T11:50:58.380 INFO:teuthology.orchestra.run.smithi100.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 44 MB/s | 64 MB 00:01 2023-12-17T11:51:04.324 INFO:teuthology.orchestra.run.smithi008.stdout:Red Hat CodeReady Linux Builder for RHEL 8 x86_ 13 MB/s | 8.8 MB 00:00 2023-12-17T11:51:06.665 INFO:teuthology.orchestra.run.smithi186.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 42 MB/s | 64 MB 00:01 2023-12-17T11:51:07.714 INFO:teuthology.orchestra.run.smithi008.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 40 MB/s | 58 MB 00:01 2023-12-17T11:51:09.398 INFO:teuthology.orchestra.run.smithi100.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 39 MB/s | 58 MB 00:01 2023-12-17T11:51:21.761 INFO:teuthology.orchestra.run.smithi186.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-12-17T11:51:21.762 INFO:teuthology.orchestra.run.smithi186.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-12-17T11:51:21.781 INFO:teuthology.orchestra.run.smithi186.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-12-17T11:51:21.783 INFO:teuthology.orchestra.run.smithi186.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-12-17T11:51:21.784 INFO:teuthology.orchestra.run.smithi186.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-12-17T11:51:21.786 INFO:teuthology.orchestra.run.smithi186.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-12-17T11:51:21.789 INFO:teuthology.orchestra.run.smithi186.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-12-17T11:51:21.793 INFO:teuthology.orchestra.run.smithi186.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-12-17T11:51:21.795 INFO:teuthology.orchestra.run.smithi186.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-12-17T11:51:22.021 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2023-12-17T11:51:22.035 INFO:teuthology.orchestra.run.smithi186.stdout:=========================================================================================================================== 2023-12-17T11:51:22.036 INFO:teuthology.orchestra.run.smithi186.stdout: Package Arch Version Repository Size 2023-12-17T11:51:22.036 INFO:teuthology.orchestra.run.smithi186.stdout:=========================================================================================================================== 2023-12-17T11:51:22.036 INFO:teuthology.orchestra.run.smithi186.stdout:Installing: 2023-12-17T11:51:22.036 INFO:teuthology.orchestra.run.smithi186.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 rhel-8-for-x86_64-baseos-rpms 143 k 2023-12-17T11:51:22.036 INFO:teuthology.orchestra.run.smithi186.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-12-17T11:51:22.036 INFO:teuthology.orchestra.run.smithi186.stdout: ceph x86_64 2:19.0.0-119.ga62fda73.el8 ceph 6.4 k 2023-12-17T11:51:22.036 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-base x86_64 2:19.0.0-119.ga62fda73.el8 ceph 5.4 M 2023-12-17T11:51:22.036 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-fuse x86_64 2:19.0.0-119.ga62fda73.el8 ceph 919 k 2023-12-17T11:51:22.036 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-119.ga62fda73.el8 ceph 171 k 2023-12-17T11:51:22.036 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr x86_64 2:19.0.0-119.ga62fda73.el8 ceph 1.6 M 2023-12-17T11:51:22.036 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-cephadm noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 133 k 2023-12-17T11:51:22.036 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-dashboard noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 1.8 M 2023-12-17T11:51:22.036 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 7.4 M 2023-12-17T11:51:22.036 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-rook noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 50 k 2023-12-17T11:51:22.037 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-radosgw x86_64 2:19.0.0-119.ga62fda73.el8 ceph 14 M 2023-12-17T11:51:22.037 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-test x86_64 2:19.0.0-119.ga62fda73.el8 ceph 49 M 2023-12-17T11:51:22.037 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-volume noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 262 k 2023-12-17T11:51:22.037 INFO:teuthology.orchestra.run.smithi186.stdout: cephadm noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 415 k 2023-12-17T11:51:22.037 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-mirror x86_64 2:19.0.0-119.ga62fda73.el8 ceph 262 k 2023-12-17T11:51:22.037 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-top noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 18 k 2023-12-17T11:51:22.037 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2023-12-17T11:51:22.037 INFO:teuthology.orchestra.run.smithi186.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-12-17T11:51:22.037 INFO:teuthology.orchestra.run.smithi186.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-12-17T11:51:22.037 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs-devel x86_64 2:19.0.0-119.ga62fda73.el8 ceph 31 k 2023-12-17T11:51:22.037 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs2 x86_64 2:19.0.0-119.ga62fda73.el8 ceph 838 k 2023-12-17T11:51:22.037 INFO:teuthology.orchestra.run.smithi186.stdout: librados-devel x86_64 2:19.0.0-119.ga62fda73.el8 ceph 139 k 2023-12-17T11:51:22.037 INFO:teuthology.orchestra.run.smithi186.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-12-17T11:51:22.037 INFO:teuthology.orchestra.run.smithi186.stdout: libuuid-devel x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 100 k 2023-12-17T11:51:22.038 INFO:teuthology.orchestra.run.smithi186.stdout: openssl-devel x86_64 1:1.1.1k-9.el8_7 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-12-17T11:51:22.038 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql x86_64 10.23-3.module+el8.9.0+20831+78489779 rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-12-17T11:51:22.038 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-contrib x86_64 10.23-3.module+el8.9.0+20831+78489779 rhel-8-for-x86_64-appstream-rpms 811 k 2023-12-17T11:51:22.038 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-server x86_64 10.23-3.module+el8.9.0+20831+78489779 rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-12-17T11:51:22.038 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cephfs x86_64 2:19.0.0-119.ga62fda73.el8 ceph 197 k 2023-12-17T11:51:22.038 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rados x86_64 2:19.0.0-119.ga62fda73.el8 ceph 371 k 2023-12-17T11:51:22.038 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rbd x86_64 2:19.0.0-119.ga62fda73.el8 ceph 364 k 2023-12-17T11:51:22.038 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rgw x86_64 2:19.0.0-119.ga62fda73.el8 ceph 107 k 2023-12-17T11:51:22.038 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-fuse x86_64 2:19.0.0-119.ga62fda73.el8 ceph 93 k 2023-12-17T11:51:22.038 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-mirror x86_64 2:19.0.0-119.ga62fda73.el8 ceph 3.6 M 2023-12-17T11:51:22.038 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-nbd x86_64 2:19.0.0-119.ga62fda73.el8 ceph 181 k 2023-12-17T11:51:22.038 INFO:teuthology.orchestra.run.smithi186.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2023-12-17T11:51:22.038 INFO:teuthology.orchestra.run.smithi186.stdout:Upgrading: 2023-12-17T11:51:22.038 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2023-12-17T11:51:22.039 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2023-12-17T11:51:22.039 INFO:teuthology.orchestra.run.smithi186.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2023-12-17T11:51:22.039 INFO:teuthology.orchestra.run.smithi186.stdout: libblkid x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-12-17T11:51:22.039 INFO:teuthology.orchestra.run.smithi186.stdout: libfdisk x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 254 k 2023-12-17T11:51:22.039 INFO:teuthology.orchestra.run.smithi186.stdout: libmount x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 237 k 2023-12-17T11:51:22.039 INFO:teuthology.orchestra.run.smithi186.stdout: librados2 x86_64 2:19.0.0-119.ga62fda73.el8 ceph 3.8 M 2023-12-17T11:51:22.039 INFO:teuthology.orchestra.run.smithi186.stdout: librbd1 x86_64 2:19.0.0-119.ga62fda73.el8 ceph 3.7 M 2023-12-17T11:51:22.039 INFO:teuthology.orchestra.run.smithi186.stdout: libsmartcols x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 179 k 2023-12-17T11:51:22.039 INFO:teuthology.orchestra.run.smithi186.stdout: libuuid x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 99 k 2023-12-17T11:51:22.039 INFO:teuthology.orchestra.run.smithi186.stdout: openssl x86_64 1:1.1.1k-9.el8_7 rhel-8-for-x86_64-baseos-rpms 710 k 2023-12-17T11:51:22.039 INFO:teuthology.orchestra.run.smithi186.stdout: openssl-libs x86_64 1:1.1.1k-9.el8_7 rhel-8-for-x86_64-baseos-rpms 1.5 M 2023-12-17T11:51:22.039 INFO:teuthology.orchestra.run.smithi186.stdout: util-linux x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 2.5 M 2023-12-17T11:51:22.039 INFO:teuthology.orchestra.run.smithi186.stdout: util-linux-user x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 103 k 2023-12-17T11:51:22.039 INFO:teuthology.orchestra.run.smithi186.stdout: xfsdump x86_64 3.1.8-6.el8 rhel-8-for-x86_64-baseos-rpms 333 k 2023-12-17T11:51:22.039 INFO:teuthology.orchestra.run.smithi186.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2023-12-17T11:51:22.039 INFO:teuthology.orchestra.run.smithi186.stdout:Installing dependencies: 2023-12-17T11:51:22.040 INFO:teuthology.orchestra.run.smithi186.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2023-12-17T11:51:22.040 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-common x86_64 2:19.0.0-119.ga62fda73.el8 ceph 23 M 2023-12-17T11:51:22.040 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-grafana-dashboards noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 28 k 2023-12-17T11:51:22.040 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mds x86_64 2:19.0.0-119.ga62fda73.el8 ceph 2.3 M 2023-12-17T11:51:22.040 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-modules-core noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 243 k 2023-12-17T11:51:22.040 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mon x86_64 2:19.0.0-119.ga62fda73.el8 ceph 4.6 M 2023-12-17T11:51:22.040 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-osd x86_64 2:19.0.0-119.ga62fda73.el8 ceph 18 M 2023-12-17T11:51:22.040 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-prometheus-alerts noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 15 k 2023-12-17T11:51:22.040 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-selinux x86_64 2:19.0.0-119.ga62fda73.el8 ceph 24 k 2023-12-17T11:51:22.040 INFO:teuthology.orchestra.run.smithi186.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-12-17T11:51:22.040 INFO:teuthology.orchestra.run.smithi186.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-17T11:51:22.040 INFO:teuthology.orchestra.run.smithi186.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-12-17T11:51:22.040 INFO:teuthology.orchestra.run.smithi186.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-12-17T11:51:22.040 INFO:teuthology.orchestra.run.smithi186.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2023-12-17T11:51:22.040 INFO:teuthology.orchestra.run.smithi186.stdout: libcephsqlite x86_64 2:19.0.0-119.ga62fda73.el8 ceph 183 k 2023-12-17T11:51:22.041 INFO:teuthology.orchestra.run.smithi186.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-12-17T11:51:22.041 INFO:teuthology.orchestra.run.smithi186.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2023-12-17T11:51:22.041 INFO:teuthology.orchestra.run.smithi186.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-17T11:51:22.041 INFO:teuthology.orchestra.run.smithi186.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-12-17T11:51:22.041 INFO:teuthology.orchestra.run.smithi186.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2023-12-17T11:51:22.041 INFO:teuthology.orchestra.run.smithi186.stdout: librabbitmq x86_64 0.9.0-4.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-12-17T11:51:22.041 INFO:teuthology.orchestra.run.smithi186.stdout: libradosstriper1 x86_64 2:19.0.0-119.ga62fda73.el8 ceph 517 k 2023-12-17T11:51:22.041 INFO:teuthology.orchestra.run.smithi186.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-12-17T11:51:22.041 INFO:teuthology.orchestra.run.smithi186.stdout: librgw2 x86_64 2:19.0.0-119.ga62fda73.el8 ceph 6.9 M 2023-12-17T11:51:22.041 INFO:teuthology.orchestra.run.smithi186.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-12-17T11:51:22.041 INFO:teuthology.orchestra.run.smithi186.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-12-17T11:51:22.041 INFO:teuthology.orchestra.run.smithi186.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-17T11:51:22.041 INFO:teuthology.orchestra.run.smithi186.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-12-17T11:51:22.041 INFO:teuthology.orchestra.run.smithi186.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2023-12-17T11:51:22.041 INFO:teuthology.orchestra.run.smithi186.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-12-17T11:51:22.041 INFO:teuthology.orchestra.run.smithi186.stdout: luarocks noarch 3.5.0-1.el8 epel 167 k 2023-12-17T11:51:22.042 INFO:teuthology.orchestra.run.smithi186.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-12-17T11:51:22.042 INFO:teuthology.orchestra.run.smithi186.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2023-12-17T11:51:22.042 INFO:teuthology.orchestra.run.smithi186.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2023-12-17T11:51:22.042 INFO:teuthology.orchestra.run.smithi186.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-12-17T11:51:22.042 INFO:teuthology.orchestra.run.smithi186.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-12-17T11:51:22.042 INFO:teuthology.orchestra.run.smithi186.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-12-17T11:51:22.042 INFO:teuthology.orchestra.run.smithi186.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-17T11:51:22.042 INFO:teuthology.orchestra.run.smithi186.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-12-17T11:51:22.042 INFO:teuthology.orchestra.run.smithi186.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-17T11:51:22.042 INFO:teuthology.orchestra.run.smithi186.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-17T11:51:22.042 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-17T11:51:22.042 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-argparse x86_64 2:19.0.0-119.ga62fda73.el8 ceph 45 k 2023-12-17T11:51:22.042 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-common x86_64 2:19.0.0-119.ga62fda73.el8 ceph 129 k 2023-12-17T11:51:22.042 INFO:teuthology.orchestra.run.smithi186.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-17T11:51:22.042 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-12-17T11:51:22.043 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-17T11:51:22.043 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-17T11:51:22.043 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cryptography x86_64 3.2.1-6.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-12-17T11:51:22.043 INFO:teuthology.orchestra.run.smithi186.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-17T11:51:22.043 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-17T11:51:22.043 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-17T11:51:22.043 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-12-17T11:51:22.043 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-12-17T11:51:22.043 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-12-17T11:51:22.043 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-12-17T11:51:22.043 INFO:teuthology.orchestra.run.smithi186.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-17T11:51:22.043 INFO:teuthology.orchestra.run.smithi186.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-17T11:51:22.043 INFO:teuthology.orchestra.run.smithi186.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-12-17T11:51:22.043 INFO:teuthology.orchestra.run.smithi186.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-12-17T11:51:22.043 INFO:teuthology.orchestra.run.smithi186.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-17T11:51:22.043 INFO:teuthology.orchestra.run.smithi186.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-17T11:51:22.044 INFO:teuthology.orchestra.run.smithi186.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-12-17T11:51:22.044 INFO:teuthology.orchestra.run.smithi186.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-12-17T11:51:22.044 INFO:teuthology.orchestra.run.smithi186.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-12-17T11:51:22.044 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-17T11:51:22.044 INFO:teuthology.orchestra.run.smithi186.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-17T11:51:22.044 INFO:teuthology.orchestra.run.smithi186.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-12-17T11:51:22.044 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-12-17T11:51:22.044 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-12-17T11:51:22.044 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-12-17T11:51:22.044 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-12-17T11:51:22.044 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-12-17T11:51:22.044 INFO:teuthology.orchestra.run.smithi186.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-17T11:51:22.044 INFO:teuthology.orchestra.run.smithi186.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-12-17T11:51:22.044 INFO:teuthology.orchestra.run.smithi186.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-17T11:51:22.044 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-17T11:51:22.045 INFO:teuthology.orchestra.run.smithi186.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2023-12-17T11:51:22.045 INFO:teuthology.orchestra.run.smithi186.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-17T11:51:22.045 INFO:teuthology.orchestra.run.smithi186.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-17T11:51:22.045 INFO:teuthology.orchestra.run.smithi186.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-17T11:51:22.045 INFO:teuthology.orchestra.run.smithi186.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-17T11:51:22.045 INFO:teuthology.orchestra.run.smithi186.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-17T11:51:22.045 INFO:teuthology.orchestra.run.smithi186.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-17T11:51:22.045 INFO:teuthology.orchestra.run.smithi186.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-17T11:51:22.045 INFO:teuthology.orchestra.run.smithi186.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-17T11:51:22.045 INFO:teuthology.orchestra.run.smithi186.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-12-17T11:51:22.045 INFO:teuthology.orchestra.run.smithi186.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-17T11:51:22.045 INFO:teuthology.orchestra.run.smithi186.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-12-17T11:51:22.045 INFO:teuthology.orchestra.run.smithi186.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-17T11:51:22.045 INFO:teuthology.orchestra.run.smithi186.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-12-17T11:51:22.045 INFO:teuthology.orchestra.run.smithi186.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-12-17T11:51:22.046 INFO:teuthology.orchestra.run.smithi186.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-12-17T11:51:22.046 INFO:teuthology.orchestra.run.smithi186.stdout:Enabling module streams: 2023-12-17T11:51:22.046 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql 10 2023-12-17T11:51:22.046 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-12-17T11:51:22.046 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction Summary 2023-12-17T11:51:22.046 INFO:teuthology.orchestra.run.smithi186.stdout:=========================================================================================================================== 2023-12-17T11:51:22.046 INFO:teuthology.orchestra.run.smithi186.stdout:Install 130 Packages 2023-12-17T11:51:22.046 INFO:teuthology.orchestra.run.smithi186.stdout:Upgrade 16 Packages 2023-12-17T11:51:22.046 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-12-17T11:51:22.046 INFO:teuthology.orchestra.run.smithi186.stdout:Total download size: 218 M 2023-12-17T11:51:22.046 INFO:teuthology.orchestra.run.smithi186.stdout:Downloading Packages: 2023-12-17T11:51:22.282 INFO:teuthology.orchestra.run.smithi186.stdout:(1/146): ceph-19.0.0-119.ga62fda73.el8.x86_64.r 38 kB/s | 6.4 kB 00:00 2023-12-17T11:51:22.515 INFO:teuthology.orchestra.run.smithi186.stdout:(2/146): ceph-fuse-19.0.0-119.ga62fda73.el8.x86 3.9 MB/s | 919 kB 00:00 2023-12-17T11:51:22.591 INFO:teuthology.orchestra.run.smithi186.stdout:(3/146): ceph-immutable-object-cache-19.0.0-119 2.2 MB/s | 171 kB 00:00 2023-12-17T11:51:22.882 INFO:teuthology.orchestra.run.smithi186.stdout:(4/146): ceph-mds-19.0.0-119.ga62fda73.el8.x86_ 7.9 MB/s | 2.3 MB 00:00 2023-12-17T11:51:23.133 INFO:teuthology.orchestra.run.smithi186.stdout:(5/146): ceph-mgr-19.0.0-119.ga62fda73.el8.x86_ 6.5 MB/s | 1.6 MB 00:00 2023-12-17T11:51:23.733 INFO:teuthology.orchestra.run.smithi186.stdout:(6/146): ceph-common-19.0.0-119.ga62fda73.el8.x 14 MB/s | 23 MB 00:01 2023-12-17T11:51:23.925 INFO:teuthology.orchestra.run.smithi186.stdout:(7/146): ceph-mon-19.0.0-119.ga62fda73.el8.x86_ 5.9 MB/s | 4.6 MB 00:00 2023-12-17T11:51:24.376 INFO:teuthology.orchestra.run.smithi186.stdout:(8/146): ceph-base-19.0.0-119.ga62fda73.el8.x86 2.4 MB/s | 5.4 MB 00:02 2023-12-17T11:51:24.467 INFO:teuthology.orchestra.run.smithi186.stdout:(9/146): ceph-selinux-19.0.0-119.ga62fda73.el8. 266 kB/s | 24 kB 00:00 2023-12-17T11:51:24.758 INFO:teuthology.orchestra.run.smithi008.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-12-17T11:51:24.760 INFO:teuthology.orchestra.run.smithi008.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-12-17T11:51:24.780 INFO:teuthology.orchestra.run.smithi008.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-12-17T11:51:24.781 INFO:teuthology.orchestra.run.smithi008.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-12-17T11:51:24.783 INFO:teuthology.orchestra.run.smithi008.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-12-17T11:51:24.785 INFO:teuthology.orchestra.run.smithi008.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-12-17T11:51:24.788 INFO:teuthology.orchestra.run.smithi008.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-12-17T11:51:24.793 INFO:teuthology.orchestra.run.smithi008.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-12-17T11:51:24.794 INFO:teuthology.orchestra.run.smithi008.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-12-17T11:51:24.851 INFO:teuthology.orchestra.run.smithi186.stdout:(10/146): ceph-osd-19.0.0-119.ga62fda73.el8.x86 16 MB/s | 18 MB 00:01 2023-12-17T11:51:24.943 INFO:teuthology.orchestra.run.smithi186.stdout:(11/146): cephfs-mirror-19.0.0-119.ga62fda73.el 2.8 MB/s | 262 kB 00:00 2023-12-17T11:51:24.985 INFO:teuthology.orchestra.run.smithi186.stdout:(12/146): libcephfs-devel-19.0.0-119.ga62fda73. 751 kB/s | 31 kB 00:00 2023-12-17T11:51:25.031 INFO:teuthology.orchestra.run.smithi008.stdout:Dependencies resolved. 2023-12-17T11:51:25.047 INFO:teuthology.orchestra.run.smithi008.stdout:=========================================================================================================================== 2023-12-17T11:51:25.047 INFO:teuthology.orchestra.run.smithi008.stdout: Package Arch Version Repository Size 2023-12-17T11:51:25.047 INFO:teuthology.orchestra.run.smithi008.stdout:=========================================================================================================================== 2023-12-17T11:51:25.047 INFO:teuthology.orchestra.run.smithi008.stdout:Installing: 2023-12-17T11:51:25.048 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 rhel-8-for-x86_64-baseos-rpms 143 k 2023-12-17T11:51:25.048 INFO:teuthology.orchestra.run.smithi008.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-12-17T11:51:25.048 INFO:teuthology.orchestra.run.smithi008.stdout: ceph x86_64 2:19.0.0-119.ga62fda73.el8 ceph 6.4 k 2023-12-17T11:51:25.048 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-base x86_64 2:19.0.0-119.ga62fda73.el8 ceph 5.4 M 2023-12-17T11:51:25.048 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-fuse x86_64 2:19.0.0-119.ga62fda73.el8 ceph 919 k 2023-12-17T11:51:25.048 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-119.ga62fda73.el8 ceph 171 k 2023-12-17T11:51:25.048 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr x86_64 2:19.0.0-119.ga62fda73.el8 ceph 1.6 M 2023-12-17T11:51:25.048 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-cephadm noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 133 k 2023-12-17T11:51:25.048 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-dashboard noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 1.8 M 2023-12-17T11:51:25.048 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 7.4 M 2023-12-17T11:51:25.048 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-rook noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 50 k 2023-12-17T11:51:25.048 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-radosgw x86_64 2:19.0.0-119.ga62fda73.el8 ceph 14 M 2023-12-17T11:51:25.049 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-test x86_64 2:19.0.0-119.ga62fda73.el8 ceph 49 M 2023-12-17T11:51:25.049 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-volume noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 262 k 2023-12-17T11:51:25.049 INFO:teuthology.orchestra.run.smithi008.stdout: cephadm noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 415 k 2023-12-17T11:51:25.049 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-mirror x86_64 2:19.0.0-119.ga62fda73.el8 ceph 262 k 2023-12-17T11:51:25.049 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-top noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 18 k 2023-12-17T11:51:25.049 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2023-12-17T11:51:25.049 INFO:teuthology.orchestra.run.smithi008.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-12-17T11:51:25.049 INFO:teuthology.orchestra.run.smithi008.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-12-17T11:51:25.049 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs-devel x86_64 2:19.0.0-119.ga62fda73.el8 ceph 31 k 2023-12-17T11:51:25.049 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs2 x86_64 2:19.0.0-119.ga62fda73.el8 ceph 838 k 2023-12-17T11:51:25.049 INFO:teuthology.orchestra.run.smithi008.stdout: librados-devel x86_64 2:19.0.0-119.ga62fda73.el8 ceph 139 k 2023-12-17T11:51:25.049 INFO:teuthology.orchestra.run.smithi008.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-12-17T11:51:25.050 INFO:teuthology.orchestra.run.smithi008.stdout: libuuid-devel x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 100 k 2023-12-17T11:51:25.050 INFO:teuthology.orchestra.run.smithi008.stdout: openssl-devel x86_64 1:1.1.1k-9.el8_7 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-12-17T11:51:25.050 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql x86_64 10.23-3.module+el8.9.0+20831+78489779 rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-12-17T11:51:25.050 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-contrib x86_64 10.23-3.module+el8.9.0+20831+78489779 rhel-8-for-x86_64-appstream-rpms 811 k 2023-12-17T11:51:25.050 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-server x86_64 10.23-3.module+el8.9.0+20831+78489779 rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-12-17T11:51:25.050 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cephfs x86_64 2:19.0.0-119.ga62fda73.el8 ceph 197 k 2023-12-17T11:51:25.050 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rados x86_64 2:19.0.0-119.ga62fda73.el8 ceph 371 k 2023-12-17T11:51:25.050 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rbd x86_64 2:19.0.0-119.ga62fda73.el8 ceph 364 k 2023-12-17T11:51:25.050 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rgw x86_64 2:19.0.0-119.ga62fda73.el8 ceph 107 k 2023-12-17T11:51:25.050 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-fuse x86_64 2:19.0.0-119.ga62fda73.el8 ceph 93 k 2023-12-17T11:51:25.050 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-mirror x86_64 2:19.0.0-119.ga62fda73.el8 ceph 3.6 M 2023-12-17T11:51:25.050 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-nbd x86_64 2:19.0.0-119.ga62fda73.el8 ceph 181 k 2023-12-17T11:51:25.050 INFO:teuthology.orchestra.run.smithi008.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2023-12-17T11:51:25.051 INFO:teuthology.orchestra.run.smithi008.stdout:Upgrading: 2023-12-17T11:51:25.051 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2023-12-17T11:51:25.051 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2023-12-17T11:51:25.051 INFO:teuthology.orchestra.run.smithi008.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2023-12-17T11:51:25.051 INFO:teuthology.orchestra.run.smithi008.stdout: libblkid x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-12-17T11:51:25.051 INFO:teuthology.orchestra.run.smithi008.stdout: libfdisk x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 254 k 2023-12-17T11:51:25.051 INFO:teuthology.orchestra.run.smithi008.stdout: libmount x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 237 k 2023-12-17T11:51:25.051 INFO:teuthology.orchestra.run.smithi008.stdout: librados2 x86_64 2:19.0.0-119.ga62fda73.el8 ceph 3.8 M 2023-12-17T11:51:25.051 INFO:teuthology.orchestra.run.smithi008.stdout: librbd1 x86_64 2:19.0.0-119.ga62fda73.el8 ceph 3.7 M 2023-12-17T11:51:25.051 INFO:teuthology.orchestra.run.smithi008.stdout: libsmartcols x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 179 k 2023-12-17T11:51:25.051 INFO:teuthology.orchestra.run.smithi008.stdout: libuuid x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 99 k 2023-12-17T11:51:25.051 INFO:teuthology.orchestra.run.smithi008.stdout: openssl x86_64 1:1.1.1k-9.el8_7 rhel-8-for-x86_64-baseos-rpms 710 k 2023-12-17T11:51:25.051 INFO:teuthology.orchestra.run.smithi008.stdout: openssl-libs x86_64 1:1.1.1k-9.el8_7 rhel-8-for-x86_64-baseos-rpms 1.5 M 2023-12-17T11:51:25.051 INFO:teuthology.orchestra.run.smithi008.stdout: util-linux x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 2.5 M 2023-12-17T11:51:25.052 INFO:teuthology.orchestra.run.smithi008.stdout: util-linux-user x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 103 k 2023-12-17T11:51:25.052 INFO:teuthology.orchestra.run.smithi008.stdout: xfsdump x86_64 3.1.8-6.el8 rhel-8-for-x86_64-baseos-rpms 333 k 2023-12-17T11:51:25.052 INFO:teuthology.orchestra.run.smithi008.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2023-12-17T11:51:25.052 INFO:teuthology.orchestra.run.smithi008.stdout:Installing dependencies: 2023-12-17T11:51:25.052 INFO:teuthology.orchestra.run.smithi008.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2023-12-17T11:51:25.052 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-common x86_64 2:19.0.0-119.ga62fda73.el8 ceph 23 M 2023-12-17T11:51:25.052 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-grafana-dashboards noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 28 k 2023-12-17T11:51:25.052 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mds x86_64 2:19.0.0-119.ga62fda73.el8 ceph 2.3 M 2023-12-17T11:51:25.052 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-modules-core noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 243 k 2023-12-17T11:51:25.052 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mon x86_64 2:19.0.0-119.ga62fda73.el8 ceph 4.6 M 2023-12-17T11:51:25.052 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-osd x86_64 2:19.0.0-119.ga62fda73.el8 ceph 18 M 2023-12-17T11:51:25.053 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-prometheus-alerts noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 15 k 2023-12-17T11:51:25.053 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-selinux x86_64 2:19.0.0-119.ga62fda73.el8 ceph 24 k 2023-12-17T11:51:25.053 INFO:teuthology.orchestra.run.smithi008.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-12-17T11:51:25.053 INFO:teuthology.orchestra.run.smithi008.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-17T11:51:25.053 INFO:teuthology.orchestra.run.smithi008.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-12-17T11:51:25.053 INFO:teuthology.orchestra.run.smithi008.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-12-17T11:51:25.053 INFO:teuthology.orchestra.run.smithi008.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2023-12-17T11:51:25.053 INFO:teuthology.orchestra.run.smithi008.stdout: libcephsqlite x86_64 2:19.0.0-119.ga62fda73.el8 ceph 183 k 2023-12-17T11:51:25.053 INFO:teuthology.orchestra.run.smithi008.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-12-17T11:51:25.053 INFO:teuthology.orchestra.run.smithi008.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2023-12-17T11:51:25.053 INFO:teuthology.orchestra.run.smithi008.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-17T11:51:25.053 INFO:teuthology.orchestra.run.smithi008.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-12-17T11:51:25.053 INFO:teuthology.orchestra.run.smithi008.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2023-12-17T11:51:25.054 INFO:teuthology.orchestra.run.smithi008.stdout: librabbitmq x86_64 0.9.0-4.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-12-17T11:51:25.054 INFO:teuthology.orchestra.run.smithi008.stdout: libradosstriper1 x86_64 2:19.0.0-119.ga62fda73.el8 ceph 517 k 2023-12-17T11:51:25.054 INFO:teuthology.orchestra.run.smithi008.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-12-17T11:51:25.054 INFO:teuthology.orchestra.run.smithi008.stdout: librgw2 x86_64 2:19.0.0-119.ga62fda73.el8 ceph 6.9 M 2023-12-17T11:51:25.054 INFO:teuthology.orchestra.run.smithi008.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-12-17T11:51:25.054 INFO:teuthology.orchestra.run.smithi008.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-12-17T11:51:25.054 INFO:teuthology.orchestra.run.smithi008.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-17T11:51:25.054 INFO:teuthology.orchestra.run.smithi008.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-12-17T11:51:25.054 INFO:teuthology.orchestra.run.smithi008.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2023-12-17T11:51:25.054 INFO:teuthology.orchestra.run.smithi008.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-12-17T11:51:25.054 INFO:teuthology.orchestra.run.smithi008.stdout: luarocks noarch 3.5.0-1.el8 epel 167 k 2023-12-17T11:51:25.054 INFO:teuthology.orchestra.run.smithi008.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-12-17T11:51:25.055 INFO:teuthology.orchestra.run.smithi008.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2023-12-17T11:51:25.055 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2023-12-17T11:51:25.055 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-12-17T11:51:25.055 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-12-17T11:51:25.055 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-12-17T11:51:25.055 INFO:teuthology.orchestra.run.smithi008.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-17T11:51:25.055 INFO:teuthology.orchestra.run.smithi008.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-12-17T11:51:25.055 INFO:teuthology.orchestra.run.smithi008.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-17T11:51:25.055 INFO:teuthology.orchestra.run.smithi008.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-17T11:51:25.055 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-17T11:51:25.055 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-argparse x86_64 2:19.0.0-119.ga62fda73.el8 ceph 45 k 2023-12-17T11:51:25.055 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-common x86_64 2:19.0.0-119.ga62fda73.el8 ceph 129 k 2023-12-17T11:51:25.055 INFO:teuthology.orchestra.run.smithi008.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-17T11:51:25.056 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-12-17T11:51:25.056 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-17T11:51:25.056 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-17T11:51:25.056 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cryptography x86_64 3.2.1-6.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-12-17T11:51:25.056 INFO:teuthology.orchestra.run.smithi008.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-17T11:51:25.056 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-17T11:51:25.056 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-17T11:51:25.056 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-12-17T11:51:25.056 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-12-17T11:51:25.056 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-12-17T11:51:25.056 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-12-17T11:51:25.057 INFO:teuthology.orchestra.run.smithi008.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-17T11:51:25.057 INFO:teuthology.orchestra.run.smithi008.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-17T11:51:25.057 INFO:teuthology.orchestra.run.smithi008.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-12-17T11:51:25.057 INFO:teuthology.orchestra.run.smithi008.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-12-17T11:51:25.057 INFO:teuthology.orchestra.run.smithi008.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-17T11:51:25.057 INFO:teuthology.orchestra.run.smithi008.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-17T11:51:25.057 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-12-17T11:51:25.057 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-12-17T11:51:25.057 INFO:teuthology.orchestra.run.smithi008.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-12-17T11:51:25.057 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-17T11:51:25.057 INFO:teuthology.orchestra.run.smithi008.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-17T11:51:25.058 INFO:teuthology.orchestra.run.smithi008.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-12-17T11:51:25.058 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-12-17T11:51:25.058 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-12-17T11:51:25.058 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-12-17T11:51:25.058 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-12-17T11:51:25.058 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-12-17T11:51:25.058 INFO:teuthology.orchestra.run.smithi008.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-17T11:51:25.058 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-12-17T11:51:25.058 INFO:teuthology.orchestra.run.smithi008.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-17T11:51:25.058 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-17T11:51:25.058 INFO:teuthology.orchestra.run.smithi008.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2023-12-17T11:51:25.058 INFO:teuthology.orchestra.run.smithi008.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-17T11:51:25.058 INFO:teuthology.orchestra.run.smithi008.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-17T11:51:25.059 INFO:teuthology.orchestra.run.smithi008.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-17T11:51:25.059 INFO:teuthology.orchestra.run.smithi008.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-17T11:51:25.059 INFO:teuthology.orchestra.run.smithi008.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-17T11:51:25.059 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-17T11:51:25.059 INFO:teuthology.orchestra.run.smithi008.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-17T11:51:25.059 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-17T11:51:25.059 INFO:teuthology.orchestra.run.smithi008.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-12-17T11:51:25.059 INFO:teuthology.orchestra.run.smithi008.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-17T11:51:25.059 INFO:teuthology.orchestra.run.smithi008.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-12-17T11:51:25.059 INFO:teuthology.orchestra.run.smithi008.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-17T11:51:25.059 INFO:teuthology.orchestra.run.smithi008.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-12-17T11:51:25.059 INFO:teuthology.orchestra.run.smithi008.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-12-17T11:51:25.059 INFO:teuthology.orchestra.run.smithi008.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-12-17T11:51:25.060 INFO:teuthology.orchestra.run.smithi008.stdout:Enabling module streams: 2023-12-17T11:51:25.060 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql 10 2023-12-17T11:51:25.060 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T11:51:25.060 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction Summary 2023-12-17T11:51:25.060 INFO:teuthology.orchestra.run.smithi008.stdout:=========================================================================================================================== 2023-12-17T11:51:25.060 INFO:teuthology.orchestra.run.smithi008.stdout:Install 130 Packages 2023-12-17T11:51:25.060 INFO:teuthology.orchestra.run.smithi008.stdout:Upgrade 16 Packages 2023-12-17T11:51:25.060 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T11:51:25.061 INFO:teuthology.orchestra.run.smithi008.stdout:Total download size: 218 M 2023-12-17T11:51:25.061 INFO:teuthology.orchestra.run.smithi008.stdout:Downloading Packages: 2023-12-17T11:51:25.085 INFO:teuthology.orchestra.run.smithi186.stdout:(13/146): libcephfs2-19.0.0-119.ga62fda73.el8.x 8.2 MB/s | 838 kB 00:00 2023-12-17T11:51:25.144 INFO:teuthology.orchestra.run.smithi186.stdout:(14/146): libcephsqlite-19.0.0-119.ga62fda73.el 3.1 MB/s | 183 kB 00:00 2023-12-17T11:51:25.211 INFO:teuthology.orchestra.run.smithi186.stdout:(15/146): librados-devel-19.0.0-119.ga62fda73.e 2.0 MB/s | 139 kB 00:00 2023-12-17T11:51:25.215 INFO:teuthology.orchestra.run.smithi100.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-12-17T11:51:25.216 INFO:teuthology.orchestra.run.smithi100.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-12-17T11:51:25.235 INFO:teuthology.orchestra.run.smithi100.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-12-17T11:51:25.237 INFO:teuthology.orchestra.run.smithi100.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-12-17T11:51:25.239 INFO:teuthology.orchestra.run.smithi100.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-12-17T11:51:25.240 INFO:teuthology.orchestra.run.smithi100.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-12-17T11:51:25.243 INFO:teuthology.orchestra.run.smithi100.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-12-17T11:51:25.247 INFO:teuthology.orchestra.run.smithi100.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-12-17T11:51:25.249 INFO:teuthology.orchestra.run.smithi100.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-12-17T11:51:25.320 INFO:teuthology.orchestra.run.smithi186.stdout:(16/146): libradosstriper1-19.0.0-119.ga62fda73 4.7 MB/s | 517 kB 00:00 2023-12-17T11:51:25.364 INFO:teuthology.orchestra.run.smithi008.stdout:(1/146): ceph-19.0.0-119.ga62fda73.el8.x86_64.r 25 kB/s | 6.4 kB 00:00 2023-12-17T11:51:25.464 INFO:teuthology.orchestra.run.smithi100.stdout:Dependencies resolved. 2023-12-17T11:51:25.479 INFO:teuthology.orchestra.run.smithi100.stdout:=========================================================================================================================== 2023-12-17T11:51:25.479 INFO:teuthology.orchestra.run.smithi100.stdout: Package Arch Version Repository Size 2023-12-17T11:51:25.479 INFO:teuthology.orchestra.run.smithi100.stdout:=========================================================================================================================== 2023-12-17T11:51:25.479 INFO:teuthology.orchestra.run.smithi100.stdout:Installing: 2023-12-17T11:51:25.479 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-initscripts-updown noarch 1:1.40.16-9.el8 rhel-8-for-x86_64-baseos-rpms 143 k 2023-12-17T11:51:25.479 INFO:teuthology.orchestra.run.smithi100.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-12-17T11:51:25.479 INFO:teuthology.orchestra.run.smithi100.stdout: ceph x86_64 2:19.0.0-119.ga62fda73.el8 ceph 6.4 k 2023-12-17T11:51:25.479 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base x86_64 2:19.0.0-119.ga62fda73.el8 ceph 5.4 M 2023-12-17T11:51:25.479 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse x86_64 2:19.0.0-119.ga62fda73.el8 ceph 919 k 2023-12-17T11:51:25.479 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-119.ga62fda73.el8 ceph 171 k 2023-12-17T11:51:25.480 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr x86_64 2:19.0.0-119.ga62fda73.el8 ceph 1.6 M 2023-12-17T11:51:25.480 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 133 k 2023-12-17T11:51:25.480 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 1.8 M 2023-12-17T11:51:25.480 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 7.4 M 2023-12-17T11:51:25.480 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 50 k 2023-12-17T11:51:25.480 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw x86_64 2:19.0.0-119.ga62fda73.el8 ceph 14 M 2023-12-17T11:51:25.480 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test x86_64 2:19.0.0-119.ga62fda73.el8 ceph 49 M 2023-12-17T11:51:25.480 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-volume noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 262 k 2023-12-17T11:51:25.480 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 415 k 2023-12-17T11:51:25.480 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-mirror x86_64 2:19.0.0-119.ga62fda73.el8 ceph 262 k 2023-12-17T11:51:25.480 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-top noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 18 k 2023-12-17T11:51:25.481 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-devel x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 62 k 2023-12-17T11:51:25.481 INFO:teuthology.orchestra.run.smithi100.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-12-17T11:51:25.481 INFO:teuthology.orchestra.run.smithi100.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-12-17T11:51:25.481 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel x86_64 2:19.0.0-119.ga62fda73.el8 ceph 31 k 2023-12-17T11:51:25.481 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2 x86_64 2:19.0.0-119.ga62fda73.el8 ceph 838 k 2023-12-17T11:51:25.481 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel x86_64 2:19.0.0-119.ga62fda73.el8 ceph 139 k 2023-12-17T11:51:25.481 INFO:teuthology.orchestra.run.smithi100.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-12-17T11:51:25.481 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-devel x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 100 k 2023-12-17T11:51:25.481 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-devel x86_64 1:1.1.1k-9.el8_7 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-12-17T11:51:25.481 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql x86_64 10.23-3.module+el8.9.0+20831+78489779 rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-12-17T11:51:25.481 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-contrib x86_64 10.23-3.module+el8.9.0+20831+78489779 rhel-8-for-x86_64-appstream-rpms 811 k 2023-12-17T11:51:25.481 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-server x86_64 10.23-3.module+el8.9.0+20831+78489779 rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-12-17T11:51:25.481 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs x86_64 2:19.0.0-119.ga62fda73.el8 ceph 197 k 2023-12-17T11:51:25.482 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados x86_64 2:19.0.0-119.ga62fda73.el8 ceph 371 k 2023-12-17T11:51:25.482 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd x86_64 2:19.0.0-119.ga62fda73.el8 ceph 364 k 2023-12-17T11:51:25.482 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw x86_64 2:19.0.0-119.ga62fda73.el8 ceph 107 k 2023-12-17T11:51:25.482 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse x86_64 2:19.0.0-119.ga62fda73.el8 ceph 93 k 2023-12-17T11:51:25.482 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror x86_64 2:19.0.0-119.ga62fda73.el8 ceph 3.6 M 2023-12-17T11:51:25.482 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd x86_64 2:19.0.0-119.ga62fda73.el8 ceph 181 k 2023-12-17T11:51:25.482 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-devel x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 73 k 2023-12-17T11:51:25.482 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrading: 2023-12-17T11:51:25.482 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 232 k 2023-12-17T11:51:25.482 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libs x86_64 0.189-3.el8 rhel-8-for-x86_64-baseos-rpms 303 k 2023-12-17T11:51:25.482 INFO:teuthology.orchestra.run.smithi100.stdout: iproute x86_64 6.2.0-5.el8_9 rhel-8-for-x86_64-baseos-rpms 854 k 2023-12-17T11:51:25.482 INFO:teuthology.orchestra.run.smithi100.stdout: libblkid x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-12-17T11:51:25.482 INFO:teuthology.orchestra.run.smithi100.stdout: libfdisk x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 254 k 2023-12-17T11:51:25.482 INFO:teuthology.orchestra.run.smithi100.stdout: libmount x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 237 k 2023-12-17T11:51:25.483 INFO:teuthology.orchestra.run.smithi100.stdout: librados2 x86_64 2:19.0.0-119.ga62fda73.el8 ceph 3.8 M 2023-12-17T11:51:25.483 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1 x86_64 2:19.0.0-119.ga62fda73.el8 ceph 3.7 M 2023-12-17T11:51:25.483 INFO:teuthology.orchestra.run.smithi100.stdout: libsmartcols x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 179 k 2023-12-17T11:51:25.483 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 99 k 2023-12-17T11:51:25.483 INFO:teuthology.orchestra.run.smithi100.stdout: openssl x86_64 1:1.1.1k-9.el8_7 rhel-8-for-x86_64-baseos-rpms 710 k 2023-12-17T11:51:25.483 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-libs x86_64 1:1.1.1k-9.el8_7 rhel-8-for-x86_64-baseos-rpms 1.5 M 2023-12-17T11:51:25.483 INFO:teuthology.orchestra.run.smithi100.stdout: util-linux x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 2.5 M 2023-12-17T11:51:25.483 INFO:teuthology.orchestra.run.smithi100.stdout: util-linux-user x86_64 2.32.1-43.el8 rhel-8-for-x86_64-baseos-rpms 103 k 2023-12-17T11:51:25.483 INFO:teuthology.orchestra.run.smithi100.stdout: xfsdump x86_64 3.1.8-6.el8 rhel-8-for-x86_64-baseos-rpms 333 k 2023-12-17T11:51:25.483 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs x86_64 5.0.0-12.el8 rhel-8-for-x86_64-baseos-rpms 1.1 M 2023-12-17T11:51:25.483 INFO:teuthology.orchestra.run.smithi100.stdout:Installing dependencies: 2023-12-17T11:51:25.483 INFO:teuthology.orchestra.run.smithi100.stdout: automake noarch 1.16.1-8.el8 rhel-8-for-x86_64-appstream-rpms 714 k 2023-12-17T11:51:25.483 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common x86_64 2:19.0.0-119.ga62fda73.el8 ceph 23 M 2023-12-17T11:51:25.484 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 28 k 2023-12-17T11:51:25.484 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds x86_64 2:19.0.0-119.ga62fda73.el8 ceph 2.3 M 2023-12-17T11:51:25.484 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 243 k 2023-12-17T11:51:25.484 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon x86_64 2:19.0.0-119.ga62fda73.el8 ceph 4.6 M 2023-12-17T11:51:25.484 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd x86_64 2:19.0.0-119.ga62fda73.el8 ceph 18 M 2023-12-17T11:51:25.484 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts noarch 2:19.0.0-119.ga62fda73.el8 ceph-noarch 15 k 2023-12-17T11:51:25.484 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux x86_64 2:19.0.0-119.ga62fda73.el8 ceph 24 k 2023-12-17T11:51:25.484 INFO:teuthology.orchestra.run.smithi100.stdout: fuse x86_64 2.9.7-17.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-12-17T11:51:25.484 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-12-17T11:51:25.484 INFO:teuthology.orchestra.run.smithi100.stdout: jq x86_64 1.6-7.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-12-17T11:51:25.484 INFO:teuthology.orchestra.run.smithi100.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-12-17T11:51:25.484 INFO:teuthology.orchestra.run.smithi100.stdout: krb5-devel x86_64 1.18.2-26.el8_9 rhel-8-for-x86_64-baseos-rpms 562 k 2023-12-17T11:51:25.484 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite x86_64 2:19.0.0-119.ga62fda73.el8 ceph 183 k 2023-12-17T11:51:25.485 INFO:teuthology.orchestra.run.smithi100.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-12-17T11:51:25.485 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 645 k 2023-12-17T11:51:25.485 INFO:teuthology.orchestra.run.smithi100.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-12-17T11:51:25.485 INFO:teuthology.orchestra.run.smithi100.stdout: libpq x86_64 13.11-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-12-17T11:51:25.485 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath x86_64 8.5.0-20.el8 rhel-8-for-x86_64-baseos-rpms 172 k 2023-12-17T11:51:25.485 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq x86_64 0.9.0-4.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-12-17T11:51:25.485 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1 x86_64 2:19.0.0-119.ga62fda73.el8 ceph 517 k 2023-12-17T11:51:25.485 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-12-17T11:51:25.485 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2 x86_64 2:19.0.0-119.ga62fda73.el8 ceph 6.9 M 2023-12-17T11:51:25.485 INFO:teuthology.orchestra.run.smithi100.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-12-17T11:51:25.485 INFO:teuthology.orchestra.run.smithi100.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-12-17T11:51:25.485 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-12-17T11:51:25.485 INFO:teuthology.orchestra.run.smithi100.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-12-17T11:51:25.486 INFO:teuthology.orchestra.run.smithi100.stdout: libzstd-devel x86_64 1.4.4-1.el8 rhel-8-for-x86_64-baseos-rpms 44 k 2023-12-17T11:51:25.486 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-12-17T11:51:25.486 INFO:teuthology.orchestra.run.smithi100.stdout: luarocks noarch 3.5.0-1.el8 epel 167 k 2023-12-17T11:51:25.486 INFO:teuthology.orchestra.run.smithi100.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-12-17T11:51:25.486 INFO:teuthology.orchestra.run.smithi100.stdout: openblas x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.0 M 2023-12-17T11:51:25.486 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-threads x86_64 0.3.15-6.el8 rhel-8-for-x86_64-appstream-rpms 5.2 M 2023-12-17T11:51:25.486 INFO:teuthology.orchestra.run.smithi100.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-12-17T11:51:25.486 INFO:teuthology.orchestra.run.smithi100.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-12-17T11:51:25.486 INFO:teuthology.orchestra.run.smithi100.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-12-17T11:51:25.486 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-12-17T11:51:25.486 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-12-17T11:51:25.486 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-12-17T11:51:25.486 INFO:teuthology.orchestra.run.smithi100.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-12-17T11:51:25.487 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-12-17T11:51:25.487 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse x86_64 2:19.0.0-119.ga62fda73.el8 ceph 45 k 2023-12-17T11:51:25.487 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common x86_64 2:19.0.0-119.ga62fda73.el8 ceph 129 k 2023-12-17T11:51:25.487 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-12-17T11:51:25.487 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi x86_64 1.11.5-6.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-12-17T11:51:25.487 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-12-17T11:51:25.487 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-12-17T11:51:25.487 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography x86_64 3.2.1-6.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-12-17T11:51:25.487 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-12-17T11:51:25.487 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-12-17T11:51:25.487 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-12-17T11:51:25.487 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-12-17T11:51:25.487 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-12-17T11:51:25.488 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-12-17T11:51:25.488 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-12-17T11:51:25.488 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-12-17T11:51:25.488 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-12-17T11:51:25.488 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako noarch 1.0.6-14.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-12-17T11:51:25.488 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-12-17T11:51:25.488 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-12-17T11:51:25.488 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-12-17T11:51:25.488 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-12-17T11:51:25.488 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-12-17T11:51:25.488 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-12-17T11:51:25.488 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-12-17T11:51:25.488 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-12-17T11:51:25.489 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-12-17T11:51:25.489 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-12-17T11:51:25.489 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-12-17T11:51:25.489 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-12-17T11:51:25.489 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-12-17T11:51:25.489 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz noarch 2017.2-11.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-12-17T11:51:25.489 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-12-17T11:51:25.489 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-12-17T11:51:25.489 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-12-17T11:51:25.489 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-12-17T11:51:25.489 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy x86_64 1.0.0-21.module+el8.9.0+20976+d3c38525 rhel-8-for-x86_64-appstream-rpms 14 M 2023-12-17T11:51:25.489 INFO:teuthology.orchestra.run.smithi100.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-12-17T11:51:25.489 INFO:teuthology.orchestra.run.smithi100.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-12-17T11:51:25.490 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-12-17T11:51:25.490 INFO:teuthology.orchestra.run.smithi100.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-12-17T11:51:25.490 INFO:teuthology.orchestra.run.smithi100.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-12-17T11:51:25.490 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-12-17T11:51:25.490 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-12-17T11:51:25.490 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-12-17T11:51:25.490 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-12-17T11:51:25.490 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-12-17T11:51:25.490 INFO:teuthology.orchestra.run.smithi100.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-12-17T11:51:25.490 INFO:teuthology.orchestra.run.smithi100.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-12-17T11:51:25.490 INFO:teuthology.orchestra.run.smithi100.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-12-17T11:51:25.490 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-12-17T11:51:25.490 INFO:teuthology.orchestra.run.smithi100.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-12-17T11:51:25.490 INFO:teuthology.orchestra.run.smithi100.stdout:Enabling module streams: 2023-12-17T11:51:25.491 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql 10 2023-12-17T11:51:25.491 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-17T11:51:25.491 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction Summary 2023-12-17T11:51:25.491 INFO:teuthology.orchestra.run.smithi100.stdout:=========================================================================================================================== 2023-12-17T11:51:25.491 INFO:teuthology.orchestra.run.smithi100.stdout:Install 130 Packages 2023-12-17T11:51:25.491 INFO:teuthology.orchestra.run.smithi100.stdout:Upgrade 16 Packages 2023-12-17T11:51:25.491 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-17T11:51:25.492 INFO:teuthology.orchestra.run.smithi100.stdout:Total download size: 218 M 2023-12-17T11:51:25.492 INFO:teuthology.orchestra.run.smithi100.stdout:Downloading Packages: 2023-12-17T11:51:25.587 INFO:teuthology.orchestra.run.smithi186.stdout:(17/146): ceph-radosgw-19.0.0-119.ga62fda73.el8 8.3 MB/s | 14 MB 00:01 2023-12-17T11:51:25.687 INFO:teuthology.orchestra.run.smithi186.stdout:(18/146): python3-ceph-argparse-19.0.0-119.ga62 447 kB/s | 45 kB 00:00 2023-12-17T11:51:25.756 INFO:teuthology.orchestra.run.smithi100.stdout:(1/146): ceph-19.0.0-119.ga62fda73.el8.x86_64.r 33 kB/s | 6.4 kB 00:00 2023-12-17T11:51:25.787 INFO:teuthology.orchestra.run.smithi186.stdout:(19/146): librgw2-19.0.0-119.ga62fda73.el8.x86_ 15 MB/s | 6.9 MB 00:00 2023-12-17T11:51:25.812 INFO:teuthology.orchestra.run.smithi186.stdout:(20/146): python3-ceph-common-19.0.0-119.ga62fd 1.0 MB/s | 129 kB 00:00 2023-12-17T11:51:25.838 INFO:teuthology.orchestra.run.smithi186.stdout:(21/146): python3-cephfs-19.0.0-119.ga62fda73.e 3.9 MB/s | 197 kB 00:00 2023-12-17T11:51:25.871 INFO:teuthology.orchestra.run.smithi186.stdout:(22/146): python3-rados-19.0.0-119.ga62fda73.el 6.2 MB/s | 371 kB 00:00 2023-12-17T11:51:25.905 INFO:teuthology.orchestra.run.smithi186.stdout:(23/146): python3-rbd-19.0.0-119.ga62fda73.el8. 5.3 MB/s | 364 kB 00:00 2023-12-17T11:51:25.930 INFO:teuthology.orchestra.run.smithi186.stdout:(24/146): python3-rgw-19.0.0-119.ga62fda73.el8. 1.8 MB/s | 107 kB 00:00 2023-12-17T11:51:25.956 INFO:teuthology.orchestra.run.smithi186.stdout:(25/146): rbd-fuse-19.0.0-119.ga62fda73.el8.x86 1.8 MB/s | 93 kB 00:00 2023-12-17T11:51:26.061 INFO:teuthology.orchestra.run.smithi186.stdout:(26/146): rbd-nbd-19.0.0-119.ga62fda73.el8.x86_ 1.7 MB/s | 181 kB 00:00 2023-12-17T11:51:26.140 INFO:teuthology.orchestra.run.smithi186.stdout:(27/146): ceph-grafana-dashboards-19.0.0-119.ga 360 kB/s | 28 kB 00:00 2023-12-17T11:51:26.165 INFO:teuthology.orchestra.run.smithi008.stdout:(2/146): ceph-fuse-19.0.0-119.ga62fda73.el8.x86 1.1 MB/s | 919 kB 00:00 2023-12-17T11:51:26.232 INFO:teuthology.orchestra.run.smithi186.stdout:(28/146): ceph-mgr-cephadm-19.0.0-119.ga62fda73 1.4 MB/s | 133 kB 00:00 2023-12-17T11:51:26.281 INFO:teuthology.orchestra.run.smithi100.stdout:(2/146): ceph-fuse-19.0.0-119.ga62fda73.el8.x86 1.7 MB/s | 919 kB 00:00 2023-12-17T11:51:26.439 INFO:teuthology.orchestra.run.smithi100.stdout:(3/146): ceph-immutable-object-cache-19.0.0-119 1.1 MB/s | 171 kB 00:00 2023-12-17T11:51:26.474 INFO:teuthology.orchestra.run.smithi186.stdout:(29/146): rbd-mirror-19.0.0-119.ga62fda73.el8.x 6.6 MB/s | 3.6 MB 00:00 2023-12-17T11:51:26.498 INFO:teuthology.orchestra.run.smithi008.stdout:(3/146): ceph-immutable-object-cache-19.0.0-119 513 kB/s | 171 kB 00:00 2023-12-17T11:51:26.515 INFO:teuthology.orchestra.run.smithi186.stdout:(30/146): ceph-mgr-dashboard-19.0.0-119.ga62fda 6.2 MB/s | 1.8 MB 00:00 2023-12-17T11:51:26.607 INFO:teuthology.orchestra.run.smithi186.stdout:(31/146): ceph-mgr-modules-core-19.0.0-119.ga62 2.6 MB/s | 243 kB 00:00 2023-12-17T11:51:26.699 INFO:teuthology.orchestra.run.smithi186.stdout:(32/146): ceph-mgr-rook-19.0.0-119.ga62fda73.el 547 kB/s | 50 kB 00:00 2023-12-17T11:51:26.724 INFO:teuthology.orchestra.run.smithi008.stdout:(4/146): ceph-base-19.0.0-119.ga62fda73.el8.x86 3.3 MB/s | 5.4 MB 00:01 2023-12-17T11:51:26.766 INFO:teuthology.orchestra.run.smithi186.stdout:(33/146): ceph-prometheus-alerts-19.0.0-119.ga6 225 kB/s | 15 kB 00:00 2023-12-17T11:51:26.867 INFO:teuthology.orchestra.run.smithi186.stdout:(34/146): ceph-volume-19.0.0-119.ga62fda73.el8. 2.6 MB/s | 262 kB 00:00 2023-12-17T11:51:26.984 INFO:teuthology.orchestra.run.smithi186.stdout:(35/146): cephadm-19.0.0-119.ga62fda73.el8.noar 3.5 MB/s | 415 kB 00:00 2023-12-17T11:51:27.084 INFO:teuthology.orchestra.run.smithi186.stdout:(36/146): cephfs-top-19.0.0-119.ga62fda73.el8.n 181 kB/s | 18 kB 00:00 2023-12-17T11:51:27.149 INFO:teuthology.orchestra.run.smithi008.stdout:(5/146): ceph-mgr-19.0.0-119.ga62fda73.el8.x86_ 3.8 MB/s | 1.6 MB 00:00 2023-12-17T11:51:27.390 INFO:teuthology.orchestra.run.smithi100.stdout:(4/146): ceph-mds-19.0.0-119.ga62fda73.el8.x86_ 2.4 MB/s | 2.3 MB 00:00 2023-12-17T11:51:27.484 INFO:teuthology.orchestra.run.smithi186.stdout:(37/146): gperftools-libs-2.7-9.el8.x86_64.rpm 766 kB/s | 306 kB 00:00 2023-12-17T11:51:27.602 INFO:teuthology.orchestra.run.smithi186.stdout:(38/146): liboath-2.6.2-3.el8.x86_64.rpm 503 kB/s | 59 kB 00:00 2023-12-17T11:51:27.685 INFO:teuthology.orchestra.run.smithi186.stdout:(39/146): libunwind-1.3.1-3.el8.x86_64.rpm 905 kB/s | 75 kB 00:00 2023-12-17T11:51:27.765 INFO:teuthology.orchestra.run.smithi100.stdout:(5/146): ceph-base-19.0.0-119.ga62fda73.el8.x86 2.4 MB/s | 5.4 MB 00:02 2023-12-17T11:51:27.777 INFO:teuthology.orchestra.run.smithi186.stdout:(40/146): ceph-mgr-diskprediction-local-19.0.0- 5.7 MB/s | 7.4 MB 00:01 2023-12-17T11:51:27.802 INFO:teuthology.orchestra.run.smithi186.stdout:(41/146): luarocks-3.5.0-1.el8.noarch.rpm 1.4 MB/s | 167 kB 00:00 2023-12-17T11:51:27.878 INFO:teuthology.orchestra.run.smithi186.stdout:(42/146): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 583 kB/s | 44 kB 00:00 2023-12-17T11:51:27.982 INFO:teuthology.orchestra.run.smithi100.stdout:(6/146): ceph-mgr-19.0.0-119.ga62fda73.el8.x86_ 2.7 MB/s | 1.6 MB 00:00 2023-12-17T11:51:28.003 INFO:teuthology.orchestra.run.smithi186.stdout:(43/146): python3-beautifulsoup4-4.6.3-2.el8.1. 1.4 MB/s | 185 kB 00:00 2023-12-17T11:51:28.079 INFO:teuthology.orchestra.run.smithi186.stdout:(44/146): python3-cachetools-3.1.1-4.el8.noarch 439 kB/s | 33 kB 00:00 2023-12-17T11:51:28.162 INFO:teuthology.orchestra.run.smithi186.stdout:(45/146): python3-certifi-2018.10.15-7.el8.noar 196 kB/s | 16 kB 00:00 2023-12-17T11:51:28.237 INFO:teuthology.orchestra.run.smithi186.stdout:(46/146): python3-asyncssh-2.7.0-2.el8.noarch.r 1.0 MB/s | 476 kB 00:00 2023-12-17T11:51:28.262 INFO:teuthology.orchestra.run.smithi186.stdout:(47/146): python3-cheroot-8.5.2-1.el8.noarch.rp 1.7 MB/s | 173 kB 00:00 2023-12-17T11:51:28.421 INFO:teuthology.orchestra.run.smithi186.stdout:(48/146): python3-cherrypy-18.4.0-1.el8.noarch. 2.0 MB/s | 384 kB 00:00 2023-12-17T11:51:28.446 INFO:teuthology.orchestra.run.smithi186.stdout:(49/146): python3-google-auth-1.1.1-10.el8.noar 442 kB/s | 81 kB 00:00 2023-12-17T11:51:28.497 INFO:teuthology.orchestra.run.smithi186.stdout:(50/146): python3-jaraco-6.2-6.el8.noarch.rpm 148 kB/s | 11 kB 00:00 2023-12-17T11:51:28.522 INFO:teuthology.orchestra.run.smithi186.stdout:(51/146): python3-jaraco-functools-2.0-4.el8.no 233 kB/s | 18 kB 00:00 2023-12-17T11:51:28.549 INFO:teuthology.orchestra.run.smithi008.stdout:(6/146): ceph-mds-19.0.0-119.ga62fda73.el8.x86_ 1.1 MB/s | 2.3 MB 00:02 2023-12-17T11:51:28.606 INFO:teuthology.orchestra.run.smithi186.stdout:(52/146): python3-logutils-0.3.5-11.el8.noarch. 586 kB/s | 49 kB 00:00 2023-12-17T11:51:28.682 INFO:teuthology.orchestra.run.smithi008.stdout:(7/146): ceph-mon-19.0.0-119.ga62fda73.el8.x86_ 3.0 MB/s | 4.6 MB 00:01 2023-12-17T11:51:28.689 INFO:teuthology.orchestra.run.smithi186.stdout:(53/146): python3-kubernetes-11.0.0-6.el8.noarc 6.1 MB/s | 1.2 MB 00:00 2023-12-17T11:51:28.715 INFO:teuthology.orchestra.run.smithi186.stdout:(54/146): python3-more-itertools-7.2.0-3.el8.no 540 kB/s | 59 kB 00:00 2023-12-17T11:51:28.790 INFO:teuthology.orchestra.run.smithi186.stdout:(55/146): python3-natsort-7.1.1-2.el8.noarch.rp 601 kB/s | 60 kB 00:00 2023-12-17T11:51:28.832 INFO:teuthology.orchestra.run.smithi186.stdout:(56/146): python3-pecan-1.3.2-9.el8.noarch.rpm 2.4 MB/s | 283 kB 00:00 2023-12-17T11:51:28.866 INFO:teuthology.orchestra.run.smithi186.stdout:(57/146): python3-portend-2.6-1.el8.noarch.rpm 207 kB/s | 16 kB 00:00 2023-12-17T11:51:28.907 INFO:teuthology.orchestra.run.smithi100.stdout:(7/146): ceph-mon-19.0.0-119.ga62fda73.el8.x86_ 4.1 MB/s | 4.6 MB 00:01 2023-12-17T11:51:28.908 INFO:teuthology.orchestra.run.smithi186.stdout:(58/146): python3-repoze-lru-0.7-6.el8.noarch.r 445 kB/s | 34 kB 00:00 2023-12-17T11:51:28.941 INFO:teuthology.orchestra.run.smithi186.stdout:(59/146): python3-routes-2.4.1-12.el8.noarch.rp 2.6 MB/s | 196 kB 00:00 2023-12-17T11:51:28.983 INFO:teuthology.orchestra.run.smithi186.stdout:(60/146): python3-rsa-4.9-2.el8.noarch.rpm 855 kB/s | 64 kB 00:00 2023-12-17T11:51:29.026 INFO:teuthology.orchestra.run.smithi186.stdout:(61/146): python3-simplegeneric-0.8.1-17.el8.no 222 kB/s | 19 kB 00:00 2023-12-17T11:51:29.050 INFO:teuthology.orchestra.run.smithi008.stdout:(8/146): ceph-common-19.0.0-119.ga62fda73.el8.x 5.7 MB/s | 23 MB 00:03 2023-12-17T11:51:29.059 INFO:teuthology.orchestra.run.smithi186.stdout:(62/146): python3-singledispatch-3.4.0.3-18.el8 316 kB/s | 24 kB 00:00 2023-12-17T11:51:29.100 INFO:teuthology.orchestra.run.smithi008.stdout:(9/146): ceph-selinux-19.0.0-119.ga62fda73.el8. 490 kB/s | 24 kB 00:00 2023-12-17T11:51:29.109 INFO:teuthology.orchestra.run.smithi186.stdout:(63/146): python3-tempora-1.14.1-5.el8.noarch.r 350 kB/s | 29 kB 00:00 2023-12-17T11:51:29.176 INFO:teuthology.orchestra.run.smithi186.stdout:(64/146): python3-trustme-0.6.0-4.el8.noarch.rp 235 kB/s | 27 kB 00:00 2023-12-17T11:51:29.218 INFO:teuthology.orchestra.run.smithi186.stdout:(65/146): python3-waitress-1.4.3-1.el8.noarch.r 2.3 MB/s | 255 kB 00:00 2023-12-17T11:51:29.319 INFO:teuthology.orchestra.run.smithi186.stdout:(66/146): python3-webob-1.8.5-1.el8.1.noarch.rp 1.7 MB/s | 251 kB 00:00 2023-12-17T11:51:29.344 INFO:teuthology.orchestra.run.smithi186.stdout:(67/146): python3-websocket-client-0.56.0-5.el8 489 kB/s | 61 kB 00:00 2023-12-17T11:51:29.402 INFO:teuthology.orchestra.run.smithi186.stdout:(68/146): python3-webtest-2.0.33-1.el8.noarch.r 1.0 MB/s | 85 kB 00:00 2023-12-17T11:51:29.420 INFO:teuthology.orchestra.run.smithi186.stdout:(69/146): python3-zc-lockfile-2.0-2.el8.noarch. 304 kB/s | 23 kB 00:00 2023-12-17T11:51:29.445 INFO:teuthology.orchestra.run.smithi186.stdout:(70/146): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.8 MB/s | 70 kB 00:00 2023-12-17T11:51:29.570 INFO:teuthology.orchestra.run.smithi186.stdout:(71/146): python3-jsonpointer-1.10-11.el8.noarc 160 kB/s | 20 kB 00:00 2023-12-17T11:51:29.654 INFO:teuthology.orchestra.run.smithi186.stdout:(72/146): thrift-0.13.0-2.el8.x86_64.rpm 6.9 MB/s | 1.7 MB 00:00 2023-12-17T11:51:29.671 INFO:teuthology.orchestra.run.smithi186.stdout:(73/146): python3-prettytable-0.7.2-14.el8.noar 438 kB/s | 44 kB 00:00 2023-12-17T11:51:29.863 INFO:teuthology.orchestra.run.smithi186.stdout:(74/146): python3-jsonpatch-1.21-2.el8.noarch.r 143 kB/s | 27 kB 00:00 2023-12-17T11:51:29.923 INFO:teuthology.orchestra.run.smithi186.stdout:(75/146): python3-pyasn1-modules-0.3.7-6.el8.no 412 kB/s | 110 kB 00:00 2023-12-17T11:51:29.972 INFO:teuthology.orchestra.run.smithi186.stdout:(76/146): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.1 MB/s | 126 kB 00:00 2023-12-17T11:51:30.097 INFO:teuthology.orchestra.run.smithi186.stdout:(77/146): bison-3.0.4-10.el8.x86_64.rpm 5.4 MB/s | 688 kB 00:00 2023-12-17T11:51:30.122 INFO:teuthology.orchestra.run.smithi186.stdout:(78/146): python3-werkzeug-0.12.2-4.el8.noarch. 2.2 MB/s | 457 kB 00:00 2023-12-17T11:51:30.348 INFO:teuthology.orchestra.run.smithi186.stdout:(79/146): libtool-2.4.6-25.el8.x86_64.rpm 3.1 MB/s | 709 kB 00:00 2023-12-17T11:51:30.440 INFO:teuthology.orchestra.run.smithi186.stdout:(80/146): flex-2.6.1-9.el8.x86_64.rpm 933 kB/s | 320 kB 00:00 2023-12-17T11:51:30.465 INFO:teuthology.orchestra.run.smithi186.stdout:(81/146): python3-markupsafe-0.23-19.el8.x86_64 332 kB/s | 39 kB 00:00 2023-12-17T11:51:30.565 INFO:teuthology.orchestra.run.smithi186.stdout:(82/146): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.0 MB/s | 259 kB 00:00 2023-12-17T11:51:30.624 INFO:teuthology.orchestra.run.smithi186.stdout:(83/146): oniguruma-6.8.2-2.el8.x86_64.rpm 1.2 MB/s | 187 kB 00:00 2023-12-17T11:51:30.699 INFO:teuthology.orchestra.run.smithi186.stdout:(84/146): uuid-1.6.2-43.el8.x86_64.rpm 479 kB/s | 64 kB 00:00 2023-12-17T11:51:30.724 INFO:teuthology.orchestra.run.smithi186.stdout:(85/146): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.0 MB/s | 103 kB 00:00 2023-12-17T11:51:30.908 INFO:teuthology.orchestra.run.smithi186.stdout:(86/146): python3-babel-2.5.1-7.el8.noarch.rpm 23 MB/s | 4.8 MB 00:00 2023-12-17T11:51:30.942 INFO:teuthology.orchestra.run.smithi186.stdout:(87/146): python3-jinja2-2.10.1-3.el8.noarch.rp 2.4 MB/s | 538 kB 00:00 2023-12-17T11:51:31.134 INFO:teuthology.orchestra.run.smithi186.stdout:(88/146): python3-numpy-1.14.3-10.el8.x86_64.rp 17 MB/s | 3.7 MB 00:00 2023-12-17T11:51:31.167 INFO:teuthology.orchestra.run.smithi186.stdout:(89/146): socat-1.7.4.1-1.el8.x86_64.rpm 1.4 MB/s | 323 kB 00:00 2023-12-17T11:51:31.335 INFO:teuthology.orchestra.run.smithi186.stdout:(90/146): python3-numpy-f2py-1.14.3-10.el8.x86_ 1.1 MB/s | 225 kB 00:00 2023-12-17T11:51:31.369 INFO:teuthology.orchestra.run.smithi186.stdout:(91/146): librdkafka-0.11.4-3.el8.x86_64.rpm 1.7 MB/s | 354 kB 00:00 2023-12-17T11:51:31.433 INFO:teuthology.orchestra.run.smithi008.stdout:(10/146): ceph-radosgw-19.0.0-119.ga62fda73.el8 5.0 MB/s | 14 MB 00:02 2023-12-17T11:51:31.443 INFO:teuthology.orchestra.run.smithi186.stdout:(92/146): python3-mako-1.0.6-14.el8.noarch.rpm 2.1 MB/s | 157 kB 00:00 2023-12-17T11:51:31.491 INFO:teuthology.orchestra.run.smithi008.stdout:(11/146): cephfs-mirror-19.0.0-119.ga62fda73.el 4.4 MB/s | 262 kB 00:00 2023-12-17T11:51:31.550 INFO:teuthology.orchestra.run.smithi008.stdout:(12/146): libcephfs-devel-19.0.0-119.ga62fda73. 532 kB/s | 31 kB 00:00 2023-12-17T11:51:31.586 INFO:teuthology.orchestra.run.smithi186.stdout:(93/146): openblas-threads-0.3.15-6.el8.x86_64. 21 MB/s | 5.2 MB 00:00 2023-12-17T11:51:31.615 INFO:teuthology.orchestra.run.smithi100.stdout:(8/146): ceph-common-19.0.0-119.ga62fda73.el8.x 3.7 MB/s | 23 MB 00:06 2023-12-17T11:51:31.682 INFO:teuthology.orchestra.run.smithi100.stdout:(9/146): ceph-selinux-19.0.0-119.ga62fda73.el8. 366 kB/s | 24 kB 00:00 2023-12-17T11:51:31.700 INFO:teuthology.orchestra.run.smithi008.stdout:(13/146): libcephfs2-19.0.0-119.ga62fda73.el8.x 5.5 MB/s | 838 kB 00:00 2023-12-17T11:51:31.719 INFO:teuthology.orchestra.run.smithi186.stdout:(94/146): openblas-0.3.15-6.el8.x86_64.rpm 18 MB/s | 5.0 MB 00:00 2023-12-17T11:51:31.761 INFO:teuthology.orchestra.run.smithi186.stdout:(95/146): automake-1.16.1-8.el8.noarch.rpm 4.0 MB/s | 714 kB 00:00 2023-12-17T11:51:31.767 INFO:teuthology.orchestra.run.smithi008.stdout:(14/146): libcephsqlite-19.0.0-119.ga62fda73.el 2.7 MB/s | 183 kB 00:00 2023-12-17T11:51:31.811 INFO:teuthology.orchestra.run.smithi186.stdout:(96/146): libpq-13.11-1.el8.x86_64.rpm 2.1 MB/s | 198 kB 00:00 2023-12-17T11:51:31.835 INFO:teuthology.orchestra.run.smithi008.stdout:(15/146): librados-devel-19.0.0-119.ga62fda73.e 2.0 MB/s | 139 kB 00:00 2023-12-17T11:51:31.862 INFO:teuthology.orchestra.run.smithi186.stdout:(97/146): jq-1.6-7.el8.x86_64.rpm 2.0 MB/s | 202 kB 00:00 2023-12-17T11:51:31.912 INFO:teuthology.orchestra.run.smithi186.stdout:(98/146): python3-pytz-2017.2-11.el8.noarch.rpm 541 kB/s | 54 kB 00:00 2023-12-17T11:51:31.985 INFO:teuthology.orchestra.run.smithi008.stdout:(16/146): libradosstriper1-19.0.0-119.ga62fda73 3.4 MB/s | 517 kB 00:00 2023-12-17T11:51:32.062 INFO:teuthology.orchestra.run.smithi186.stdout:(99/146): postgresql-10.23-3.module+el8.9.0+208 7.5 MB/s | 1.5 MB 00:00 2023-12-17T11:51:32.196 INFO:teuthology.orchestra.run.smithi186.stdout:(100/146): postgresql-contrib-10.23-3.module+el 2.8 MB/s | 811 kB 00:00 2023-12-17T11:51:32.299 INFO:teuthology.orchestra.run.smithi100.stdout:(10/146): ceph-radosgw-19.0.0-119.ga62fda73.el8 4.1 MB/s | 14 MB 00:03 2023-12-17T11:51:32.338 INFO:teuthology.orchestra.run.smithi186.stdout:(101/146): postgresql-server-10.23-3.module+el8 18 MB/s | 5.1 MB 00:00 2023-12-17T11:51:32.441 INFO:teuthology.orchestra.run.smithi100.stdout:(11/146): cephfs-mirror-19.0.0-119.ga62fda73.el 1.8 MB/s | 262 kB 00:00 2023-12-17T11:51:32.472 INFO:teuthology.orchestra.run.smithi186.stdout:(102/146): libverto-devel-0.3.0-5.el8.x86_64.rp 134 kB/s | 18 kB 00:00 2023-12-17T11:51:32.516 INFO:teuthology.orchestra.run.smithi100.stdout:(12/146): libcephfs-devel-19.0.0-119.ga62fda73. 413 kB/s | 31 kB 00:00 2023-12-17T11:51:32.580 INFO:teuthology.orchestra.run.smithi186.stdout:(103/146): python3-jwt-1.6.1-2.el8.noarch.rpm 394 kB/s | 43 kB 00:00 2023-12-17T11:51:32.706 INFO:teuthology.orchestra.run.smithi186.stdout:(104/146): python3-oauthlib-2.1.0-1.el8.noarch. 1.2 MB/s | 155 kB 00:00 2023-12-17T11:51:32.856 INFO:teuthology.orchestra.run.smithi186.stdout:(105/146): python3-scipy-1.0.0-21.module+el8.9. 21 MB/s | 14 MB 00:00 2023-12-17T11:51:32.858 INFO:teuthology.orchestra.run.smithi100.stdout:(13/146): ceph-osd-19.0.0-119.ga62fda73.el8.x86 3.7 MB/s | 18 MB 00:04 2023-12-17T11:51:32.881 INFO:teuthology.orchestra.run.smithi186.stdout:(106/146): python3-pycparser-2.14-14.el8.noarch 624 kB/s | 109 kB 00:00 2023-12-17T11:51:32.900 INFO:teuthology.orchestra.run.smithi100.stdout:(14/146): libcephfs2-19.0.0-119.ga62fda73.el8.x 2.1 MB/s | 838 kB 00:00 2023-12-17T11:51:32.933 INFO:teuthology.orchestra.run.smithi100.stdout:(15/146): libcephsqlite-19.0.0-119.ga62fda73.el 2.4 MB/s | 183 kB 00:00 2023-12-17T11:51:32.965 INFO:teuthology.orchestra.run.smithi186.stdout:(107/146): python3-requests-oauthlib-1.0.0-1.el 395 kB/s | 43 kB 00:00 2023-12-17T11:51:32.984 INFO:teuthology.orchestra.run.smithi100.stdout:(16/146): librados-devel-19.0.0-119.ga62fda73.e 1.6 MB/s | 139 kB 00:00 2023-12-17T11:51:32.990 INFO:teuthology.orchestra.run.smithi186.stdout:(108/146): libaio-devel-0.3.112-1.el8.x86_64.rp 172 kB/s | 19 kB 00:00 2023-12-17T11:51:33.026 INFO:teuthology.orchestra.run.smithi008.stdout:(17/146): librgw2-19.0.0-119.ga62fda73.el8.x86_ 6.6 MB/s | 6.9 MB 00:01 2023-12-17T11:51:33.076 INFO:teuthology.orchestra.run.smithi100.stdout:(17/146): libradosstriper1-19.0.0-119.ga62fda73 3.6 MB/s | 517 kB 00:00 2023-12-17T11:51:33.082 INFO:teuthology.orchestra.run.smithi186.stdout:(109/146): libzstd-devel-1.4.4-1.el8.x86_64.rpm 375 kB/s | 44 kB 00:00 2023-12-17T11:51:33.102 INFO:teuthology.orchestra.run.smithi008.stdout:(18/146): python3-ceph-argparse-19.0.0-119.ga62 596 kB/s | 45 kB 00:00 2023-12-17T11:51:33.159 INFO:teuthology.orchestra.run.smithi100.stdout:(18/146): python3-ceph-argparse-19.0.0-119.ga62 534 kB/s | 45 kB 00:00 2023-12-17T11:51:33.182 INFO:teuthology.orchestra.run.smithi186.stdout:(110/146): pcre2-devel-10.32-2.el8.x86_64.rpm 3.1 MB/s | 605 kB 00:00 2023-12-17T11:51:33.202 INFO:teuthology.orchestra.run.smithi008.stdout:(19/146): python3-ceph-common-19.0.0-119.ga62fd 1.3 MB/s | 129 kB 00:00 2023-12-17T11:51:33.226 INFO:teuthology.orchestra.run.smithi100.stdout:(19/146): python3-ceph-common-19.0.0-119.ga62fd 1.9 MB/s | 129 kB 00:00 2023-12-17T11:51:33.266 INFO:teuthology.orchestra.run.smithi186.stdout:(111/146): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.2 MB/s | 229 kB 00:00 2023-12-17T11:51:33.277 INFO:teuthology.orchestra.run.smithi008.stdout:(20/146): python3-cephfs-19.0.0-119.ga62fda73.e 2.6 MB/s | 197 kB 00:00 2023-12-17T11:51:33.302 INFO:teuthology.orchestra.run.smithi100.stdout:(20/146): python3-cephfs-19.0.0-119.ga62fda73.e 2.6 MB/s | 197 kB 00:00 2023-12-17T11:51:33.341 INFO:teuthology.orchestra.run.smithi186.stdout:(112/146): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.4 MB/s | 220 kB 00:00 2023-12-17T11:51:33.376 INFO:teuthology.orchestra.run.smithi186.stdout:(113/146): libselinux-devel-2.9-5.el8.x86_64.rp 1.8 MB/s | 200 kB 00:00 2023-12-17T11:51:33.411 INFO:teuthology.orchestra.run.smithi008.stdout:(21/146): python3-rados-19.0.0-119.ga62fda73.el 2.7 MB/s | 371 kB 00:00 2023-12-17T11:51:33.435 INFO:teuthology.orchestra.run.smithi100.stdout:(21/146): python3-rados-19.0.0-119.ga62fda73.el 2.7 MB/s | 371 kB 00:00 2023-12-17T11:51:33.478 INFO:teuthology.orchestra.run.smithi008.stdout:(22/146): python3-rbd-19.0.0-119.ga62fda73.el8. 5.4 MB/s | 364 kB 00:00 2023-12-17T11:51:33.554 INFO:teuthology.orchestra.run.smithi008.stdout:(23/146): python3-rgw-19.0.0-119.ga62fda73.el8. 1.4 MB/s | 107 kB 00:00 2023-12-17T11:51:33.569 INFO:teuthology.orchestra.run.smithi100.stdout:(22/146): python3-rbd-19.0.0-119.ga62fda73.el8. 2.7 MB/s | 364 kB 00:00 2023-12-17T11:51:33.604 INFO:teuthology.orchestra.run.smithi008.stdout:(24/146): rbd-fuse-19.0.0-119.ga62fda73.el8.x86 1.8 MB/s | 93 kB 00:00 2023-12-17T11:51:33.636 INFO:teuthology.orchestra.run.smithi100.stdout:(23/146): python3-rgw-19.0.0-119.ga62fda73.el8. 1.6 MB/s | 107 kB 00:00 2023-12-17T11:51:33.725 INFO:teuthology.orchestra.run.smithi186.stdout:(114/146): keyutils-libs-devel-1.5.10-9.el8.x86 126 kB/s | 48 kB 00:00 2023-12-17T11:51:33.727 INFO:teuthology.orchestra.run.smithi100.stdout:(24/146): rbd-fuse-19.0.0-119.ga62fda73.el8.x86 1.0 MB/s | 93 kB 00:00 2023-12-17T11:51:33.751 INFO:teuthology.orchestra.run.smithi186.stdout:(115/146): libsepol-devel-2.9-3.el8.x86_64.rpm 231 kB/s | 87 kB 00:00 2023-12-17T11:51:33.843 INFO:teuthology.orchestra.run.smithi186.stdout:(116/146): libcom_err-devel-1.45.6-4.el8.x86_64 423 kB/s | 39 kB 00:00 2023-12-17T11:51:33.868 INFO:teuthology.orchestra.run.smithi186.stdout:(117/146): zlib-devel-1.2.11-18.el8_5.x86_64.rp 404 kB/s | 58 kB 00:00 2023-12-17T11:51:33.960 INFO:teuthology.orchestra.run.smithi186.stdout:(118/146): openssl-devel-1.1.1k-9.el8_7.x86_64. 20 MB/s | 2.3 MB 00:00 2023-12-17T11:51:33.985 INFO:teuthology.orchestra.run.smithi186.stdout:(119/146): fuse-2.9.7-17.el8.x86_64.rpm 710 kB/s | 83 kB 00:00 2023-12-17T11:51:34.120 INFO:teuthology.orchestra.run.smithi186.stdout:(120/146): libgfortran-8.5.0-20.el8.x86_64.rpm 3.9 MB/s | 645 kB 00:00 2023-12-17T11:51:34.153 INFO:teuthology.orchestra.run.smithi186.stdout:(121/146): libquadmath-8.5.0-20.el8.x86_64.rpm 1.0 MB/s | 172 kB 00:00 2023-12-17T11:51:34.237 INFO:teuthology.orchestra.run.smithi008.stdout:(25/146): rbd-mirror-19.0.0-119.ga62fda73.el8.x 5.7 MB/s | 3.6 MB 00:00 2023-12-17T11:51:34.287 INFO:teuthology.orchestra.run.smithi186.stdout:(122/146): libuuid-devel-2.32.1-43.el8.x86_64.r 601 kB/s | 100 kB 00:00 2023-12-17T11:51:34.320 INFO:teuthology.orchestra.run.smithi186.stdout:(123/146): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.4 MB/s | 238 kB 00:00 2023-12-17T11:51:34.321 INFO:teuthology.orchestra.run.smithi008.stdout:(26/146): rbd-nbd-19.0.0-119.ga62fda73.el8.x86_ 2.1 MB/s | 181 kB 00:00 2023-12-17T11:51:34.388 INFO:teuthology.orchestra.run.smithi008.stdout:(27/146): ceph-grafana-dashboards-19.0.0-119.ga 422 kB/s | 28 kB 00:00 2023-12-17T11:51:34.412 INFO:teuthology.orchestra.run.smithi186.stdout:(124/146): python3-cryptography-3.2.1-6.el8.x86 4.4 MB/s | 559 kB 00:00 2023-12-17T11:51:34.471 INFO:teuthology.orchestra.run.smithi008.stdout:(28/146): ceph-mgr-cephadm-19.0.0-119.ga62fda73 1.6 MB/s | 133 kB 00:00 2023-12-17T11:51:34.512 INFO:teuthology.orchestra.run.smithi186.stdout:(125/146): xfsprogs-devel-5.0.0-12.el8.x86_64.r 378 kB/s | 73 kB 00:00 2023-12-17T11:51:34.546 INFO:teuthology.orchestra.run.smithi186.stdout:(126/146): NetworkManager-initscripts-updown-1. 1.1 MB/s | 143 kB 00:00 2023-12-17T11:51:34.603 INFO:teuthology.orchestra.run.smithi100.stdout:(25/146): librgw2-19.0.0-119.ga62fda73.el8.x86_ 4.3 MB/s | 6.9 MB 00:01 2023-12-17T11:51:34.621 INFO:teuthology.orchestra.run.smithi186.stdout:(127/146): elfutils-libelf-devel-0.189-3.el8.x8 570 kB/s | 62 kB 00:00 2023-12-17T11:51:34.680 INFO:teuthology.orchestra.run.smithi186.stdout:(128/146): librabbitmq-0.9.0-4.el8.x86_64.rpm 352 kB/s | 47 kB 00:00 2023-12-17T11:51:34.687 INFO:teuthology.orchestra.run.smithi100.stdout:(26/146): rbd-nbd-19.0.0-119.ga62fda73.el8.x86_ 2.1 MB/s | 181 kB 00:00 2023-12-17T11:51:34.753 INFO:teuthology.orchestra.run.smithi100.stdout:(27/146): rbd-mirror-19.0.0-119.ga62fda73.el8.x 3.5 MB/s | 3.6 MB 00:01 2023-12-17T11:51:34.779 INFO:teuthology.orchestra.run.smithi100.stdout:(28/146): ceph-grafana-dashboards-19.0.0-119.ga 305 kB/s | 28 kB 00:00 2023-12-17T11:51:34.788 INFO:teuthology.orchestra.run.smithi008.stdout:(29/146): ceph-mgr-dashboard-19.0.0-119.ga62fda 5.6 MB/s | 1.8 MB 00:00 2023-12-17T11:51:34.797 INFO:teuthology.orchestra.run.smithi186.stdout:(129/146): krb5-devel-1.18.2-26.el8_9.x86_64.rp 3.1 MB/s | 562 kB 00:00 2023-12-17T11:51:34.804 INFO:teuthology.orchestra.run.smithi100.stdout:(29/146): ceph-mgr-cephadm-19.0.0-119.ga62fda73 2.6 MB/s | 133 kB 00:00 2023-12-17T11:51:35.354 INFO:teuthology.orchestra.run.smithi100.stdout:(30/146): ceph-mgr-dashboard-19.0.0-119.ga62fda 3.1 MB/s | 1.8 MB 00:00 2023-12-17T11:51:35.463 INFO:teuthology.orchestra.run.smithi100.stdout:(31/146): ceph-mgr-modules-core-19.0.0-119.ga62 2.2 MB/s | 243 kB 00:00 2023-12-17T11:51:35.555 INFO:teuthology.orchestra.run.smithi100.stdout:(32/146): ceph-mgr-rook-19.0.0-119.ga62fda73.el 545 kB/s | 50 kB 00:00 2023-12-17T11:51:35.589 INFO:teuthology.orchestra.run.smithi008.stdout:(30/146): ceph-test-19.0.0-119.ga62fda73.el8.x8 7.6 MB/s | 49 MB 00:06 2023-12-17T11:51:35.647 INFO:teuthology.orchestra.run.smithi100.stdout:(33/146): ceph-prometheus-alerts-19.0.0-119.ga6 164 kB/s | 15 kB 00:00 2023-12-17T11:51:35.689 INFO:teuthology.orchestra.run.smithi186.stdout:(130/146): librbd1-19.0.0-119.ga62fda73.el8.x86 4.2 MB/s | 3.7 MB 00:00 2023-12-17T11:51:35.739 INFO:teuthology.orchestra.run.smithi008.stdout:(31/146): ceph-mgr-modules-core-19.0.0-119.ga62 1.6 MB/s | 243 kB 00:00 2023-12-17T11:51:35.748 INFO:teuthology.orchestra.run.smithi186.stdout:(131/146): librados2-19.0.0-119.ga62fda73.el8.x 3.5 MB/s | 3.8 MB 00:01 2023-12-17T11:51:35.772 INFO:teuthology.orchestra.run.smithi100.stdout:(34/146): ceph-volume-19.0.0-119.ga62fda73.el8. 2.0 MB/s | 262 kB 00:00 2023-12-17T11:51:35.806 INFO:teuthology.orchestra.run.smithi186.stdout:(132/146): openssl-1.1.1k-9.el8_7.x86_64.rpm 6.0 MB/s | 710 kB 00:00 2023-12-17T11:51:35.814 INFO:teuthology.orchestra.run.smithi008.stdout:(32/146): ceph-mgr-rook-19.0.0-119.ga62fda73.el 670 kB/s | 50 kB 00:00 2023-12-17T11:51:35.873 INFO:teuthology.orchestra.run.smithi186.stdout:(133/146): openssl-libs-1.1.1k-9.el8_7.x86_64.r 12 MB/s | 1.5 MB 00:00 2023-12-17T11:51:35.898 INFO:teuthology.orchestra.run.smithi100.stdout:(35/146): cephadm-19.0.0-119.ga62fda73.el8.noar 3.2 MB/s | 415 kB 00:00 2023-12-17T11:51:35.898 INFO:teuthology.orchestra.run.smithi008.stdout:(33/146): ceph-prometheus-alerts-19.0.0-119.ga6 180 kB/s | 15 kB 00:00 2023-12-17T11:51:35.956 INFO:teuthology.orchestra.run.smithi100.stdout:(36/146): cephfs-top-19.0.0-119.ga62fda73.el8.n 312 kB/s | 18 kB 00:00 2023-12-17T11:51:35.973 INFO:teuthology.orchestra.run.smithi008.stdout:(34/146): ceph-volume-19.0.0-119.ga62fda73.el8. 3.4 MB/s | 262 kB 00:00 2023-12-17T11:51:36.057 INFO:teuthology.orchestra.run.smithi186.stdout:(134/146): elfutils-libelf-0.189-3.el8.x86_64.r 927 kB/s | 232 kB 00:00 2023-12-17T11:51:36.115 INFO:teuthology.orchestra.run.smithi186.stdout:(135/146): elfutils-libs-0.189-3.el8.x86_64.rpm 1.2 MB/s | 303 kB 00:00 2023-12-17T11:51:36.199 INFO:teuthology.orchestra.run.smithi186.stdout:(136/146): libmount-2.32.1-43.el8.x86_64.rpm 1.6 MB/s | 237 kB 00:00 2023-12-17T11:51:36.224 INFO:teuthology.orchestra.run.smithi186.stdout:(137/146): libsmartcols-2.32.1-43.el8.x86_64.rp 1.6 MB/s | 179 kB 00:00 2023-12-17T11:51:36.306 INFO:teuthology.orchestra.run.smithi100.stdout:(37/146): gperftools-libs-2.7-9.el8.x86_64.rpm 875 kB/s | 306 kB 00:00 2023-12-17T11:51:36.406 INFO:teuthology.orchestra.run.smithi100.stdout:(38/146): ceph-mgr-diskprediction-local-19.0.0- 4.6 MB/s | 7.4 MB 00:01 2023-12-17T11:51:36.418 INFO:teuthology.orchestra.run.smithi186.stdout:(138/146): libuuid-2.32.1-43.el8.x86_64.rpm 451 kB/s | 99 kB 00:00 2023-12-17T11:51:36.432 INFO:teuthology.orchestra.run.smithi100.stdout:(39/146): liboath-2.6.2-3.el8.x86_64.rpm 470 kB/s | 59 kB 00:00 2023-12-17T11:51:36.467 INFO:teuthology.orchestra.run.smithi008.stdout:(35/146): ceph-mgr-diskprediction-local-19.0.0- 4.4 MB/s | 7.4 MB 00:01 2023-12-17T11:51:36.499 INFO:teuthology.orchestra.run.smithi008.stdout:(36/146): cephadm-19.0.0-119.ga62fda73.el8.noar 791 kB/s | 415 kB 00:00 2023-12-17T11:51:36.508 INFO:teuthology.orchestra.run.smithi186.stdout:(139/146): util-linux-2.32.1-43.el8.x86_64.rpm 8.7 MB/s | 2.5 MB 00:00 2023-12-17T11:51:36.524 INFO:teuthology.orchestra.run.smithi008.stdout:(37/146): cephfs-top-19.0.0-119.ga62fda73.el8.n 321 kB/s | 18 kB 00:00 2023-12-17T11:51:36.534 INFO:teuthology.orchestra.run.smithi186.stdout:(140/146): util-linux-user-2.32.1-43.el8.x86_64 894 kB/s | 103 kB 00:00 2023-12-17T11:51:36.549 INFO:teuthology.orchestra.run.smithi100.stdout:(40/146): luarocks-3.5.0-1.el8.noarch.rpm 1.4 MB/s | 167 kB 00:00 2023-12-17T11:51:36.682 INFO:teuthology.orchestra.run.smithi100.stdout:(41/146): libunwind-1.3.1-3.el8.x86_64.rpm 272 kB/s | 75 kB 00:00 2023-12-17T11:51:36.684 INFO:teuthology.orchestra.run.smithi186.stdout:(141/146): xfsdump-3.1.8-6.el8.x86_64.rpm 1.9 MB/s | 333 kB 00:00 2023-12-17T11:51:36.726 INFO:teuthology.orchestra.run.smithi186.stdout:(142/146): iproute-6.2.0-5.el8_9.x86_64.rpm 4.3 MB/s | 854 kB 00:00 2023-12-17T11:51:36.741 INFO:teuthology.orchestra.run.smithi100.stdout:(42/146): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 753 kB/s | 44 kB 00:00 2023-12-17T11:51:36.826 INFO:teuthology.orchestra.run.smithi186.stdout:(143/146): libblkid-2.32.1-43.el8.x86_64.rpm 1.5 MB/s | 220 kB 00:00 2023-12-17T11:51:36.860 INFO:teuthology.orchestra.run.smithi186.stdout:(144/146): libfdisk-2.32.1-43.el8.x86_64.rpm 1.9 MB/s | 254 kB 00:00 2023-12-17T11:51:36.866 INFO:teuthology.orchestra.run.smithi100.stdout:(43/146): python3-asyncssh-2.7.0-2.el8.noarch.r 1.5 MB/s | 476 kB 00:00 2023-12-17T11:51:36.875 INFO:teuthology.orchestra.run.smithi008.stdout:(38/146): liboath-2.6.2-3.el8.x86_64.rpm 168 kB/s | 59 kB 00:00 2023-12-17T11:51:36.891 INFO:teuthology.orchestra.run.smithi100.stdout:(44/146): python3-beautifulsoup4-4.6.3-2.el8.1. 1.2 MB/s | 185 kB 00:00 2023-12-17T11:51:36.910 INFO:teuthology.orchestra.run.smithi186.stdout:(145/146): xfsprogs-5.0.0-12.el8.x86_64.rpm 13 MB/s | 1.1 MB 00:00 2023-12-17T11:51:36.933 INFO:teuthology.orchestra.run.smithi100.stdout:(45/146): python3-cachetools-3.1.1-4.el8.noarch 492 kB/s | 33 kB 00:00 2023-12-17T11:51:36.967 INFO:teuthology.orchestra.run.smithi100.stdout:(46/146): python3-certifi-2018.10.15-7.el8.noar 216 kB/s | 16 kB 00:00 2023-12-17T11:51:37.075 INFO:teuthology.orchestra.run.smithi008.stdout:(39/146): libunwind-1.3.1-3.el8.x86_64.rpm 376 kB/s | 75 kB 00:00 2023-12-17T11:51:37.110 INFO:teuthology.orchestra.run.smithi100.stdout:(47/146): python3-cheroot-8.5.2-1.el8.noarch.rp 984 kB/s | 173 kB 00:00 2023-12-17T11:51:37.234 INFO:teuthology.orchestra.run.smithi008.stdout:(40/146): gperftools-libs-2.7-9.el8.x86_64.rpm 417 kB/s | 306 kB 00:00 2023-12-17T11:51:37.234 INFO:teuthology.orchestra.run.smithi100.stdout:(48/146): python3-google-auth-1.1.1-10.el8.noar 651 kB/s | 81 kB 00:00 2023-12-17T11:51:37.318 INFO:teuthology.orchestra.run.smithi100.stdout:(49/146): python3-jaraco-6.2-6.el8.noarch.rpm 133 kB/s | 11 kB 00:00 2023-12-17T11:51:37.343 INFO:teuthology.orchestra.run.smithi100.stdout:(50/146): python3-cherrypy-18.4.0-1.el8.noarch. 1.0 MB/s | 384 kB 00:00 2023-12-17T11:51:37.384 INFO:teuthology.orchestra.run.smithi008.stdout:(41/146): luarocks-3.5.0-1.el8.noarch.rpm 541 kB/s | 167 kB 00:00 2023-12-17T11:51:37.402 INFO:teuthology.orchestra.run.smithi100.stdout:(51/146): python3-jaraco-functools-2.0-4.el8.no 210 kB/s | 18 kB 00:00 2023-12-17T11:51:37.486 INFO:teuthology.orchestra.run.smithi100.stdout:(52/146): python3-logutils-0.3.5-11.el8.noarch. 585 kB/s | 49 kB 00:00 2023-12-17T11:51:37.518 INFO:teuthology.orchestra.run.smithi008.stdout:(42/146): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 327 kB/s | 44 kB 00:00 2023-12-17T11:51:37.569 INFO:teuthology.orchestra.run.smithi100.stdout:(53/146): python3-more-itertools-7.2.0-3.el8.no 705 kB/s | 59 kB 00:00 2023-12-17T11:51:37.661 INFO:teuthology.orchestra.run.smithi100.stdout:(54/146): python3-natsort-7.1.1-2.el8.noarch.rp 657 kB/s | 60 kB 00:00 2023-12-17T11:51:37.868 INFO:teuthology.orchestra.run.smithi008.stdout:(43/146): python3-beautifulsoup4-4.6.3-2.el8.1. 530 kB/s | 185 kB 00:00 2023-12-17T11:51:37.902 INFO:teuthology.orchestra.run.smithi008.stdout:(44/146): python3-asyncssh-2.7.0-2.el8.noarch.r 713 kB/s | 476 kB 00:00 2023-12-17T11:51:37.978 INFO:teuthology.orchestra.run.smithi100.stdout:(55/146): python3-pecan-1.3.2-9.el8.noarch.rpm 894 kB/s | 283 kB 00:00 2023-12-17T11:51:38.010 INFO:teuthology.orchestra.run.smithi008.stdout:(45/146): python3-cachetools-3.1.1-4.el8.noarch 232 kB/s | 33 kB 00:00 2023-12-17T11:51:38.036 INFO:teuthology.orchestra.run.smithi008.stdout:(46/146): python3-certifi-2018.10.15-7.el8.noar 122 kB/s | 16 kB 00:00 2023-12-17T11:51:38.070 INFO:teuthology.orchestra.run.smithi100.stdout:(56/146): python3-portend-2.6-1.el8.noarch.rpm 171 kB/s | 16 kB 00:00 2023-12-17T11:51:38.162 INFO:teuthology.orchestra.run.smithi100.stdout:(57/146): python3-repoze-lru-0.7-6.el8.noarch.r 367 kB/s | 34 kB 00:00 2023-12-17T11:51:38.244 INFO:teuthology.orchestra.run.smithi008.stdout:(47/146): python3-cheroot-8.5.2-1.el8.noarch.rp 739 kB/s | 173 kB 00:00 2023-12-17T11:51:38.354 INFO:teuthology.orchestra.run.smithi100.stdout:(58/146): python3-routes-2.4.1-12.el8.noarch.rp 1.0 MB/s | 196 kB 00:00 2023-12-17T11:51:38.378 INFO:teuthology.orchestra.run.smithi008.stdout:(48/146): python3-google-auth-1.1.1-10.el8.noar 611 kB/s | 81 kB 00:00 2023-12-17T11:51:38.429 INFO:teuthology.orchestra.run.smithi100.stdout:(59/146): python3-rsa-4.9-2.el8.noarch.rpm 857 kB/s | 64 kB 00:00 2023-12-17T11:51:38.488 INFO:teuthology.orchestra.run.smithi100.stdout:(60/146): python3-simplegeneric-0.8.1-17.el8.no 321 kB/s | 19 kB 00:00 2023-12-17T11:51:38.493 INFO:teuthology.orchestra.run.smithi008.stdout:(49/146): python3-cherrypy-18.4.0-1.el8.noarch. 841 kB/s | 384 kB 00:00 2023-12-17T11:51:38.528 INFO:teuthology.orchestra.run.smithi008.stdout:(50/146): python3-jaraco-6.2-6.el8.noarch.rpm 74 kB/s | 11 kB 00:00 2023-12-17T11:51:38.547 INFO:teuthology.orchestra.run.smithi100.stdout:(61/146): python3-singledispatch-3.4.0.3-18.el8 412 kB/s | 24 kB 00:00 2023-12-17T11:51:38.581 INFO:teuthology.orchestra.run.smithi100.stdout:(62/146): python3-kubernetes-11.0.0-6.el8.noarc 965 kB/s | 1.2 MB 00:01 2023-12-17T11:51:38.604 INFO:teuthology.orchestra.run.smithi008.stdout:(51/146): python3-jaraco-functools-2.0-4.el8.no 160 kB/s | 18 kB 00:00 2023-12-17T11:51:38.605 INFO:teuthology.orchestra.run.smithi100.stdout:(63/146): python3-tempora-1.14.1-5.el8.noarch.r 501 kB/s | 29 kB 00:00 2023-12-17T11:51:38.639 INFO:teuthology.orchestra.run.smithi100.stdout:(64/146): python3-trustme-0.6.0-4.el8.noarch.rp 473 kB/s | 27 kB 00:00 2023-12-17T11:51:38.712 INFO:teuthology.orchestra.run.smithi008.stdout:(52/146): python3-logutils-0.3.5-11.el8.noarch. 451 kB/s | 49 kB 00:00 2023-12-17T11:51:38.798 INFO:teuthology.orchestra.run.smithi100.stdout:(65/146): python3-waitress-1.4.3-1.el8.noarch.r 1.3 MB/s | 255 kB 00:00 2023-12-17T11:51:38.823 INFO:teuthology.orchestra.run.smithi100.stdout:(66/146): python3-webob-1.8.5-1.el8.1.noarch.rp 1.3 MB/s | 251 kB 00:00 2023-12-17T11:51:38.857 INFO:teuthology.orchestra.run.smithi100.stdout:(67/146): python3-websocket-client-0.56.0-5.el8 1.0 MB/s | 61 kB 00:00 2023-12-17T11:51:38.946 INFO:teuthology.orchestra.run.smithi008.stdout:(53/146): ceph-osd-19.0.0-119.ga62fda73.el8.x86 1.7 MB/s | 18 MB 00:10 2023-12-17T11:51:38.971 INFO:teuthology.orchestra.run.smithi008.stdout:(54/146): python3-more-itertools-7.2.0-3.el8.no 227 kB/s | 59 kB 00:00 2023-12-17T11:51:39.174 INFO:teuthology.orchestra.run.smithi100.stdout:(68/146): python3-zc-lockfile-2.0-2.el8.noarch. 72 kB/s | 23 kB 00:00 2023-12-17T11:51:39.200 INFO:teuthology.orchestra.run.smithi100.stdout:(69/146): python3-webtest-2.0.33-1.el8.noarch.r 227 kB/s | 85 kB 00:00 2023-12-17T11:51:39.225 INFO:teuthology.orchestra.run.smithi100.stdout:(70/146): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.8 MB/s | 70 kB 00:00 2023-12-17T11:51:39.246 INFO:teuthology.orchestra.run.smithi008.stdout:(55/146): python3-pecan-1.3.2-9.el8.noarch.rpm 1.0 MB/s | 283 kB 00:00 2023-12-17T11:51:39.313 INFO:teuthology.orchestra.run.smithi008.stdout:(56/146): python3-natsort-7.1.1-2.el8.noarch.rp 164 kB/s | 60 kB 00:00 2023-12-17T11:51:39.355 INFO:teuthology.orchestra.run.smithi008.stdout:(57/146): python3-portend-2.6-1.el8.noarch.rpm 144 kB/s | 16 kB 00:00 2023-12-17T11:51:39.422 INFO:teuthology.orchestra.run.smithi008.stdout:(58/146): python3-repoze-lru-0.7-6.el8.noarch.r 310 kB/s | 34 kB 00:00 2023-12-17T11:51:39.497 INFO:teuthology.orchestra.run.smithi008.stdout:(59/146): python3-kubernetes-11.0.0-6.el8.noarc 1.2 MB/s | 1.2 MB 00:00 2023-12-17T11:51:39.531 INFO:teuthology.orchestra.run.smithi008.stdout:(60/146): python3-rsa-4.9-2.el8.noarch.rpm 590 kB/s | 64 kB 00:00 2023-12-17T11:51:39.598 INFO:teuthology.orchestra.run.smithi008.stdout:(61/146): python3-routes-2.4.1-12.el8.noarch.rp 810 kB/s | 196 kB 00:00 2023-12-17T11:51:39.623 INFO:teuthology.orchestra.run.smithi008.stdout:(62/146): python3-simplegeneric-0.8.1-17.el8.no 149 kB/s | 19 kB 00:00 2023-12-17T11:51:39.641 INFO:teuthology.orchestra.run.smithi008.stdout:(63/146): python3-singledispatch-3.4.0.3-18.el8 220 kB/s | 24 kB 00:00 2023-12-17T11:51:39.691 INFO:teuthology.orchestra.run.smithi008.stdout:(64/146): python3-tempora-1.14.1-5.el8.noarch.r 317 kB/s | 29 kB 00:00 2023-12-17T11:51:39.716 INFO:teuthology.orchestra.run.smithi008.stdout:(65/146): python3-trustme-0.6.0-4.el8.noarch.rp 299 kB/s | 27 kB 00:00 2023-12-17T11:51:39.717 INFO:teuthology.orchestra.run.smithi100.stdout:(71/146): ceph-test-19.0.0-119.ga62fda73.el8.x8 6.1 MB/s | 49 MB 00:08 2023-12-17T11:51:39.750 INFO:teuthology.orchestra.run.smithi100.stdout:(72/146): libverto-devel-0.3.0-5.el8.x86_64.rpm 34 kB/s | 18 kB 00:00 2023-12-17T11:51:39.824 INFO:teuthology.orchestra.run.smithi008.stdout:(66/146): python3-websocket-client-0.56.0-5.el8 565 kB/s | 61 kB 00:00 2023-12-17T11:51:39.850 INFO:teuthology.orchestra.run.smithi008.stdout:(67/146): python3-waitress-1.4.3-1.el8.noarch.r 1.2 MB/s | 255 kB 00:00 2023-12-17T11:51:39.892 INFO:teuthology.orchestra.run.smithi008.stdout:(68/146): python3-webob-1.8.5-1.el8.1.noarch.rp 1.2 MB/s | 251 kB 00:00 2023-12-17T11:51:39.893 INFO:teuthology.orchestra.run.smithi100.stdout:(73/146): thrift-0.13.0-2.el8.x86_64.rpm 2.4 MB/s | 1.7 MB 00:00 2023-12-17T11:51:39.918 INFO:teuthology.orchestra.run.smithi100.stdout:(74/146): python3-jwt-1.6.1-2.el8.noarch.rpm 213 kB/s | 43 kB 00:00 2023-12-17T11:51:39.933 INFO:teuthology.orchestra.run.smithi008.stdout:(69/146): python3-webtest-2.0.33-1.el8.noarch.r 786 kB/s | 85 kB 00:00 2023-12-17T11:51:39.951 INFO:teuthology.orchestra.run.smithi100.stdout:(75/146): python3-oauthlib-2.1.0-1.el8.noarch.r 795 kB/s | 155 kB 00:00 2023-12-17T11:51:39.958 INFO:teuthology.orchestra.run.smithi008.stdout:(70/146): python3-zc-lockfile-2.0-2.el8.noarch. 211 kB/s | 23 kB 00:00 2023-12-17T11:51:39.984 INFO:teuthology.orchestra.run.smithi008.stdout:(71/146): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.3 MB/s | 70 kB 00:00 2023-12-17T11:51:40.102 INFO:teuthology.orchestra.run.smithi100.stdout:(76/146): python3-pycparser-2.14-14.el8.noarch. 523 kB/s | 109 kB 00:00 2023-12-17T11:51:40.143 INFO:teuthology.orchestra.run.smithi008.stdout:(72/146): python3-jwt-1.6.1-2.el8.noarch.rpm 271 kB/s | 43 kB 00:00 2023-12-17T11:51:40.168 INFO:teuthology.orchestra.run.smithi008.stdout:(73/146): libverto-devel-0.3.0-5.el8.x86_64.rpm 85 kB/s | 18 kB 00:00 2023-12-17T11:51:40.185 INFO:teuthology.orchestra.run.smithi100.stdout:(77/146): libaio-devel-0.3.112-1.el8.x86_64.rpm 80 kB/s | 19 kB 00:00 2023-12-17T11:51:40.219 INFO:teuthology.orchestra.run.smithi100.stdout:(78/146): python3-requests-oauthlib-1.0.0-1.el8 145 kB/s | 43 kB 00:00 2023-12-17T11:51:40.244 INFO:teuthology.orchestra.run.smithi100.stdout:(79/146): libzstd-devel-1.4.4-1.el8.x86_64.rpm 309 kB/s | 44 kB 00:00 2023-12-17T11:51:40.285 INFO:teuthology.orchestra.run.smithi008.stdout:(74/146): python3-oauthlib-2.1.0-1.el8.noarch.r 1.1 MB/s | 155 kB 00:00 2023-12-17T11:51:40.310 INFO:teuthology.orchestra.run.smithi008.stdout:(75/146): python3-pycparser-2.14-14.el8.noarch. 770 kB/s | 109 kB 00:00 2023-12-17T11:51:40.327 INFO:teuthology.orchestra.run.smithi100.stdout:(80/146): pcre2-devel-10.32-2.el8.x86_64.rpm 4.1 MB/s | 605 kB 00:00 2023-12-17T11:51:40.353 INFO:teuthology.orchestra.run.smithi100.stdout:(81/146): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.7 MB/s | 229 kB 00:00 2023-12-17T11:51:40.360 INFO:teuthology.orchestra.run.smithi186.stdout:(146/146): ceph-test-19.0.0-119.ga62fda73.el8.x 3.1 MB/s | 49 MB 00:15 2023-12-17T11:51:40.364 INFO:teuthology.orchestra.run.smithi186.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:51:40.364 INFO:teuthology.orchestra.run.smithi186.stdout:Total 12 MB/s | 218 MB 00:18 2023-12-17T11:51:40.378 INFO:teuthology.orchestra.run.smithi100.stdout:(82/146): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.6 MB/s | 220 kB 00:00 2023-12-17T11:51:40.411 INFO:teuthology.orchestra.run.smithi008.stdout:(76/146): python3-requests-oauthlib-1.0.0-1.el8 341 kB/s | 43 kB 00:00 2023-12-17T11:51:40.453 INFO:teuthology.orchestra.run.smithi100.stdout:(83/146): libselinux-devel-2.9-5.el8.x86_64.rpm 1.6 MB/s | 200 kB 00:00 2023-12-17T11:51:40.469 INFO:teuthology.orchestra.run.smithi008.stdout:(77/146): libzstd-devel-1.4.4-1.el8.x86_64.rpm 756 kB/s | 44 kB 00:00 2023-12-17T11:51:40.479 INFO:teuthology.orchestra.run.smithi100.stdout:(84/146): libsepol-devel-2.9-3.el8.x86_64.rpm 871 kB/s | 87 kB 00:00 2023-12-17T11:51:40.519 INFO:teuthology.orchestra.run.smithi008.stdout:(78/146): libaio-devel-0.3.112-1.el8.x86_64.rpm 89 kB/s | 19 kB 00:00 2023-12-17T11:51:40.521 INFO:teuthology.orchestra.run.smithi100.stdout:(85/146): keyutils-libs-devel-1.5.10-9.el8.x86_ 287 kB/s | 48 kB 00:00 2023-12-17T11:51:40.579 INFO:teuthology.orchestra.run.smithi100.stdout:(86/146): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 459 kB/s | 58 kB 00:00 2023-12-17T11:51:40.629 INFO:teuthology.orchestra.run.smithi100.stdout:(87/146): libcom_err-devel-1.45.6-4.el8.x86_64. 256 kB/s | 39 kB 00:00 2023-12-17T11:51:40.645 INFO:teuthology.orchestra.run.smithi008.stdout:(79/146): pcre2-devel-10.32-2.el8.x86_64.rpm 3.4 MB/s | 605 kB 00:00 2023-12-17T11:51:40.695 INFO:teuthology.orchestra.run.smithi008.stdout:(80/146): pcre2-utf16-10.32-2.el8.x86_64.rpm 1.3 MB/s | 229 kB 00:00 2023-12-17T11:51:40.705 INFO:teuthology.orchestra.run.smithi100.stdout:(88/146): openssl-devel-1.1.1k-9.el8_7.x86_64.r 13 MB/s | 2.3 MB 00:00 2023-12-17T11:51:40.763 INFO:teuthology.orchestra.run.smithi100.stdout:(89/146): fuse-2.9.7-17.el8.x86_64.rpm 452 kB/s | 83 kB 00:00 2023-12-17T11:51:40.787 INFO:teuthology.orchestra.run.smithi008.stdout:(81/146): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.5 MB/s | 220 kB 00:00 2023-12-17T11:51:40.822 INFO:teuthology.orchestra.run.smithi100.stdout:(90/146): libgfortran-8.5.0-20.el8.x86_64.rpm 3.3 MB/s | 645 kB 00:00 2023-12-17T11:51:40.847 INFO:teuthology.orchestra.run.smithi100.stdout:(91/146): libquadmath-8.5.0-20.el8.x86_64.rpm 1.2 MB/s | 172 kB 00:00 2023-12-17T11:51:40.854 INFO:teuthology.orchestra.run.smithi008.stdout:(82/146): libselinux-devel-2.9-5.el8.x86_64.rpm 1.2 MB/s | 200 kB 00:00 2023-12-17T11:51:40.914 INFO:teuthology.orchestra.run.smithi100.stdout:(92/146): libuuid-devel-2.32.1-43.el8.x86_64.rp 663 kB/s | 100 kB 00:00 2023-12-17T11:51:40.948 INFO:teuthology.orchestra.run.smithi100.stdout:(93/146): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.9 MB/s | 238 kB 00:00 2023-12-17T11:51:40.963 INFO:teuthology.orchestra.run.smithi008.stdout:(83/146): keyutils-libs-devel-1.5.10-9.el8.x86_ 274 kB/s | 48 kB 00:00 2023-12-17T11:51:40.988 INFO:teuthology.orchestra.run.smithi008.stdout:(84/146): libsepol-devel-2.9-3.el8.x86_64.rpm 651 kB/s | 87 kB 00:00 2023-12-17T11:51:41.022 INFO:teuthology.orchestra.run.smithi008.stdout:(85/146): thrift-0.13.0-2.el8.x86_64.rpm 1.5 MB/s | 1.7 MB 00:01 2023-12-17T11:51:41.031 INFO:teuthology.orchestra.run.smithi100.stdout:(94/146): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 622 kB/s | 73 kB 00:00 2023-12-17T11:51:41.065 INFO:teuthology.orchestra.run.smithi100.stdout:(95/146): python3-cryptography-3.2.1-6.el8.x86_ 2.5 MB/s | 559 kB 00:00 2023-12-17T11:51:41.090 INFO:teuthology.orchestra.run.smithi100.stdout:(96/146): NetworkManager-initscripts-updown-1.4 1.0 MB/s | 143 kB 00:00 2023-12-17T11:51:41.102 INFO:teuthology.orchestra.run.smithi008.stdout:(86/146): libcom_err-devel-1.45.6-4.el8.x86_64. 339 kB/s | 39 kB 00:00 2023-12-17T11:51:41.139 INFO:teuthology.orchestra.run.smithi008.stdout:(87/146): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 328 kB/s | 58 kB 00:00 2023-12-17T11:51:41.149 INFO:teuthology.orchestra.run.smithi100.stdout:(97/146): librabbitmq-0.9.0-4.el8.x86_64.rpm 565 kB/s | 47 kB 00:00 2023-12-17T11:51:41.241 INFO:teuthology.orchestra.run.smithi100.stdout:(98/146): elfutils-libelf-devel-0.189-3.el8.x86 295 kB/s | 62 kB 00:00 2023-12-17T11:51:41.348 INFO:teuthology.orchestra.run.smithi008.stdout:(88/146): openssl-devel-1.1.1k-9.el8_7.x86_64.r 7.1 MB/s | 2.3 MB 00:00 2023-12-17T11:51:41.358 INFO:teuthology.orchestra.run.smithi100.stdout:(99/146): krb5-devel-1.18.2-26.el8_9.x86_64.rpm 2.1 MB/s | 562 kB 00:00 2023-12-17T11:51:41.373 INFO:teuthology.orchestra.run.smithi008.stdout:(89/146): fuse-2.9.7-17.el8.x86_64.rpm 307 kB/s | 83 kB 00:00 2023-12-17T11:51:41.383 INFO:teuthology.orchestra.run.smithi100.stdout:(100/146): python3-jsonpointer-1.10-11.el8.noar 85 kB/s | 20 kB 00:00 2023-12-17T11:51:41.406 INFO:teuthology.orchestra.run.smithi008.stdout:(90/146): libgfortran-8.5.0-20.el8.x86_64.rpm 2.4 MB/s | 645 kB 00:00 2023-12-17T11:51:41.409 INFO:teuthology.orchestra.run.smithi100.stdout:(101/146): python3-prettytable-0.7.2-14.el8.noa 263 kB/s | 44 kB 00:00 2023-12-17T11:51:41.442 INFO:teuthology.orchestra.run.smithi100.stdout:(102/146): python3-pyasn1-modules-0.3.7-6.el8.n 1.3 MB/s | 110 kB 00:00 2023-12-17T11:51:41.484 INFO:teuthology.orchestra.run.smithi100.stdout:(103/146): python3-pyasn1-0.3.7-6.el8.noarch.rp 1.6 MB/s | 126 kB 00:00 2023-12-17T11:51:41.490 INFO:teuthology.orchestra.run.smithi008.stdout:(91/146): python3-cffi-1.11.5-6.el8.x86_64.rpm 2.8 MB/s | 238 kB 00:00 2023-12-17T11:51:41.582 INFO:teuthology.orchestra.run.smithi008.stdout:(92/146): libquadmath-8.5.0-20.el8.x86_64.rpm 737 kB/s | 172 kB 00:00 2023-12-17T11:51:41.632 INFO:teuthology.orchestra.run.smithi008.stdout:(93/146): python3-cryptography-3.2.1-6.el8.x86_ 3.9 MB/s | 559 kB 00:00 2023-12-17T11:51:41.676 INFO:teuthology.orchestra.run.smithi100.stdout:(104/146): python3-werkzeug-0.12.2-4.el8.noarch 1.9 MB/s | 457 kB 00:00 2023-12-17T11:51:41.708 INFO:teuthology.orchestra.run.smithi008.stdout:(94/146): libuuid-devel-2.32.1-43.el8.x86_64.rp 298 kB/s | 100 kB 00:00 2023-12-17T11:51:41.733 INFO:teuthology.orchestra.run.smithi008.stdout:(95/146): xfsprogs-devel-5.0.0-12.el8.x86_64.rp 482 kB/s | 73 kB 00:00 2023-12-17T11:51:41.735 INFO:teuthology.orchestra.run.smithi100.stdout:(105/146): bison-3.0.4-10.el8.x86_64.rpm 2.7 MB/s | 688 kB 00:00 2023-12-17T11:51:41.752 INFO:teuthology.orchestra.run.smithi100.stdout:(106/146): python3-jsonpatch-1.21-2.el8.noarch. 72 kB/s | 27 kB 00:00 2023-12-17T11:51:41.758 INFO:teuthology.orchestra.run.smithi008.stdout:(96/146): NetworkManager-initscripts-updown-1.4 1.1 MB/s | 143 kB 00:00 2023-12-17T11:51:41.833 INFO:teuthology.orchestra.run.smithi008.stdout:(97/146): elfutils-libelf-devel-0.189-3.el8.x86 492 kB/s | 62 kB 00:00 2023-12-17T11:51:41.852 INFO:teuthology.orchestra.run.smithi100.stdout:(107/146): flex-2.6.1-9.el8.x86_64.rpm 1.8 MB/s | 320 kB 00:00 2023-12-17T11:51:41.858 INFO:teuthology.orchestra.run.smithi008.stdout:(98/146): librabbitmq-0.9.0-4.el8.x86_64.rpm 375 kB/s | 47 kB 00:00 2023-12-17T11:51:41.903 INFO:teuthology.orchestra.run.smithi100.stdout:(108/146): python3-markupsafe-0.23-19.el8.x86_6 257 kB/s | 39 kB 00:00 2023-12-17T11:51:41.917 INFO:teuthology.orchestra.run.smithi008.stdout:(99/146): krb5-devel-1.18.2-26.el8_9.x86_64.rpm 3.5 MB/s | 562 kB 00:00 2023-12-17T11:51:41.942 INFO:teuthology.orchestra.run.smithi008.stdout:(100/146): python3-jsonpointer-1.10-11.el8.noar 184 kB/s | 20 kB 00:00 2023-12-17T11:51:41.944 INFO:teuthology.orchestra.run.smithi100.stdout:(109/146): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.8 MB/s | 259 kB 00:00 2023-12-17T11:51:41.968 INFO:teuthology.orchestra.run.smithi008.stdout:(101/146): python3-prettytable-0.7.2-14.el8.noa 404 kB/s | 44 kB 00:00 2023-12-17T11:51:41.978 INFO:teuthology.orchestra.run.smithi100.stdout:(110/146): libtool-2.4.6-25.el8.x86_64.rpm 2.9 MB/s | 709 kB 00:00 2023-12-17T11:51:42.003 INFO:teuthology.orchestra.run.smithi100.stdout:(111/146): oniguruma-6.8.2-2.el8.x86_64.rpm 1.8 MB/s | 187 kB 00:00 2023-12-17T11:51:42.060 INFO:teuthology.orchestra.run.smithi008.stdout:(102/146): python3-pyasn1-modules-0.3.7-6.el8.n 773 kB/s | 110 kB 00:00 2023-12-17T11:51:42.070 INFO:teuthology.orchestra.run.smithi100.stdout:(112/146): uuid-1.6.2-43.el8.x86_64.rpm 512 kB/s | 64 kB 00:00 2023-12-17T11:51:42.077 INFO:teuthology.orchestra.run.smithi008.stdout:(103/146): python3-jsonpatch-1.21-2.el8.noarch. 198 kB/s | 27 kB 00:00 2023-12-17T11:51:42.104 INFO:teuthology.orchestra.run.smithi100.stdout:(113/146): python3-pyOpenSSL-19.0.0-1.el8.noarc 826 kB/s | 103 kB 00:00 2023-12-17T11:51:42.110 INFO:teuthology.orchestra.run.smithi008.stdout:(104/146): python3-pyasn1-0.3.7-6.el8.noarch.rp 887 kB/s | 126 kB 00:00 2023-12-17T11:51:42.246 INFO:teuthology.orchestra.run.smithi100.stdout:(114/146): python3-babel-2.5.1-7.el8.noarch.rpm 20 MB/s | 4.8 MB 00:00 2023-12-17T11:51:42.288 INFO:teuthology.orchestra.run.smithi100.stdout:(115/146): python3-jinja2-2.10.1-3.el8.noarch.r 2.4 MB/s | 538 kB 00:00 2023-12-17T11:51:42.294 INFO:teuthology.orchestra.run.smithi008.stdout:(105/146): flex-2.6.1-9.el8.x86_64.rpm 1.7 MB/s | 320 kB 00:00 2023-12-17T11:51:42.336 INFO:teuthology.orchestra.run.smithi008.stdout:(106/146): python3-werkzeug-0.12.2-4.el8.noarch 1.6 MB/s | 457 kB 00:00 2023-12-17T11:51:42.346 INFO:teuthology.orchestra.run.smithi100.stdout:(116/146): socat-1.7.4.1-1.el8.x86_64.rpm 3.2 MB/s | 323 kB 00:00 2023-12-17T11:51:42.370 INFO:teuthology.orchestra.run.smithi008.stdout:(107/146): bison-3.0.4-10.el8.x86_64.rpm 2.3 MB/s | 688 kB 00:00 2023-12-17T11:51:42.413 INFO:teuthology.orchestra.run.smithi100.stdout:(117/146): python3-numpy-1.14.3-10.el8.x86_64.r 12 MB/s | 3.7 MB 00:00 2023-12-17T11:51:42.438 INFO:teuthology.orchestra.run.smithi100.stdout:(118/146): python3-numpy-f2py-1.14.3-10.el8.x86 1.5 MB/s | 225 kB 00:00 2023-12-17T11:51:42.461 INFO:teuthology.orchestra.run.smithi008.stdout:(108/146): libtool-2.4.6-25.el8.x86_64.rpm 4.1 MB/s | 709 kB 00:00 2023-12-17T11:51:42.495 INFO:teuthology.orchestra.run.smithi008.stdout:(109/146): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.0 MB/s | 259 kB 00:00 2023-12-17T11:51:42.497 INFO:teuthology.orchestra.run.smithi100.stdout:(119/146): librdkafka-0.11.4-3.el8.x86_64.rpm 2.3 MB/s | 354 kB 00:00 2023-12-17T11:51:42.520 INFO:teuthology.orchestra.run.smithi008.stdout:(110/146): python3-markupsafe-0.23-19.el8.x86_6 211 kB/s | 39 kB 00:00 2023-12-17T11:51:42.522 INFO:teuthology.orchestra.run.smithi100.stdout:(120/146): python3-mako-1.0.6-14.el8.noarch.rpm 1.8 MB/s | 157 kB 00:00 2023-12-17T11:51:42.524 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction check 2023-12-17T11:51:42.546 INFO:teuthology.orchestra.run.smithi008.stdout:(111/146): oniguruma-6.8.2-2.el8.x86_64.rpm 2.2 MB/s | 187 kB 00:00 2023-12-17T11:51:42.588 INFO:teuthology.orchestra.run.smithi008.stdout:(112/146): uuid-1.6.2-43.el8.x86_64.rpm 694 kB/s | 64 kB 00:00 2023-12-17T11:51:42.613 INFO:teuthology.orchestra.run.smithi008.stdout:(113/146): python3-pyOpenSSL-19.0.0-1.el8.noarc 1.1 MB/s | 103 kB 00:00 2023-12-17T11:51:42.681 INFO:teuthology.orchestra.run.smithi100.stdout:(121/146): openblas-threads-0.3.15-6.el8.x86_64 19 MB/s | 5.2 MB 00:00 2023-12-17T11:51:42.723 INFO:teuthology.orchestra.run.smithi100.stdout:(122/146): automake-1.16.1-8.el8.noarch.rpm 3.5 MB/s | 714 kB 00:00 2023-12-17T11:51:42.730 INFO:teuthology.orchestra.run.smithi008.stdout:(114/146): python3-jinja2-2.10.1-3.el8.noarch.r 3.7 MB/s | 538 kB 00:00 2023-12-17T11:51:42.781 INFO:teuthology.orchestra.run.smithi100.stdout:(123/146): libpq-13.11-1.el8.x86_64.rpm 1.9 MB/s | 198 kB 00:00 2023-12-17T11:51:42.855 INFO:teuthology.orchestra.run.smithi008.stdout:(115/146): python3-babel-2.5.1-7.el8.noarch.rpm 15 MB/s | 4.8 MB 00:00 2023-12-17T11:51:42.865 INFO:teuthology.orchestra.run.smithi100.stdout:(124/146): openblas-0.3.15-6.el8.x86_64.rpm 14 MB/s | 5.0 MB 00:00 2023-12-17T11:51:42.888 INFO:teuthology.orchestra.run.smithi008.stdout:(116/146): socat-1.7.4.1-1.el8.x86_64.rpm 2.0 MB/s | 323 kB 00:00 2023-12-17T11:51:42.890 INFO:teuthology.orchestra.run.smithi100.stdout:(125/146): jq-1.6-7.el8.x86_64.rpm 1.2 MB/s | 202 kB 00:00 2023-12-17T11:51:42.924 INFO:teuthology.orchestra.run.smithi100.stdout:(126/146): python3-pytz-2017.2-11.el8.noarch.rp 382 kB/s | 54 kB 00:00 2023-12-17T11:51:42.972 INFO:teuthology.orchestra.run.smithi008.stdout:(117/146): python3-numpy-1.14.3-10.el8.x86_64.r 10 MB/s | 3.7 MB 00:00 2023-12-17T11:51:42.981 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction check succeeded. 2023-12-17T11:51:42.982 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction test 2023-12-17T11:51:43.006 INFO:teuthology.orchestra.run.smithi008.stdout:(118/146): librdkafka-0.11.4-3.el8.x86_64.rpm 3.0 MB/s | 354 kB 00:00 2023-12-17T11:51:43.065 INFO:teuthology.orchestra.run.smithi008.stdout:(119/146): python3-numpy-f2py-1.14.3-10.el8.x86 1.1 MB/s | 225 kB 00:00 2023-12-17T11:51:43.083 INFO:teuthology.orchestra.run.smithi100.stdout:(127/146): postgresql-contrib-10.23-3.module+el 4.1 MB/s | 811 kB 00:00 2023-12-17T11:51:43.166 INFO:teuthology.orchestra.run.smithi100.stdout:(128/146): postgresql-server-10.23-3.module+el8 21 MB/s | 5.1 MB 00:00 2023-12-17T11:51:43.217 INFO:teuthology.orchestra.run.smithi100.stdout:(129/146): postgresql-10.23-3.module+el8.9.0+20 4.3 MB/s | 1.5 MB 00:00 2023-12-17T11:51:43.265 INFO:teuthology.orchestra.run.smithi008.stdout:(120/146): openblas-threads-0.3.15-6.el8.x86_64 18 MB/s | 5.2 MB 00:00 2023-12-17T11:51:43.290 INFO:teuthology.orchestra.run.smithi008.stdout:(121/146): python3-mako-1.0.6-14.el8.noarch.rpm 553 kB/s | 157 kB 00:00 2023-12-17T11:51:43.365 INFO:teuthology.orchestra.run.smithi008.stdout:(122/146): automake-1.16.1-8.el8.noarch.rpm 7.0 MB/s | 714 kB 00:00 2023-12-17T11:51:43.424 INFO:teuthology.orchestra.run.smithi008.stdout:(123/146): libpq-13.11-1.el8.x86_64.rpm 1.4 MB/s | 198 kB 00:00 2023-12-17T11:51:43.499 INFO:teuthology.orchestra.run.smithi008.stdout:(124/146): openblas-0.3.15-6.el8.x86_64.rpm 12 MB/s | 5.0 MB 00:00 2023-12-17T11:51:43.541 INFO:teuthology.orchestra.run.smithi008.stdout:(125/146): python3-pytz-2017.2-11.el8.noarch.rp 464 kB/s | 54 kB 00:00 2023-12-17T11:51:43.583 INFO:teuthology.orchestra.run.smithi100.stdout:(130/146): python3-scipy-1.0.0-21.module+el8.9. 27 MB/s | 14 MB 00:00 2023-12-17T11:51:43.608 INFO:teuthology.orchestra.run.smithi008.stdout:(126/146): jq-1.6-7.el8.x86_64.rpm 835 kB/s | 202 kB 00:00 2023-12-17T11:51:43.700 INFO:teuthology.orchestra.run.smithi100.stdout:(131/146): librados2-19.0.0-119.ga62fda73.el8.x 7.1 MB/s | 3.8 MB 00:00 2023-12-17T11:51:43.708 INFO:teuthology.orchestra.run.smithi008.stdout:(127/146): postgresql-contrib-10.23-3.module+el 4.8 MB/s | 811 kB 00:00 2023-12-17T11:51:43.751 INFO:teuthology.orchestra.run.smithi100.stdout:(132/146): openssl-1.1.1k-9.el8_7.x86_64.rpm 4.2 MB/s | 710 kB 00:00 2023-12-17T11:51:43.795 INFO:teuthology.orchestra.run.smithi008.stdout:(128/146): postgresql-10.23-3.module+el8.9.0+20 5.1 MB/s | 1.5 MB 00:00 2023-12-17T11:51:43.809 INFO:teuthology.orchestra.run.smithi100.stdout:(133/146): librbd1-19.0.0-119.ga62fda73.el8.x86 6.3 MB/s | 3.7 MB 00:00 2023-12-17T11:51:43.909 INFO:teuthology.orchestra.run.smithi100.stdout:(134/146): elfutils-libelf-0.189-3.el8.x86_64.r 1.4 MB/s | 232 kB 00:00 2023-12-17T11:51:43.960 INFO:teuthology.orchestra.run.smithi100.stdout:(135/146): openssl-libs-1.1.1k-9.el8_7.x86_64.r 5.7 MB/s | 1.5 MB 00:00 2023-12-17T11:51:43.984 INFO:teuthology.orchestra.run.smithi008.stdout:(129/146): postgresql-server-10.23-3.module+el8 13 MB/s | 5.1 MB 00:00 2023-12-17T11:51:44.077 INFO:teuthology.orchestra.run.smithi100.stdout:(136/146): elfutils-libs-0.189-3.el8.x86_64.rpm 1.1 MB/s | 303 kB 00:00 2023-12-17T11:51:44.102 INFO:teuthology.orchestra.run.smithi100.stdout:(137/146): libsmartcols-2.32.1-43.el8.x86_64.rp 1.2 MB/s | 179 kB 00:00 2023-12-17T11:51:44.136 INFO:teuthology.orchestra.run.smithi100.stdout:(138/146): libmount-2.32.1-43.el8.x86_64.rpm 1.0 MB/s | 237 kB 00:00 2023-12-17T11:51:44.236 INFO:teuthology.orchestra.run.smithi100.stdout:(139/146): libuuid-2.32.1-43.el8.x86_64.rpm 624 kB/s | 99 kB 00:00 2023-12-17T11:51:44.303 INFO:teuthology.orchestra.run.smithi100.stdout:(140/146): xfsdump-3.1.8-6.el8.x86_64.rpm 4.9 MB/s | 333 kB 00:00 2023-12-17T11:51:44.351 INFO:teuthology.orchestra.run.smithi008.stdout:(130/146): librbd1-19.0.0-119.ga62fda73.el8.x86 10 MB/s | 3.7 MB 00:00 2023-12-17T11:51:44.353 INFO:teuthology.orchestra.run.smithi100.stdout:(141/146): util-linux-2.32.1-43.el8.x86_64.rpm 9.9 MB/s | 2.5 MB 00:00 2023-12-17T11:51:44.370 INFO:teuthology.orchestra.run.smithi100.stdout:(142/146): util-linux-user-2.32.1-43.el8.x86_64 439 kB/s | 103 kB 00:00 2023-12-17T11:51:44.445 INFO:teuthology.orchestra.run.smithi100.stdout:(143/146): iproute-6.2.0-5.el8_9.x86_64.rpm 5.9 MB/s | 854 kB 00:00 2023-12-17T11:51:44.470 INFO:teuthology.orchestra.run.smithi100.stdout:(144/146): libblkid-2.32.1-43.el8.x86_64.rpm 1.8 MB/s | 220 kB 00:00 2023-12-17T11:51:44.504 INFO:teuthology.orchestra.run.smithi100.stdout:(145/146): libfdisk-2.32.1-43.el8.x86_64.rpm 1.9 MB/s | 254 kB 00:00 2023-12-17T11:51:44.543 INFO:teuthology.orchestra.run.smithi008.stdout:(131/146): python3-scipy-1.0.0-21.module+el8.9. 16 MB/s | 14 MB 00:00 2023-12-17T11:51:44.593 INFO:teuthology.orchestra.run.smithi008.stdout:(132/146): openssl-1.1.1k-9.el8_7.x86_64.rpm 2.9 MB/s | 710 kB 00:00 2023-12-17T11:51:44.612 INFO:teuthology.orchestra.run.smithi100.stdout:(146/146): xfsprogs-5.0.0-12.el8.x86_64.rpm 6.4 MB/s | 1.1 MB 00:00 2023-12-17T11:51:44.616 INFO:teuthology.orchestra.run.smithi100.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:51:44.616 INFO:teuthology.orchestra.run.smithi100.stdout:Total 11 MB/s | 218 MB 00:19 2023-12-17T11:51:44.702 INFO:teuthology.orchestra.run.smithi008.stdout:(133/146): openssl-libs-1.1.1k-9.el8_7.x86_64.r 9.3 MB/s | 1.5 MB 00:00 2023-12-17T11:51:44.708 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction test succeeded. 2023-12-17T11:51:44.720 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction 2023-12-17T11:51:44.735 INFO:teuthology.orchestra.run.smithi008.stdout:(134/146): elfutils-libelf-0.189-3.el8.x86_64.r 1.6 MB/s | 232 kB 00:00 2023-12-17T11:51:44.861 INFO:teuthology.orchestra.run.smithi008.stdout:(135/146): elfutils-libs-0.189-3.el8.x86_64.rpm 1.9 MB/s | 303 kB 00:00 2023-12-17T11:51:44.894 INFO:teuthology.orchestra.run.smithi008.stdout:(136/146): libmount-2.32.1-43.el8.x86_64.rpm 1.5 MB/s | 237 kB 00:00 2023-12-17T11:51:44.994 INFO:teuthology.orchestra.run.smithi008.stdout:(137/146): libsmartcols-2.32.1-43.el8.x86_64.rp 1.3 MB/s | 179 kB 00:00 2023-12-17T11:51:45.036 INFO:teuthology.orchestra.run.smithi008.stdout:(138/146): libuuid-2.32.1-43.el8.x86_64.rpm 699 kB/s | 99 kB 00:00 2023-12-17T11:51:45.170 INFO:teuthology.orchestra.run.smithi008.stdout:(139/146): util-linux-2.32.1-43.el8.x86_64.rpm 14 MB/s | 2.5 MB 00:00 2023-12-17T11:51:45.195 INFO:teuthology.orchestra.run.smithi008.stdout:(140/146): util-linux-user-2.32.1-43.el8.x86_64 647 kB/s | 103 kB 00:00 2023-12-17T11:51:45.229 INFO:teuthology.orchestra.run.smithi008.stdout:(141/146): xfsdump-3.1.8-6.el8.x86_64.rpm 5.6 MB/s | 333 kB 00:00 2023-12-17T11:51:45.379 INFO:teuthology.orchestra.run.smithi008.stdout:(142/146): iproute-6.2.0-5.el8_9.x86_64.rpm 4.5 MB/s | 854 kB 00:00 2023-12-17T11:51:45.430 INFO:teuthology.orchestra.run.smithi008.stdout:(143/146): libblkid-2.32.1-43.el8.x86_64.rpm 1.1 MB/s | 220 kB 00:00 2023-12-17T11:51:45.488 INFO:teuthology.orchestra.run.smithi008.stdout:(144/146): librados2-19.0.0-119.ga62fda73.el8.x 2.2 MB/s | 3.8 MB 00:01 2023-12-17T11:51:45.514 INFO:teuthology.orchestra.run.smithi008.stdout:(145/146): libfdisk-2.32.1-43.el8.x86_64.rpm 1.9 MB/s | 254 kB 00:00 2023-12-17T11:51:45.580 INFO:teuthology.orchestra.run.smithi008.stdout:(146/146): xfsprogs-5.0.0-12.el8.x86_64.rpm 7.1 MB/s | 1.1 MB 00:00 2023-12-17T11:51:45.583 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:51:45.583 INFO:teuthology.orchestra.run.smithi008.stdout:Total 11 MB/s | 218 MB 00:20 2023-12-17T11:51:46.711 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction check 2023-12-17T11:51:47.160 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction check succeeded. 2023-12-17T11:51:47.160 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction test 2023-12-17T11:51:47.759 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction check 2023-12-17T11:51:48.236 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction check succeeded. 2023-12-17T11:51:48.236 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction test 2023-12-17T11:51:48.912 INFO:teuthology.orchestra.run.smithi100.stdout:Transaction test succeeded. 2023-12-17T11:51:48.923 INFO:teuthology.orchestra.run.smithi100.stdout:Running transaction 2023-12-17T11:51:49.979 INFO:teuthology.orchestra.run.smithi008.stdout:Transaction test succeeded. 2023-12-17T11:51:49.992 INFO:teuthology.orchestra.run.smithi008.stdout:Running transaction 2023-12-17T11:51:50.935 INFO:teuthology.orchestra.run.smithi186.stdout: Preparing : 1/1 2023-12-17T11:51:51.182 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8_7.x86_64 1/1 2023-12-17T11:51:51.505 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : openssl-libs-1:1.1.1k-9.el8_7.x86_64 1/162 2023-12-17T11:51:51.764 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8_7.x86_64 1/162 2023-12-17T11:51:52.007 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/162 2023-12-17T11:51:52.249 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 3/162 2023-12-17T11:51:52.341 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 3/162 2023-12-17T11:51:52.591 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 4/162 2023-12-17T11:51:52.687 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 4/162 2023-12-17T11:51:52.967 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/162 2023-12-17T11:51:53.207 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 6/162 2023-12-17T11:51:53.285 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 6/162 2023-12-17T11:51:53.532 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 7/162 2023-12-17T11:51:53.791 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/162 2023-12-17T11:51:54.251 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/162 2023-12-17T11:51:54.549 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : librados2-2:19.0.0-119.ga62fda73.el8.x86_64 9/162 2023-12-17T11:51:54.819 INFO:teuthology.orchestra.run.smithi100.stdout: Preparing : 1/1 2023-12-17T11:51:55.008 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librados2-2:19.0.0-119.ga62fda73.el8.x86_64 9/162 2023-12-17T11:51:55.056 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8_7.x86_64 1/1 2023-12-17T11:51:55.266 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : librbd1-2:19.0.0-119.ga62fda73.el8.x86_64 10/162 2023-12-17T11:51:55.335 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : openssl-libs-1:1.1.1k-9.el8_7.x86_64 1/162 2023-12-17T11:51:55.419 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librbd1-2:19.0.0-119.ga62fda73.el8.x86_64 10/162 2023-12-17T11:51:55.608 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8_7.x86_64 1/162 2023-12-17T11:51:55.649 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libcephfs2-2:19.0.0-119.ga62fda73.el8.x86_64 11/162 2023-12-17T11:51:55.766 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libcephfs2-2:19.0.0-119.ga62fda73.el8.x86_64 11/162 2023-12-17T11:51:55.843 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/162 2023-12-17T11:51:55.899 INFO:teuthology.orchestra.run.smithi008.stdout: Preparing : 1/1 2023-12-17T11:51:56.054 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 3/162 2023-12-17T11:51:56.133 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8_7.x86_64 1/1 2023-12-17T11:51:56.153 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 3/162 2023-12-17T11:51:56.364 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 4/162 2023-12-17T11:51:56.389 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : openssl-libs-1:1.1.1k-9.el8_7.x86_64 1/162 2023-12-17T11:51:56.465 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 4/162 2023-12-17T11:51:56.673 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: openssl-libs-1:1.1.1k-9.el8_7.x86_64 1/162 2023-12-17T11:51:56.684 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rados-2:19.0.0-119.ga62fda73.el8.x86_64 12/162 2023-12-17T11:51:56.685 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/162 2023-12-17T11:51:56.883 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : thrift-0.13.0-2.el8.x86_64 2/162 2023-12-17T11:51:56.889 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/162 2023-12-17T11:51:56.924 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librgw2-2:19.0.0-119.ga62fda73.el8.x86_64 13/162 2023-12-17T11:51:57.154 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/162 2023-12-17T11:51:57.156 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librgw2-2:19.0.0-119.ga62fda73.el8.x86_64 13/162 2023-12-17T11:51:57.223 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : libuuid-2.32.1-43.el8.x86_64 3/162 2023-12-17T11:51:57.286 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/162 2023-12-17T11:51:57.321 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libuuid-2.32.1-43.el8.x86_64 3/162 2023-12-17T11:51:57.482 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 14/162 2023-12-17T11:51:57.512 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/162 2023-12-17T11:51:57.523 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : libblkid-2.32.1-43.el8.x86_64 4/162 2023-12-17T11:51:57.596 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 14/162 2023-12-17T11:51:57.617 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libblkid-2.32.1-43.el8.x86_64 4/162 2023-12-17T11:51:57.854 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/162 2023-12-17T11:51:57.901 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libpq-13.11-1.el8.x86_64 15/162 2023-12-17T11:51:57.979 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/162 2023-12-17T11:51:58.095 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librabbitmq-0.9.0-4.el8.x86_64 6/162 2023-12-17T11:51:58.206 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 16/162 2023-12-17T11:51:58.237 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librados2-2:19.0.0-119.ga62fda73.el8.x86_64 9/162 2023-12-17T11:51:58.365 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 7/162 2023-12-17T11:51:58.429 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 17/162 2023-12-17T11:51:58.508 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 7/162 2023-12-17T11:51:58.706 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 8/162 2023-12-17T11:51:58.713 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-2:19.0.0-119.ga62fda73.el8.x86_64 9/162 2023-12-17T11:51:58.912 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : librbd1-2:19.0.0-119.ga62fda73.el8.x86_64 10/162 2023-12-17T11:51:58.921 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 18/162 2023-12-17T11:51:59.063 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-2:19.0.0-119.ga62fda73.el8.x86_64 10/162 2023-12-17T11:51:59.192 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 8/162 2023-12-17T11:51:59.232 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : postgresql-10.23-3.module+el8.9.0+20831+78489779 19/162 2023-12-17T11:51:59.312 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs2-2:19.0.0-119.ga62fda73.el8.x86_64 11/162 2023-12-17T11:51:59.443 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephfs2-2:19.0.0-119.ga62fda73.el8.x86_64 11/162 2023-12-17T11:51:59.457 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libcephsqlite-2:19.0.0-119.ga62fda73.el8.x86_64 20/162 2023-12-17T11:51:59.464 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : librados2-2:19.0.0-119.ga62fda73.el8.x86_64 9/162 2023-12-17T11:51:59.591 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libcephsqlite-2:19.0.0-119.ga62fda73.el8.x86_64 20/162 2023-12-17T11:51:59.823 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libradosstriper1-2:19.0.0-119.ga62fda73.el8.x86_ 21/162 2023-12-17T11:51:59.927 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libradosstriper1-2:19.0.0-119.ga62fda73.el8.x86_ 21/162 2023-12-17T11:51:59.933 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librados2-2:19.0.0-119.ga62fda73.el8.x86_64 9/162 2023-12-17T11:52:00.107 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 22/162 2023-12-17T11:52:00.165 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : librbd1-2:19.0.0-119.ga62fda73.el8.x86_64 10/162 2023-12-17T11:52:00.284 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rados-2:19.0.0-119.ga62fda73.el8.x86_64 12/162 2023-12-17T11:52:00.300 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 22/162 2023-12-17T11:52:00.327 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librbd1-2:19.0.0-119.ga62fda73.el8.x86_64 10/162 2023-12-17T11:52:00.465 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 23/162 2023-12-17T11:52:00.504 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librgw2-2:19.0.0-119.ga62fda73.el8.x86_64 13/162 2023-12-17T11:52:00.673 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephfs2-2:19.0.0-119.ga62fda73.el8.x86_64 11/162 2023-12-17T11:52:00.748 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librgw2-2:19.0.0-119.ga62fda73.el8.x86_64 13/162 2023-12-17T11:52:00.798 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libcephfs2-2:19.0.0-119.ga62fda73.el8.x86_64 11/162 2023-12-17T11:52:01.074 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 14/162 2023-12-17T11:52:01.168 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 14/162 2023-12-17T11:52:01.199 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 23/162 2023-12-17T11:52:01.415 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 24/162 2023-12-17T11:52:01.422 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libpq-13.11-1.el8.x86_64 15/162 2023-12-17T11:52:01.709 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rados-2:19.0.0-119.ga62fda73.el8.x86_64 12/162 2023-12-17T11:52:01.718 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 16/162 2023-12-17T11:52:01.906 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librgw2-2:19.0.0-119.ga62fda73.el8.x86_64 13/162 2023-12-17T11:52:01.917 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 17/162 2023-12-17T11:52:02.096 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 24/162 2023-12-17T11:52:02.163 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librgw2-2:19.0.0-119.ga62fda73.el8.x86_64 13/162 2023-12-17T11:52:02.306 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : openblas-0.3.15-6.el8.x86_64 25/162 2023-12-17T11:52:02.341 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 18/162 2023-12-17T11:52:02.458 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : xfsprogs-5.0.0-12.el8.x86_64 14/162 2023-12-17T11:52:02.551 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: xfsprogs-5.0.0-12.el8.x86_64 14/162 2023-12-17T11:52:02.571 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-10.23-3.module+el8.9.0+20831+78489779 19/162 2023-12-17T11:52:02.753 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephsqlite-2:19.0.0-119.ga62fda73.el8.x86_64 20/162 2023-12-17T11:52:02.843 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libpq-13.11-1.el8.x86_64 15/162 2023-12-17T11:52:02.885 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libcephsqlite-2:19.0.0-119.ga62fda73.el8.x86_64 20/162 2023-12-17T11:52:03.053 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libradosstriper1-2:19.0.0-119.ga62fda73.el8.x86_ 21/162 2023-12-17T11:52:03.111 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : elfutils-libelf-0.189-3.el8.x86_64 16/162 2023-12-17T11:52:03.137 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libradosstriper1-2:19.0.0-119.ga62fda73.el8.x86_ 21/162 2023-12-17T11:52:03.142 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 25/162 2023-12-17T11:52:03.342 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 22/162 2023-12-17T11:52:03.431 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 26/162 2023-12-17T11:52:03.489 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 17/162 2023-12-17T11:52:03.592 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/162 2023-12-17T11:52:03.657 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 27/162 2023-12-17T11:52:03.846 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 28/162 2023-12-17T11:52:03.861 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/162 2023-12-17T11:52:03.940 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 18/162 2023-12-17T11:52:04.019 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 25/162 2023-12-17T11:52:04.159 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 29/162 2023-12-17T11:52:04.182 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : postgresql-10.23-3.module+el8.9.0+20831+78489779 19/162 2023-12-17T11:52:04.195 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 25/162 2023-12-17T11:52:04.327 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 26/162 2023-12-17T11:52:04.373 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephsqlite-2:19.0.0-119.ga62fda73.el8.x86_64 20/162 2023-12-17T11:52:04.498 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libcephsqlite-2:19.0.0-119.ga62fda73.el8.x86_64 20/162 2023-12-17T11:52:04.508 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 30/162 2023-12-17T11:52:04.781 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libradosstriper1-2:19.0.0-119.ga62fda73.el8.x86_ 21/162 2023-12-17T11:52:04.802 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 31/162 2023-12-17T11:52:04.914 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libradosstriper1-2:19.0.0-119.ga62fda73.el8.x86_ 21/162 2023-12-17T11:52:05.021 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-ceph-common-2:19.0.0-119.ga62fda73.el8.x 32/162 2023-12-17T11:52:05.040 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 26/162 2023-12-17T11:52:05.071 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 22/162 2023-12-17T11:52:05.202 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 27/162 2023-12-17T11:52:05.228 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-ceph-argparse-2:19.0.0-119.ga62fda73.el8 33/162 2023-12-17T11:52:05.322 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/162 2023-12-17T11:52:05.514 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cephfs-2:19.0.0-119.ga62fda73.el8.x86_64 34/162 2023-12-17T11:52:05.601 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/162 2023-12-17T11:52:05.747 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libquadmath-8.5.0-20.el8.x86_64 25/162 2023-12-17T11:52:05.874 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 27/162 2023-12-17T11:52:05.921 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libquadmath-8.5.0-20.el8.x86_64 25/162 2023-12-17T11:52:06.061 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openblas-0.3.15-6.el8.x86_64 28/162 2023-12-17T11:52:06.105 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libgfortran-8.5.0-20.el8.x86_64 26/162 2023-12-17T11:52:06.626 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 35/162 2023-12-17T11:52:06.845 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libgfortran-8.5.0-20.el8.x86_64 26/162 2023-12-17T11:52:06.902 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 28/162 2023-12-17T11:52:06.990 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 36/162 2023-12-17T11:52:07.072 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openblas-threads-0.3.15-6.el8.x86_64 27/162 2023-12-17T11:52:07.160 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 29/162 2023-12-17T11:52:07.282 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 37/162 2023-12-17T11:52:07.411 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 30/162 2023-12-17T11:52:07.514 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 38/162 2023-12-17T11:52:07.671 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 31/162 2023-12-17T11:52:07.780 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: openblas-threads-0.3.15-6.el8.x86_64 27/162 2023-12-17T11:52:07.843 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-common-2:19.0.0-119.ga62fda73.el8.x 32/162 2023-12-17T11:52:07.955 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openblas-0.3.15-6.el8.x86_64 28/162 2023-12-17T11:52:07.998 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-ceph-argparse-2:19.0.0-119.ga62fda73.el8 33/162 2023-12-17T11:52:08.261 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cephfs-2:19.0.0-119.ga62fda73.el8.x86_64 34/162 2023-12-17T11:52:08.519 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/162 2023-12-17T11:52:08.849 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: openblas-0.3.15-6.el8.x86_64 28/162 2023-12-17T11:52:09.113 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 29/162 2023-12-17T11:52:09.368 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 30/162 2023-12-17T11:52:09.541 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 38/162 2023-12-17T11:52:09.603 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 31/162 2023-12-17T11:52:09.821 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-ceph-common-2:19.0.0-119.ga62fda73.el8.x 32/162 2023-12-17T11:52:09.904 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 39/162 2023-12-17T11:52:09.969 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-ceph-argparse-2:19.0.0-119.ga62fda73.el8 33/162 2023-12-17T11:52:10.183 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rsa-4.9-2.el8.noarch 40/162 2023-12-17T11:52:10.254 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cephfs-2:19.0.0-119.ga62fda73.el8.x86_64 34/162 2023-12-17T11:52:10.422 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 41/162 2023-12-17T11:52:10.480 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/162 2023-12-17T11:52:10.534 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/162 2023-12-17T11:52:10.686 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rgw-2:19.0.0-119.ga62fda73.el8.x86_64 42/162 2023-12-17T11:52:10.890 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 36/162 2023-12-17T11:52:10.971 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rbd-2:19.0.0-119.ga62fda73.el8.x86_64 43/162 2023-12-17T11:52:11.187 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librados-devel-2:19.0.0-119.ga62fda73.el8.x86_64 44/162 2023-12-17T11:52:11.405 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 45/162 2023-12-17T11:52:11.521 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 45/162 2023-12-17T11:52:11.798 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 46/162 2023-12-17T11:52:11.895 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 46/162 2023-12-17T11:52:12.012 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 37/162 2023-12-17T11:52:12.184 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libuuid-devel-2.32.1-43.el8.x86_64 47/162 2023-12-17T11:52:12.386 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 38/162 2023-12-17T11:52:12.452 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 48/162 2023-12-17T11:52:12.641 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 35/162 2023-12-17T11:52:12.641 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 39/162 2023-12-17T11:52:12.671 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 49/162 2023-12-17T11:52:12.878 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rsa-4.9-2.el8.noarch 40/162 2023-12-17T11:52:13.016 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 36/162 2023-12-17T11:52:13.148 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 41/162 2023-12-17T11:52:13.324 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 49/162 2023-12-17T11:52:13.398 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rgw-2:19.0.0-119.ga62fda73.el8.x86_64 42/162 2023-12-17T11:52:13.616 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-rbd-2:19.0.0-119.ga62fda73.el8.x86_64 43/162 2023-12-17T11:52:13.714 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 50/162 2023-12-17T11:52:13.754 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 50/162 2023-12-17T11:52:13.810 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : librados-devel-2:19.0.0-119.ga62fda73.el8.x86_64 44/162 2023-12-17T11:52:14.010 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : fuse-2.9.7-17.el8.x86_64 51/162 2023-12-17T11:52:14.101 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 45/162 2023-12-17T11:52:14.162 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 37/162 2023-12-17T11:52:14.202 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 45/162 2023-12-17T11:52:14.258 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 52/162 2023-12-17T11:52:14.428 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 46/162 2023-12-17T11:52:14.506 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/162 2023-12-17T11:52:14.507 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 38/162 2023-12-17T11:52:14.533 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 46/162 2023-12-17T11:52:14.747 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 39/162 2023-12-17T11:52:14.752 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/162 2023-12-17T11:52:14.780 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libuuid-devel-2.32.1-43.el8.x86_64 47/162 2023-12-17T11:52:14.980 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 48/162 2023-12-17T11:52:14.984 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rsa-4.9-2.el8.noarch 40/162 2023-12-17T11:52:14.994 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/162 2023-12-17T11:52:15.210 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 41/162 2023-12-17T11:52:15.218 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 49/162 2023-12-17T11:52:15.375 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 56/162 2023-12-17T11:52:15.437 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rgw-2:19.0.0-119.ga62fda73.el8.x86_64 42/162 2023-12-17T11:52:15.688 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-rbd-2:19.0.0-119.ga62fda73.el8.x86_64 43/162 2023-12-17T11:52:15.714 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 57/162 2023-12-17T11:52:15.814 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 49/162 2023-12-17T11:52:15.879 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : librados-devel-2:19.0.0-119.ga62fda73.el8.x86_64 44/162 2023-12-17T11:52:16.019 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 58/162 2023-12-17T11:52:16.062 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : libmount-2.32.1-43.el8.x86_64 45/162 2023-12-17T11:52:16.151 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 50/162 2023-12-17T11:52:16.170 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libmount-2.32.1-43.el8.x86_64 45/162 2023-12-17T11:52:16.214 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 59/162 2023-12-17T11:52:16.272 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 50/162 2023-12-17T11:52:16.410 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : libfdisk-2.32.1-43.el8.x86_64 46/162 2023-12-17T11:52:16.495 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : automake-1.16.1-8.el8.noarch 51/162 2023-12-17T11:52:16.499 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 60/162 2023-12-17T11:52:16.508 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libfdisk-2.32.1-43.el8.x86_64 46/162 2023-12-17T11:52:16.667 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : uuid-1.6.2-43.el8.x86_64 52/162 2023-12-17T11:52:16.744 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libuuid-devel-2.32.1-43.el8.x86_64 47/162 2023-12-17T11:52:16.808 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 52/162 2023-12-17T11:52:16.951 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 48/162 2023-12-17T11:52:16.958 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 61/162 2023-12-17T11:52:16.959 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 53/162 2023-12-17T11:52:17.048 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 53/162 2023-12-17T11:52:17.219 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : jq-1.6-7.el8.x86_64 54/162 2023-12-17T11:52:17.229 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : libsmartcols-2.32.1-43.el8.x86_64 49/162 2023-12-17T11:52:17.327 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 62/162 2023-12-17T11:52:17.467 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 55/162 2023-12-17T11:52:17.560 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 63/162 2023-12-17T11:52:17.643 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 56/162 2023-12-17T11:52:17.842 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libsmartcols-2.32.1-43.el8.x86_64 49/162 2023-12-17T11:52:17.849 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 57/162 2023-12-17T11:52:17.867 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 64/162 2023-12-17T11:52:18.106 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : fuse-2.9.7-17.el8.x86_64 58/162 2023-12-17T11:52:18.138 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : util-linux-2.32.1-43.el8.x86_64 50/162 2023-12-17T11:52:18.147 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 65/162 2023-12-17T11:52:18.266 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: util-linux-2.32.1-43.el8.x86_64 50/162 2023-12-17T11:52:18.305 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 59/162 2023-12-17T11:52:18.491 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : automake-1.16.1-8.el8.noarch 51/162 2023-12-17T11:52:18.493 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 60/162 2023-12-17T11:52:18.521 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 66/162 2023-12-17T11:52:18.654 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : uuid-1.6.2-43.el8.x86_64 52/162 2023-12-17T11:52:18.697 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 61/162 2023-12-17T11:52:18.758 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 52/162 2023-12-17T11:52:18.781 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 67/162 2023-12-17T11:52:18.899 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 62/162 2023-12-17T11:52:18.945 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 53/162 2023-12-17T11:52:19.024 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 68/162 2023-12-17T11:52:19.049 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 53/162 2023-12-17T11:52:19.223 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : jq-1.6-7.el8.x86_64 54/162 2023-12-17T11:52:19.252 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 63/162 2023-12-17T11:52:19.265 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 69/162 2023-12-17T11:52:19.421 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 55/162 2023-12-17T11:52:19.533 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/162 2023-12-17T11:52:19.538 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 70/162 2023-12-17T11:52:19.614 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 56/162 2023-12-17T11:52:19.776 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 57/162 2023-12-17T11:52:19.798 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/162 2023-12-17T11:52:19.945 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 71/162 2023-12-17T11:52:19.993 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 66/162 2023-12-17T11:52:20.043 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : fuse-2.9.7-17.el8.x86_64 58/162 2023-12-17T11:52:20.224 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : automake-1.16.1-8.el8.noarch 72/162 2023-12-17T11:52:20.226 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 67/162 2023-12-17T11:52:20.261 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 59/162 2023-12-17T11:52:20.429 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : uuid-1.6.2-43.el8.x86_64 73/162 2023-12-17T11:52:20.465 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 60/162 2023-12-17T11:52:20.576 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 73/162 2023-12-17T11:52:20.641 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 68/162 2023-12-17T11:52:20.677 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 61/162 2023-12-17T11:52:20.754 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 74/162 2023-12-17T11:52:20.858 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 74/162 2023-12-17T11:52:20.895 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 62/162 2023-12-17T11:52:20.998 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 69/162 2023-12-17T11:52:21.098 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : jq-1.6-7.el8.x86_64 75/162 2023-12-17T11:52:21.207 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 70/162 2023-12-17T11:52:21.265 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 63/162 2023-12-17T11:52:21.346 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 76/162 2023-12-17T11:52:21.493 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 71/162 2023-12-17T11:52:21.539 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 77/162 2023-12-17T11:52:21.561 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 64/162 2023-12-17T11:52:21.742 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 72/162 2023-12-17T11:52:21.799 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 78/162 2023-12-17T11:52:21.818 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 65/162 2023-12-17T11:52:21.990 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 79/162 2023-12-17T11:52:21.999 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libzstd-devel-1.4.4-1.el8.x86_64 66/162 2023-12-17T11:52:22.057 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 73/162 2023-12-17T11:52:22.205 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 80/162 2023-12-17T11:52:22.326 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 74/162 2023-12-17T11:52:22.532 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 81/162 2023-12-17T11:52:22.578 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 75/162 2023-12-17T11:52:22.582 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 67/162 2023-12-17T11:52:22.786 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 76/162 2023-12-17T11:52:22.812 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 82/162 2023-12-17T11:52:23.000 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 77/162 2023-12-17T11:52:23.018 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 83/162 2023-12-17T11:52:23.052 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 68/162 2023-12-17T11:52:23.251 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 84/162 2023-12-17T11:52:23.286 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 78/162 2023-12-17T11:52:23.353 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cryptography-3.2.1-6.el8.x86_64 69/162 2023-12-17T11:52:23.459 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 79/162 2023-12-17T11:52:23.494 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 85/162 2023-12-17T11:52:23.566 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 70/162 2023-12-17T11:52:23.631 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 80/162 2023-12-17T11:52:23.804 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 86/162 2023-12-17T11:52:23.828 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 71/162 2023-12-17T11:52:23.921 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 81/162 2023-12-17T11:52:24.084 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 87/162 2023-12-17T11:52:24.115 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 72/162 2023-12-17T11:52:24.149 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 82/162 2023-12-17T11:52:24.274 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 88/162 2023-12-17T11:52:24.388 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 83/162 2023-12-17T11:52:24.452 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 73/162 2023-12-17T11:52:24.511 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 89/162 2023-12-17T11:52:24.563 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 84/162 2023-12-17T11:52:24.689 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 74/162 2023-12-17T11:52:24.772 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 85/162 2023-12-17T11:52:24.818 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 90/162 2023-12-17T11:52:24.931 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 75/162 2023-12-17T11:52:25.041 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 86/162 2023-12-17T11:52:25.106 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 91/162 2023-12-17T11:52:25.131 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 76/162 2023-12-17T11:52:25.288 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 87/162 2023-12-17T11:52:25.342 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 77/162 2023-12-17T11:52:25.448 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 88/162 2023-12-17T11:52:25.591 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : krb5-devel-1.18.2-26.el8_9.x86_64 78/162 2023-12-17T11:52:25.649 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 89/162 2023-12-17T11:52:25.748 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 79/162 2023-12-17T11:52:25.898 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 90/162 2023-12-17T11:52:25.948 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 80/162 2023-12-17T11:52:26.036 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 92/162 2023-12-17T11:52:26.182 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 91/162 2023-12-17T11:52:26.253 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 81/162 2023-12-17T11:52:26.365 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 92/162 2023-12-17T11:52:26.374 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-portend-2.6-1.el8.noarch 93/162 2023-12-17T11:52:26.479 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 82/162 2023-12-17T11:52:26.636 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-portend-2.6-1.el8.noarch 93/162 2023-12-17T11:52:26.673 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 94/162 2023-12-17T11:52:26.717 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 83/162 2023-12-17T11:52:26.883 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 94/162 2023-12-17T11:52:26.898 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 95/162 2023-12-17T11:52:26.901 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 84/162 2023-12-17T11:52:27.078 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 95/162 2023-12-17T11:52:27.121 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 85/162 2023-12-17T11:52:27.179 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 96/162 2023-12-17T11:52:27.366 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 96/162 2023-12-17T11:52:27.389 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 86/162 2023-12-17T11:52:27.614 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 87/162 2023-12-17T11:52:27.891 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 88/162 2023-12-17T11:52:28.044 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 89/162 2023-12-17T11:52:28.288 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 90/162 2023-12-17T11:52:28.515 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 97/162 2023-12-17T11:52:28.540 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 91/162 2023-12-17T11:52:28.625 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 97/162 2023-12-17T11:52:28.727 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 92/162 2023-12-17T11:52:28.839 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 98/162 2023-12-17T11:52:28.942 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 98/162 2023-12-17T11:52:29.038 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-portend-2.6-1.el8.noarch 93/162 2023-12-17T11:52:29.141 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 99/162 2023-12-17T11:52:29.179 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 99/162 2023-12-17T11:52:29.296 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 94/162 2023-12-17T11:52:29.509 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 100/162 2023-12-17T11:52:29.523 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 95/162 2023-12-17T11:52:29.526 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 100/162 2023-12-17T11:52:29.773 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 96/162 2023-12-17T11:52:29.822 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 101/162 2023-12-17T11:52:29.867 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 101/162 2023-12-17T11:52:30.100 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : luarocks-3.5.0-1.el8.noarch 102/162 2023-12-17T11:52:30.180 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : luarocks-3.5.0-1.el8.noarch 102/162 2023-12-17T11:52:30.445 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 103/162 2023-12-17T11:52:30.678 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 104/162 2023-12-17T11:52:30.872 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 103/162 2023-12-17T11:52:31.066 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 104/162 2023-12-17T11:52:31.169 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 97/162 2023-12-17T11:52:31.499 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 98/162 2023-12-17T11:52:31.775 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 99/162 2023-12-17T11:52:32.116 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 100/162 2023-12-17T11:52:32.463 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 101/162 2023-12-17T11:52:32.684 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : luarocks-3.5.0-1.el8.noarch 102/162 2023-12-17T11:52:32.950 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 103/162 2023-12-17T11:52:33.603 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 104/162 2023-12-17T11:52:36.358 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:19.0.0-119.ga62fda73.el8.x86_64 105/162 2023-12-17T11:52:36.389 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-common-2:19.0.0-119.ga62fda73.el8.x86_64 105/162 2023-12-17T11:52:36.618 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-common-2:19.0.0-119.ga62fda73.el8.x86_64 105/162 2023-12-17T11:52:37.302 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-common-2:19.0.0-119.ga62fda73.el8.x86_64 105/162 2023-12-17T11:52:37.303 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-common-2:19.0.0-119.ga62fda73.el8.x86_64 105/162 2023-12-17T11:52:37.596 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-base-2:19.0.0-119.ga62fda73.el8.x86_64 106/162 2023-12-17T11:52:37.736 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-base-2:19.0.0-119.ga62fda73.el8.x86_64 106/162 2023-12-17T11:52:37.956 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-selinux-2:19.0.0-119.ga62fda73.el8.x86_64 107/162 2023-12-17T11:52:37.999 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-common-2:19.0.0-119.ga62fda73.el8.x86_64 105/162 2023-12-17T11:52:38.332 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-base-2:19.0.0-119.ga62fda73.el8.x86_64 106/162 2023-12-17T11:52:38.485 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-base-2:19.0.0-119.ga62fda73.el8.x86_64 106/162 2023-12-17T11:52:38.735 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-selinux-2:19.0.0-119.ga62fda73.el8.x86_64 107/162 2023-12-17T11:52:38.994 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-common-2:19.0.0-119.ga62fda73.el8.x86_64 105/162 2023-12-17T11:52:39.219 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-common-2:19.0.0-119.ga62fda73.el8.x86_64 105/162 2023-12-17T11:52:39.952 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-common-2:19.0.0-119.ga62fda73.el8.x86_64 105/162 2023-12-17T11:52:40.234 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-base-2:19.0.0-119.ga62fda73.el8.x86_64 106/162 2023-12-17T11:52:40.386 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-base-2:19.0.0-119.ga62fda73.el8.x86_64 106/162 2023-12-17T11:52:40.610 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-selinux-2:19.0.0-119.ga62fda73.el8.x86_64 107/162 2023-12-17T11:52:58.514 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-selinux-2:19.0.0-119.ga62fda73.el8.x86_64 107/162 2023-12-17T11:52:58.514 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /sys 2023-12-17T11:52:58.514 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /proc 2023-12-17T11:52:58.514 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /dev 2023-12-17T11:52:58.514 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /run 2023-12-17T11:52:58.514 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /mnt 2023-12-17T11:52:58.514 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /var/tmp 2023-12-17T11:52:58.514 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /home 2023-12-17T11:52:58.514 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /tmp 2023-12-17T11:52:58.514 INFO:teuthology.orchestra.run.smithi100.stdout:skipping the directory /dev 2023-12-17T11:52:58.514 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-17T11:52:58.911 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-volume-2:19.0.0-119.ga62fda73.el8.noarch 108/162 2023-12-17T11:52:59.452 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-selinux-2:19.0.0-119.ga62fda73.el8.x86_64 107/162 2023-12-17T11:52:59.452 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /sys 2023-12-17T11:52:59.452 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /proc 2023-12-17T11:52:59.452 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /dev 2023-12-17T11:52:59.452 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /run 2023-12-17T11:52:59.452 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /mnt 2023-12-17T11:52:59.452 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /var/tmp 2023-12-17T11:52:59.452 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /home 2023-12-17T11:52:59.453 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /tmp 2023-12-17T11:52:59.453 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /dev 2023-12-17T11:52:59.453 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-12-17T11:52:59.857 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-volume-2:19.0.0-119.ga62fda73.el8.noarch 108/162 2023-12-17T11:53:00.651 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-volume-2:19.0.0-119.ga62fda73.el8.noarch 108/162 2023-12-17T11:53:00.875 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-osd-2:19.0.0-119.ga62fda73.el8.x86_64 109/162 2023-12-17T11:53:01.152 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-osd-2:19.0.0-119.ga62fda73.el8.x86_64 109/162 2023-12-17T11:53:01.353 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mds-2:19.0.0-119.ga62fda73.el8.x86_64 110/162 2023-12-17T11:53:01.621 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-volume-2:19.0.0-119.ga62fda73.el8.noarch 108/162 2023-12-17T11:53:01.854 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-osd-2:19.0.0-119.ga62fda73.el8.x86_64 109/162 2023-12-17T11:53:01.875 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mds-2:19.0.0-119.ga62fda73.el8.x86_64 110/162 2023-12-17T11:53:02.032 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-selinux-2:19.0.0-119.ga62fda73.el8.x86_64 107/162 2023-12-17T11:53:02.033 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /sys 2023-12-17T11:53:02.033 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /proc 2023-12-17T11:53:02.033 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /dev 2023-12-17T11:53:02.033 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /run 2023-12-17T11:53:02.033 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /mnt 2023-12-17T11:53:02.033 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /var/tmp 2023-12-17T11:53:02.033 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /home 2023-12-17T11:53:02.033 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /tmp 2023-12-17T11:53:02.033 INFO:teuthology.orchestra.run.smithi008.stdout:skipping the directory /dev 2023-12-17T11:53:02.033 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T11:53:02.052 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mon-2:19.0.0-119.ga62fda73.el8.x86_64 111/162 2023-12-17T11:53:02.094 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mon-2:19.0.0-119.ga62fda73.el8.x86_64 111/162 2023-12-17T11:53:02.126 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-osd-2:19.0.0-119.ga62fda73.el8.x86_64 109/162 2023-12-17T11:53:02.323 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mds-2:19.0.0-119.ga62fda73.el8.x86_64 110/162 2023-12-17T11:53:02.432 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-volume-2:19.0.0-119.ga62fda73.el8.noarch 108/162 2023-12-17T11:53:02.846 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mds-2:19.0.0-119.ga62fda73.el8.x86_64 110/162 2023-12-17T11:53:03.048 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mon-2:19.0.0-119.ga62fda73.el8.x86_64 111/162 2023-12-17T11:53:03.092 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mon-2:19.0.0-119.ga62fda73.el8.x86_64 111/162 2023-12-17T11:53:04.284 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-volume-2:19.0.0-119.ga62fda73.el8.noarch 108/162 2023-12-17T11:53:04.506 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-osd-2:19.0.0-119.ga62fda73.el8.x86_64 109/162 2023-12-17T11:53:04.793 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-osd-2:19.0.0-119.ga62fda73.el8.x86_64 109/162 2023-12-17T11:53:04.982 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mds-2:19.0.0-119.ga62fda73.el8.x86_64 110/162 2023-12-17T11:53:05.032 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephadm-2:19.0.0-119.ga62fda73.el8.noarch 112/162 2023-12-17T11:53:05.178 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephadm-2:19.0.0-119.ga62fda73.el8.noarch 112/162 2023-12-17T11:53:05.327 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-119.ga62fda73.el 113/162 2023-12-17T11:53:05.537 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mds-2:19.0.0-119.ga62fda73.el8.x86_64 110/162 2023-12-17T11:53:05.541 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-119.ga62fda73.e 114/162 2023-12-17T11:53:05.715 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mon-2:19.0.0-119.ga62fda73.el8.x86_64 111/162 2023-12-17T11:53:05.759 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mon-2:19.0.0-119.ga62fda73.el8.x86_64 111/162 2023-12-17T11:53:05.817 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el8.noar 115/162 2023-12-17T11:53:06.015 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: cephadm-2:19.0.0-119.ga62fda73.el8.noarch 112/162 2023-12-17T11:53:06.089 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el8.noar 115/162 2023-12-17T11:53:06.240 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : cephadm-2:19.0.0-119.ga62fda73.el8.noarch 112/162 2023-12-17T11:53:06.282 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el8.no 116/162 2023-12-17T11:53:06.398 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-119.ga62fda73.el 113/162 2023-12-17T11:53:06.687 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-119.ga62fda73.e 114/162 2023-12-17T11:53:06.997 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el8.noar 115/162 2023-12-17T11:53:07.264 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el8.noar 115/162 2023-12-17T11:53:07.373 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el8.no 116/162 2023-12-17T11:53:07.510 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el8.no 116/162 2023-12-17T11:53:07.593 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-119.ga62f 117/162 2023-12-17T11:53:07.723 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-119.ga62f 117/162 2023-12-17T11:53:08.120 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-119.ga62fda73.el8 118/162 2023-12-17T11:53:08.299 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-2:19.0.0-119.ga62fda73.el8.x86_64 119/162 2023-12-17T11:53:08.369 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-2:19.0.0-119.ga62fda73.el8.x86_64 119/162 2023-12-17T11:53:08.551 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-mgr-rook-2:19.0.0-119.ga62fda73.el8.noarch 120/162 2023-12-17T11:53:08.581 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-119.ga62fda73.el8.noarch 120/162 2023-12-17T11:53:08.598 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el8.no 116/162 2023-12-17T11:53:08.771 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: cephadm-2:19.0.0-119.ga62fda73.el8.noarch 112/162 2023-12-17T11:53:08.797 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-119.ga62f 117/162 2023-12-17T11:53:08.926 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cephadm-2:19.0.0-119.ga62fda73.el8.noarch 112/162 2023-12-17T11:53:08.927 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-119.ga62f 117/162 2023-12-17T11:53:09.049 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-119.ga62fda73.el 113/162 2023-12-17T11:53:09.289 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-119.ga62fda73.e 114/162 2023-12-17T11:53:09.365 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-119.ga62fda73.el8 118/162 2023-12-17T11:53:09.522 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el8.noar 115/162 2023-12-17T11:53:09.536 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-2:19.0.0-119.ga62fda73.el8.x86_64 119/162 2023-12-17T11:53:09.605 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-2:19.0.0-119.ga62fda73.el8.x86_64 119/162 2023-12-17T11:53:09.804 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el8.noar 115/162 2023-12-17T11:53:09.822 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-rook-2:19.0.0-119.ga62fda73.el8.noarch 120/162 2023-12-17T11:53:09.852 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-119.ga62fda73.el8.noarch 120/162 2023-12-17T11:53:10.005 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el8.no 116/162 2023-12-17T11:53:10.038 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-2:19.0.0-119.ga62fda73.el8.x86_64 121/162 2023-12-17T11:53:10.207 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-radosgw-2:19.0.0-119.ga62fda73.el8.x86_64 122/162 2023-12-17T11:53:10.270 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-119.ga62fda73.el8.x86_64 122/162 2023-12-17T11:53:10.476 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-119.ga62fda 123/162 2023-12-17T11:53:10.549 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-119.ga62fda 123/162 2023-12-17T11:53:10.726 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 124/162 2023-12-17T11:53:11.147 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 124/162 2023-12-17T11:53:11.161 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el8.no 116/162 2023-12-17T11:53:11.349 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-2:19.0.0-119.ga62fda73.el8.x86_64 121/162 2023-12-17T11:53:11.350 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 125/162 2023-12-17T11:53:11.355 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-119.ga62f 117/162 2023-12-17T11:53:11.493 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-119.ga62f 117/162 2023-12-17T11:53:11.602 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-radosgw-2:19.0.0-119.ga62fda73.el8.x86_64 122/162 2023-12-17T11:53:11.666 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-119.ga62fda73.el8.x86_64 122/162 2023-12-17T11:53:11.886 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-119.ga62fda73.el8 118/162 2023-12-17T11:53:11.925 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-119.ga62fda 123/162 2023-12-17T11:53:11.998 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-119.ga62fda 123/162 2023-12-17T11:53:12.055 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-2:19.0.0-119.ga62fda73.el8.x86_64 119/162 2023-12-17T11:53:12.126 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-2:19.0.0-119.ga62fda73.el8.x86_64 119/162 2023-12-17T11:53:12.197 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : cephfs-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 124/162 2023-12-17T11:53:12.281 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-mgr-rook-2:19.0.0-119.ga62fda73.el8.noarch 120/162 2023-12-17T11:53:12.311 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-119.ga62fda73.el8.noarch 120/162 2023-12-17T11:53:12.621 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 124/162 2023-12-17T11:53:12.855 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : rbd-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 125/162 2023-12-17T11:53:13.879 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-2:19.0.0-119.ga62fda73.el8.x86_64 121/162 2023-12-17T11:53:14.096 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-radosgw-2:19.0.0-119.ga62fda73.el8.x86_64 122/162 2023-12-17T11:53:14.162 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-119.ga62fda73.el8.x86_64 122/162 2023-12-17T11:53:14.514 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-119.ga62fda 123/162 2023-12-17T11:53:14.589 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-119.ga62fda 123/162 2023-12-17T11:53:14.773 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cephfs-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 124/162 2023-12-17T11:53:15.217 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 124/162 2023-12-17T11:53:15.414 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 125/162 2023-12-17T11:53:16.405 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: rbd-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 125/162 2023-12-17T11:53:17.693 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-test-2:19.0.0-119.ga62fda73.el8.x86_64 126/162 2023-12-17T11:53:17.921 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: rbd-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 125/162 2023-12-17T11:53:18.054 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : openssl-devel-1:1.1.1k-9.el8_7.x86_64 127/162 2023-12-17T11:53:18.300 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 128/162 2023-12-17T11:53:18.515 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-test-2:19.0.0-119.ga62fda73.el8.x86_64 126/162 2023-12-17T11:53:18.776 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : ceph-fuse-2:19.0.0-119.ga62fda73.el8.x86_64 129/162 2023-12-17T11:53:18.885 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : postgresql-contrib-10.23-3.module+el8.9.0+20831+ 127/162 2023-12-17T11:53:19.137 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libtool-2.4.6-25.el8.x86_64 128/162 2023-12-17T11:53:19.152 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-contrib-10.23-3.module+el8.9.0+20831+ 130/162 2023-12-17T11:53:19.357 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libtool-2.4.6-25.el8.x86_64 131/162 2023-12-17T11:53:19.386 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 131/162 2023-12-17T11:53:19.579 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 132/162 2023-12-17T11:53:19.787 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/162 2023-12-17T11:53:19.983 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libcephfs-devel-2:19.0.0-119.ga62fda73.el8.x86_6 134/162 2023-12-17T11:53:20.160 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 128/162 2023-12-17T11:53:20.559 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : openssl-devel-1:1.1.1k-9.el8_7.x86_64 129/162 2023-12-17T11:53:20.820 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: rbd-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 125/162 2023-12-17T11:53:20.890 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 130/162 2023-12-17T11:53:21.162 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-fuse-2:19.0.0-119.ga62fda73.el8.x86_64 131/162 2023-12-17T11:53:21.411 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 132/162 2023-12-17T11:53:21.643 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/162 2023-12-17T11:53:21.896 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libcephfs-devel-2:19.0.0-119.ga62fda73.el8.x86_6 134/162 2023-12-17T11:53:22.201 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-test-2:19.0.0-119.ga62fda73.el8.x86_64 126/162 2023-12-17T11:53:22.518 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : openssl-devel-1:1.1.1k-9.el8_7.x86_64 127/162 2023-12-17T11:53:22.833 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : elfutils-libelf-devel-0.189-3.el8.x86_64 128/162 2023-12-17T11:53:23.308 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : ceph-fuse-2:19.0.0-119.ga62fda73.el8.x86_64 129/162 2023-12-17T11:53:23.400 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: postgresql-server-10.23-3.module+el8.9.0+20831+7 135/162 2023-12-17T11:53:23.656 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : postgresql-contrib-10.23-3.module+el8.9.0+20831+ 130/162 2023-12-17T11:53:23.735 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : postgresql-server-10.23-3.module+el8.9.0+20831+7 135/162 2023-12-17T11:53:23.816 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: postgresql-server-10.23-3.module+el8.9.0+20831+7 135/162 2023-12-17T11:53:23.879 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libtool-2.4.6-25.el8.x86_64 131/162 2023-12-17T11:53:23.910 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 131/162 2023-12-17T11:53:24.127 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : util-linux-user-2.32.1-43.el8.x86_64 132/162 2023-12-17T11:53:24.212 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 136/162 2023-12-17T11:53:24.335 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : xfsprogs-devel-5.0.0-12.el8.x86_64 133/162 2023-12-17T11:53:24.589 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libcephfs-devel-2:19.0.0-119.ga62fda73.el8.x86_6 134/162 2023-12-17T11:53:24.661 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 137/162 2023-12-17T11:53:24.920 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 138/162 2023-12-17T11:53:25.108 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : cephfs-top-2:19.0.0-119.ga62fda73.el8.noarch 139/162 2023-12-17T11:53:25.299 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-fuse-2:19.0.0-119.ga62fda73.el8.x86_64 140/162 2023-12-17T11:53:25.379 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: postgresql-server-10.23-3.module+el8.9.0+20831+7 135/162 2023-12-17T11:53:25.638 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : rbd-nbd-2:19.0.0-119.ga62fda73.el8.x86_64 141/162 2023-12-17T11:53:25.785 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : postgresql-server-10.23-3.module+el8.9.0+20831+7 135/162 2023-12-17T11:53:25.856 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: postgresql-server-10.23-3.module+el8.9.0+20831+7 135/162 2023-12-17T11:53:25.987 INFO:teuthology.orchestra.run.smithi100.stdout: Upgrading : openssl-1:1.1.1k-9.el8_7.x86_64 142/162 2023-12-17T11:53:26.237 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/162 2023-12-17T11:53:26.292 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 136/162 2023-12-17T11:53:26.347 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/162 2023-12-17T11:53:26.564 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/162 2023-12-17T11:53:26.595 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/162 2023-12-17T11:53:26.713 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 137/162 2023-12-17T11:53:26.764 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-9.el 145/162 2023-12-17T11:53:26.789 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 145/162 2023-12-17T11:53:26.934 INFO:teuthology.orchestra.run.smithi100.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 146/162 2023-12-17T11:53:27.016 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 138/162 2023-12-17T11:53:27.143 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 147/162 2023-12-17T11:53:27.296 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : cephfs-top-2:19.0.0-119.ga62fda73.el8.noarch 139/162 2023-12-17T11:53:27.325 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 148/162 2023-12-17T11:53:27.503 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 149/162 2023-12-17T11:53:27.503 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 150/162 2023-12-17T11:53:27.546 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : rbd-fuse-2:19.0.0-119.ga62fda73.el8.x86_64 140/162 2023-12-17T11:53:27.811 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 150/162 2023-12-17T11:53:27.811 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 151/162 2023-12-17T11:53:27.923 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : rbd-nbd-2:19.0.0-119.ga62fda73.el8.x86_64 141/162 2023-12-17T11:53:28.063 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 151/162 2023-12-17T11:53:28.063 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 152/162 2023-12-17T11:53:28.192 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: postgresql-server-10.23-3.module+el8.9.0+20831+7 135/162 2023-12-17T11:53:28.264 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : openssl-1:1.1.1k-9.el8_7.x86_64 142/162 2023-12-17T11:53:28.391 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 152/162 2023-12-17T11:53:28.502 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-9.el 143/162 2023-12-17T11:53:28.504 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : postgresql-server-10.23-3.module+el8.9.0+20831+7 135/162 2023-12-17T11:53:28.529 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 143/162 2023-12-17T11:53:28.623 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: postgresql-server-10.23-3.module+el8.9.0+20831+7 135/162 2023-12-17T11:53:28.633 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 153/162 2023-12-17T11:53:28.742 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 144/162 2023-12-17T11:53:28.819 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 154/162 2023-12-17T11:53:29.046 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : elfutils-libs-0.189-3.el8.x86_64 136/162 2023-12-17T11:53:29.047 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : flex-2.6.1-9.el8.x86_64 145/162 2023-12-17T11:53:29.075 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 155/162 2023-12-17T11:53:29.075 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 156/162 2023-12-17T11:53:29.189 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 145/162 2023-12-17T11:53:29.318 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 156/162 2023-12-17T11:53:29.318 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 157/162 2023-12-17T11:53:29.444 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : bison-3.0.4-10.el8.x86_64 146/162 2023-12-17T11:53:29.457 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : iproute-6.2.0-5.el8_9.x86_64 137/162 2023-12-17T11:53:29.475 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 146/162 2023-12-17T11:53:29.609 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 157/162 2023-12-17T11:53:29.609 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 158/162 2023-12-17T11:53:29.684 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : xfsdump-3.1.8-6.el8.x86_64 138/162 2023-12-17T11:53:29.696 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 147/162 2023-12-17T11:53:29.868 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 158/162 2023-12-17T11:53:29.868 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 159/162 2023-12-17T11:53:29.930 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 148/162 2023-12-17T11:53:29.930 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : cephfs-top-2:19.0.0-119.ga62fda73.el8.noarch 139/162 2023-12-17T11:53:30.117 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 149/162 2023-12-17T11:53:30.117 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 150/162 2023-12-17T11:53:30.131 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-fuse-2:19.0.0-119.ga62fda73.el8.x86_64 140/162 2023-12-17T11:53:30.134 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 159/162 2023-12-17T11:53:30.134 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 160/162 2023-12-17T11:53:30.375 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 160/162 2023-12-17T11:53:30.424 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 150/162 2023-12-17T11:53:30.424 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 151/162 2023-12-17T11:53:30.508 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : rbd-nbd-2:19.0.0-119.ga62fda73.el8.x86_64 141/162 2023-12-17T11:53:30.542 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 161/162 2023-12-17T11:53:30.542 INFO:teuthology.orchestra.run.smithi100.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2023-12-17T11:53:30.760 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 151/162 2023-12-17T11:53:30.760 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 152/162 2023-12-17T11:53:30.818 INFO:teuthology.orchestra.run.smithi008.stdout: Upgrading : openssl-1:1.1.1k-9.el8_7.x86_64 142/162 2023-12-17T11:53:31.043 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 152/162 2023-12-17T11:53:31.073 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : flex-2.6.1-9.el8.x86_64 143/162 2023-12-17T11:53:31.108 INFO:teuthology.orchestra.run.smithi100.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2023-12-17T11:53:31.108 INFO:teuthology.orchestra.run.smithi100.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-17T11:53:31.108 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-17T11:53:31.187 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 143/162 2023-12-17T11:53:31.287 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 153/162 2023-12-17T11:53:31.437 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : bison-3.0.4-10.el8.x86_64 144/162 2023-12-17T11:53:31.468 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 144/162 2023-12-17T11:53:31.515 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 154/162 2023-12-17T11:53:31.670 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : NetworkManager-initscripts-updown-1:1.40.16-9.el 145/162 2023-12-17T11:53:31.695 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.40.16-9.el 145/162 2023-12-17T11:53:31.785 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 155/162 2023-12-17T11:53:31.785 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 156/162 2023-12-17T11:53:31.788 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-2:19.0.0-119.ga62fda73.el8.x86_64 1/162 2023-12-17T11:53:31.788 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-base-2:19.0.0-119.ga62fda73.el8.x86_64 2/162 2023-12-17T11:53:31.788 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-common-2:19.0.0-119.ga62fda73.el8.x86_64 3/162 2023-12-17T11:53:31.788 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-fuse-2:19.0.0-119.ga62fda73.el8.x86_64 4/162 2023-12-17T11:53:31.788 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-119.ga62fda 5/162 2023-12-17T11:53:31.788 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mds-2:19.0.0-119.ga62fda73.el8.x86_64 6/162 2023-12-17T11:53:31.788 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-2:19.0.0-119.ga62fda73.el8.x86_64 7/162 2023-12-17T11:53:31.788 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mon-2:19.0.0-119.ga62fda73.el8.x86_64 8/162 2023-12-17T11:53:31.788 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-osd-2:19.0.0-119.ga62fda73.el8.x86_64 9/162 2023-12-17T11:53:31.788 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-radosgw-2:19.0.0-119.ga62fda73.el8.x86_64 10/162 2023-12-17T11:53:31.788 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-selinux-2:19.0.0-119.ga62fda73.el8.x86_64 11/162 2023-12-17T11:53:31.789 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-test-2:19.0.0-119.ga62fda73.el8.x86_64 12/162 2023-12-17T11:53:31.789 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 13/162 2023-12-17T11:53:31.789 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs-devel-2:19.0.0-119.ga62fda73.el8.x86_6 14/162 2023-12-17T11:53:31.789 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephfs2-2:19.0.0-119.ga62fda73.el8.x86_64 15/162 2023-12-17T11:53:31.789 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcephsqlite-2:19.0.0-119.ga62fda73.el8.x86_64 16/162 2023-12-17T11:53:31.789 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados-devel-2:19.0.0-119.ga62fda73.el8.x86_64 17/162 2023-12-17T11:53:31.789 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libradosstriper1-2:19.0.0-119.ga62fda73.el8.x86_ 18/162 2023-12-17T11:53:31.789 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librgw2-2:19.0.0-119.ga62fda73.el8.x86_64 19/162 2023-12-17T11:53:31.789 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-argparse-2:19.0.0-119.ga62fda73.el8 20/162 2023-12-17T11:53:31.789 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-ceph-common-2:19.0.0-119.ga62fda73.el8.x 21/162 2023-12-17T11:53:31.789 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cephfs-2:19.0.0-119.ga62fda73.el8.x86_64 22/162 2023-12-17T11:53:31.789 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rados-2:19.0.0-119.ga62fda73.el8.x86_64 23/162 2023-12-17T11:53:31.789 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rbd-2:19.0.0-119.ga62fda73.el8.x86_64 24/162 2023-12-17T11:53:31.789 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rgw-2:19.0.0-119.ga62fda73.el8.x86_64 25/162 2023-12-17T11:53:31.790 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-fuse-2:19.0.0-119.ga62fda73.el8.x86_64 26/162 2023-12-17T11:53:31.790 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 27/162 2023-12-17T11:53:31.790 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : rbd-nbd-2:19.0.0-119.ga62fda73.el8.x86_64 28/162 2023-12-17T11:53:31.790 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-119.ga62fda73.e 29/162 2023-12-17T11:53:31.790 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el8.noar 30/162 2023-12-17T11:53:31.790 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el8.no 31/162 2023-12-17T11:53:31.790 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-119.ga62f 32/162 2023-12-17T11:53:31.790 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-119.ga62fda73.el8 33/162 2023-12-17T11:53:31.790 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-mgr-rook-2:19.0.0-119.ga62fda73.el8.noarch 34/162 2023-12-17T11:53:31.790 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-119.ga62fda73.el 35/162 2023-12-17T11:53:31.790 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : ceph-volume-2:19.0.0-119.ga62fda73.el8.noarch 36/162 2023-12-17T11:53:31.790 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephadm-2:19.0.0-119.ga62fda73.el8.noarch 37/162 2023-12-17T11:53:31.790 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : cephfs-top-2:19.0.0-119.ga62fda73.el8.noarch 38/162 2023-12-17T11:53:31.790 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/162 2023-12-17T11:53:31.791 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/162 2023-12-17T11:53:31.791 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/162 2023-12-17T11:53:31.791 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : luarocks-3.5.0-1.el8.noarch 42/162 2023-12-17T11:53:31.791 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 43/162 2023-12-17T11:53:31.791 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 44/162 2023-12-17T11:53:31.791 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 45/162 2023-12-17T11:53:31.791 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 46/162 2023-12-17T11:53:31.791 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 47/162 2023-12-17T11:53:31.791 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 48/162 2023-12-17T11:53:31.791 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 49/162 2023-12-17T11:53:31.791 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 50/162 2023-12-17T11:53:31.791 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 51/162 2023-12-17T11:53:31.791 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 52/162 2023-12-17T11:53:31.791 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 53/162 2023-12-17T11:53:31.791 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 54/162 2023-12-17T11:53:31.792 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 55/162 2023-12-17T11:53:31.792 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 56/162 2023-12-17T11:53:31.792 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 57/162 2023-12-17T11:53:31.792 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-portend-2.6-1.el8.noarch 58/162 2023-12-17T11:53:31.792 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 59/162 2023-12-17T11:53:31.792 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 60/162 2023-12-17T11:53:31.792 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 61/162 2023-12-17T11:53:31.792 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 62/162 2023-12-17T11:53:31.792 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 63/162 2023-12-17T11:53:31.792 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 64/162 2023-12-17T11:53:31.792 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 65/162 2023-12-17T11:53:31.792 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 66/162 2023-12-17T11:53:31.792 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 67/162 2023-12-17T11:53:31.792 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 68/162 2023-12-17T11:53:31.793 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 69/162 2023-12-17T11:53:31.793 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 70/162 2023-12-17T11:53:31.793 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 71/162 2023-12-17T11:53:31.793 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 72/162 2023-12-17T11:53:31.793 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 73/162 2023-12-17T11:53:31.793 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/162 2023-12-17T11:53:31.793 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/162 2023-12-17T11:53:31.793 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/162 2023-12-17T11:53:31.793 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/162 2023-12-17T11:53:31.793 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 78/162 2023-12-17T11:53:31.793 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 79/162 2023-12-17T11:53:31.793 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 80/162 2023-12-17T11:53:31.793 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 81/162 2023-12-17T11:53:31.793 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 82/162 2023-12-17T11:53:31.794 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 83/162 2023-12-17T11:53:31.794 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 84/162 2023-12-17T11:53:31.794 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 85/162 2023-12-17T11:53:31.794 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 86/162 2023-12-17T11:53:31.794 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 87/162 2023-12-17T11:53:31.794 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8_7.x86_64 88/162 2023-12-17T11:53:31.794 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 89/162 2023-12-17T11:53:31.794 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 90/162 2023-12-17T11:53:31.794 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 91/162 2023-12-17T11:53:31.794 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libuuid-devel-2.32.1-43.el8.x86_64 92/162 2023-12-17T11:53:31.794 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 93/162 2023-12-17T11:53:31.794 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 94/162 2023-12-17T11:53:31.794 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/162 2023-12-17T11:53:31.794 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 96/162 2023-12-17T11:53:31.794 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 97/162 2023-12-17T11:53:31.795 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 98/162 2023-12-17T11:53:31.795 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 99/162 2023-12-17T11:53:31.795 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 100/162 2023-12-17T11:53:31.795 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 101/162 2023-12-17T11:53:31.795 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 102/162 2023-12-17T11:53:31.795 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 103/162 2023-12-17T11:53:31.795 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 104/162 2023-12-17T11:53:31.795 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 105/162 2023-12-17T11:53:31.795 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : bison-3.0.4-10.el8.x86_64 106/162 2023-12-17T11:53:31.795 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : flex-2.6.1-9.el8.x86_64 107/162 2023-12-17T11:53:31.795 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 108/162 2023-12-17T11:53:31.795 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 109/162 2023-12-17T11:53:31.795 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 110/162 2023-12-17T11:53:31.795 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 111/162 2023-12-17T11:53:31.796 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 112/162 2023-12-17T11:53:31.796 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 113/162 2023-12-17T11:53:31.796 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 114/162 2023-12-17T11:53:31.796 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 115/162 2023-12-17T11:53:31.796 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 116/162 2023-12-17T11:53:31.796 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 117/162 2023-12-17T11:53:31.796 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 118/162 2023-12-17T11:53:31.796 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 119/162 2023-12-17T11:53:31.796 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 120/162 2023-12-17T11:53:31.796 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 121/162 2023-12-17T11:53:31.796 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 122/162 2023-12-17T11:53:31.796 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : automake-1.16.1-8.el8.noarch 123/162 2023-12-17T11:53:31.796 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libpq-13.11-1.el8.x86_64 124/162 2023-12-17T11:53:31.796 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : jq-1.6-7.el8.x86_64 125/162 2023-12-17T11:53:31.796 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 126/162 2023-12-17T11:53:31.797 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-10.23-3.module+el8.9.0+20831+78489779 127/162 2023-12-17T11:53:31.797 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-contrib-10.23-3.module+el8.9.0+20831+ 128/162 2023-12-17T11:53:31.797 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : postgresql-server-10.23-3.module+el8.9.0+20831+7 129/162 2023-12-17T11:53:31.797 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 130/162 2023-12-17T11:53:31.797 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-2:19.0.0-119.ga62fda73.el8.x86_64 131/162 2023-12-17T11:53:31.797 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 132/162 2023-12-17T11:53:31.797 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-2:19.0.0-119.ga62fda73.el8.x86_64 133/162 2023-12-17T11:53:31.797 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 134/162 2023-12-17T11:53:31.797 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-1:1.1.1k-9.el8_7.x86_64 135/162 2023-12-17T11:53:31.797 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 136/162 2023-12-17T11:53:31.797 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8_7.x86_64 137/162 2023-12-17T11:53:31.797 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 138/162 2023-12-17T11:53:31.797 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 139/162 2023-12-17T11:53:31.797 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 140/162 2023-12-17T11:53:31.798 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 141/162 2023-12-17T11:53:31.798 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 142/162 2023-12-17T11:53:31.798 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 143/162 2023-12-17T11:53:31.798 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 144/162 2023-12-17T11:53:31.798 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 145/162 2023-12-17T11:53:31.798 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 146/162 2023-12-17T11:53:31.798 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 147/162 2023-12-17T11:53:31.798 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 148/162 2023-12-17T11:53:31.798 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 149/162 2023-12-17T11:53:31.798 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 150/162 2023-12-17T11:53:31.798 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 151/162 2023-12-17T11:53:31.798 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 152/162 2023-12-17T11:53:31.798 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 153/162 2023-12-17T11:53:31.798 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 154/162 2023-12-17T11:53:31.798 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 155/162 2023-12-17T11:53:31.799 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 156/162 2023-12-17T11:53:31.799 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 157/162 2023-12-17T11:53:31.799 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 158/162 2023-12-17T11:53:31.799 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 159/162 2023-12-17T11:53:31.799 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 160/162 2023-12-17T11:53:31.799 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 161/162 2023-12-17T11:53:31.848 INFO:teuthology.orchestra.run.smithi008.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 146/162 2023-12-17T11:53:32.063 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 156/162 2023-12-17T11:53:32.064 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 157/162 2023-12-17T11:53:32.067 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : elfutils-libs-0.186-1.el8.x86_64 147/162 2023-12-17T11:53:32.264 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : openssl-1:1.1.1k-6.el8_5.x86_64 148/162 2023-12-17T11:53:32.380 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 157/162 2023-12-17T11:53:32.381 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 158/162 2023-12-17T11:53:32.426 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : xfsdump-3.1.8-4.el8.x86_64 149/162 2023-12-17T11:53:32.426 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : xfsprogs-5.0.0-10.el8.x86_64 150/162 2023-12-17T11:53:32.680 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 158/162 2023-12-17T11:53:32.680 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 159/162 2023-12-17T11:53:32.734 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: xfsprogs-5.0.0-10.el8.x86_64 150/162 2023-12-17T11:53:32.734 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 151/162 2023-12-17T11:53:32.986 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 151/162 2023-12-17T11:53:32.986 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 152/162 2023-12-17T11:53:33.292 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 152/162 2023-12-17T11:53:33.472 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 153/162 2023-12-17T11:53:33.662 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : util-linux-user-2.32.1-35.el8.x86_64 154/162 2023-12-17T11:53:33.922 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : util-linux-2.32.1-35.el8.x86_64 155/162 2023-12-17T11:53:33.922 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : libfdisk-2.32.1-35.el8.x86_64 156/162 2023-12-17T11:53:34.233 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libfdisk-2.32.1-35.el8.x86_64 156/162 2023-12-17T11:53:34.233 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : libmount-2.32.1-35.el8.x86_64 157/162 2023-12-17T11:53:34.305 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 159/162 2023-12-17T11:53:34.305 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 160/162 2023-12-17T11:53:34.490 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libmount-2.32.1-35.el8.x86_64 157/162 2023-12-17T11:53:34.490 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : libblkid-2.32.1-35.el8.x86_64 158/162 2023-12-17T11:53:34.614 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 160/162 2023-12-17T11:53:34.773 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libblkid-2.32.1-35.el8.x86_64 158/162 2023-12-17T11:53:34.773 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : libuuid-2.32.1-35.el8.x86_64 159/162 2023-12-17T11:53:34.797 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 161/162 2023-12-17T11:53:34.797 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2023-12-17T11:53:35.441 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2023-12-17T11:53:35.441 INFO:teuthology.orchestra.run.smithi186.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-17T11:53:35.442 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-12-17T11:53:35.965 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libuuid-2.32.1-35.el8.x86_64 159/162 2023-12-17T11:53:35.966 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : libsmartcols-2.32.1-35.el8.x86_64 160/162 2023-12-17T11:53:36.179 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-2:19.0.0-119.ga62fda73.el8.x86_64 1/162 2023-12-17T11:53:36.179 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-base-2:19.0.0-119.ga62fda73.el8.x86_64 2/162 2023-12-17T11:53:36.179 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-common-2:19.0.0-119.ga62fda73.el8.x86_64 3/162 2023-12-17T11:53:36.179 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-fuse-2:19.0.0-119.ga62fda73.el8.x86_64 4/162 2023-12-17T11:53:36.179 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-119.ga62fda 5/162 2023-12-17T11:53:36.179 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mds-2:19.0.0-119.ga62fda73.el8.x86_64 6/162 2023-12-17T11:53:36.179 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-2:19.0.0-119.ga62fda73.el8.x86_64 7/162 2023-12-17T11:53:36.179 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mon-2:19.0.0-119.ga62fda73.el8.x86_64 8/162 2023-12-17T11:53:36.179 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-osd-2:19.0.0-119.ga62fda73.el8.x86_64 9/162 2023-12-17T11:53:36.179 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-radosgw-2:19.0.0-119.ga62fda73.el8.x86_64 10/162 2023-12-17T11:53:36.179 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-selinux-2:19.0.0-119.ga62fda73.el8.x86_64 11/162 2023-12-17T11:53:36.179 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-test-2:19.0.0-119.ga62fda73.el8.x86_64 12/162 2023-12-17T11:53:36.180 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : cephfs-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 13/162 2023-12-17T11:53:36.180 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libcephfs-devel-2:19.0.0-119.ga62fda73.el8.x86_6 14/162 2023-12-17T11:53:36.180 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libcephfs2-2:19.0.0-119.ga62fda73.el8.x86_64 15/162 2023-12-17T11:53:36.180 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libcephsqlite-2:19.0.0-119.ga62fda73.el8.x86_64 16/162 2023-12-17T11:53:36.180 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librados-devel-2:19.0.0-119.ga62fda73.el8.x86_64 17/162 2023-12-17T11:53:36.180 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libradosstriper1-2:19.0.0-119.ga62fda73.el8.x86_ 18/162 2023-12-17T11:53:36.180 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librgw2-2:19.0.0-119.ga62fda73.el8.x86_64 19/162 2023-12-17T11:53:36.180 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-ceph-argparse-2:19.0.0-119.ga62fda73.el8 20/162 2023-12-17T11:53:36.180 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-ceph-common-2:19.0.0-119.ga62fda73.el8.x 21/162 2023-12-17T11:53:36.180 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cephfs-2:19.0.0-119.ga62fda73.el8.x86_64 22/162 2023-12-17T11:53:36.180 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rados-2:19.0.0-119.ga62fda73.el8.x86_64 23/162 2023-12-17T11:53:36.180 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rbd-2:19.0.0-119.ga62fda73.el8.x86_64 24/162 2023-12-17T11:53:36.180 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rgw-2:19.0.0-119.ga62fda73.el8.x86_64 25/162 2023-12-17T11:53:36.193 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : rbd-fuse-2:19.0.0-119.ga62fda73.el8.x86_64 26/162 2023-12-17T11:53:36.193 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : rbd-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 27/162 2023-12-17T11:53:36.193 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : rbd-nbd-2:19.0.0-119.ga62fda73.el8.x86_64 28/162 2023-12-17T11:53:36.193 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-119.ga62fda73.e 29/162 2023-12-17T11:53:36.194 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el8.noar 30/162 2023-12-17T11:53:36.194 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el8.no 31/162 2023-12-17T11:53:36.194 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-119.ga62f 32/162 2023-12-17T11:53:36.194 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-119.ga62fda73.el8 33/162 2023-12-17T11:53:36.194 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-rook-2:19.0.0-119.ga62fda73.el8.noarch 34/162 2023-12-17T11:53:36.194 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-119.ga62fda73.el 35/162 2023-12-17T11:53:36.194 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-volume-2:19.0.0-119.ga62fda73.el8.noarch 36/162 2023-12-17T11:53:36.194 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : cephadm-2:19.0.0-119.ga62fda73.el8.noarch 37/162 2023-12-17T11:53:36.194 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : cephfs-top-2:19.0.0-119.ga62fda73.el8.noarch 38/162 2023-12-17T11:53:36.194 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/162 2023-12-17T11:53:36.194 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/162 2023-12-17T11:53:36.194 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/162 2023-12-17T11:53:36.194 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : luarocks-3.5.0-1.el8.noarch 42/162 2023-12-17T11:53:36.194 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 43/162 2023-12-17T11:53:36.194 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 44/162 2023-12-17T11:53:36.195 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 45/162 2023-12-17T11:53:36.195 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 46/162 2023-12-17T11:53:36.195 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 47/162 2023-12-17T11:53:36.195 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 48/162 2023-12-17T11:53:36.195 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 49/162 2023-12-17T11:53:36.195 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 50/162 2023-12-17T11:53:36.195 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 51/162 2023-12-17T11:53:36.195 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 52/162 2023-12-17T11:53:36.195 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 53/162 2023-12-17T11:53:36.195 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 54/162 2023-12-17T11:53:36.195 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 55/162 2023-12-17T11:53:36.195 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 56/162 2023-12-17T11:53:36.195 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 57/162 2023-12-17T11:53:36.196 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-portend-2.6-1.el8.noarch 58/162 2023-12-17T11:53:36.196 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 59/162 2023-12-17T11:53:36.196 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 60/162 2023-12-17T11:53:36.196 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 61/162 2023-12-17T11:53:36.196 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 62/162 2023-12-17T11:53:36.196 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 63/162 2023-12-17T11:53:36.196 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 64/162 2023-12-17T11:53:36.196 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 65/162 2023-12-17T11:53:36.196 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 66/162 2023-12-17T11:53:36.196 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 67/162 2023-12-17T11:53:36.196 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 68/162 2023-12-17T11:53:36.196 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 69/162 2023-12-17T11:53:36.196 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 70/162 2023-12-17T11:53:36.196 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 71/162 2023-12-17T11:53:36.196 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 72/162 2023-12-17T11:53:36.197 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 73/162 2023-12-17T11:53:36.197 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 74/162 2023-12-17T11:53:36.197 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 75/162 2023-12-17T11:53:36.197 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 76/162 2023-12-17T11:53:36.197 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 77/162 2023-12-17T11:53:36.197 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 78/162 2023-12-17T11:53:36.197 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : bison-3.0.4-10.el8.x86_64 79/162 2023-12-17T11:53:36.197 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : flex-2.6.1-9.el8.x86_64 80/162 2023-12-17T11:53:36.197 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 81/162 2023-12-17T11:53:36.197 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 82/162 2023-12-17T11:53:36.197 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 83/162 2023-12-17T11:53:36.197 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 84/162 2023-12-17T11:53:36.197 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 85/162 2023-12-17T11:53:36.197 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 86/162 2023-12-17T11:53:36.198 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 87/162 2023-12-17T11:53:36.198 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 88/162 2023-12-17T11:53:36.198 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 89/162 2023-12-17T11:53:36.198 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 90/162 2023-12-17T11:53:36.198 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 91/162 2023-12-17T11:53:36.198 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 92/162 2023-12-17T11:53:36.198 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 93/162 2023-12-17T11:53:36.198 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 94/162 2023-12-17T11:53:36.198 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 95/162 2023-12-17T11:53:36.198 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : automake-1.16.1-8.el8.noarch 96/162 2023-12-17T11:53:36.198 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libpq-13.11-1.el8.x86_64 97/162 2023-12-17T11:53:36.198 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : jq-1.6-7.el8.x86_64 98/162 2023-12-17T11:53:36.198 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 99/162 2023-12-17T11:53:36.198 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : postgresql-10.23-3.module+el8.9.0+20831+78489779 100/162 2023-12-17T11:53:36.198 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : postgresql-contrib-10.23-3.module+el8.9.0+20831+ 101/162 2023-12-17T11:53:36.199 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : postgresql-server-10.23-3.module+el8.9.0+20831+7 102/162 2023-12-17T11:53:36.199 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 103/162 2023-12-17T11:53:36.199 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 104/162 2023-12-17T11:53:36.199 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/162 2023-12-17T11:53:36.199 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 106/162 2023-12-17T11:53:36.199 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 107/162 2023-12-17T11:53:36.199 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 108/162 2023-12-17T11:53:36.199 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 109/162 2023-12-17T11:53:36.199 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 110/162 2023-12-17T11:53:36.199 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 111/162 2023-12-17T11:53:36.199 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 112/162 2023-12-17T11:53:36.199 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 113/162 2023-12-17T11:53:36.199 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 114/162 2023-12-17T11:53:36.199 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 115/162 2023-12-17T11:53:36.199 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 116/162 2023-12-17T11:53:36.200 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 117/162 2023-12-17T11:53:36.200 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 118/162 2023-12-17T11:53:36.200 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8_7.x86_64 119/162 2023-12-17T11:53:36.200 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 120/162 2023-12-17T11:53:36.200 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 121/162 2023-12-17T11:53:36.200 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 122/162 2023-12-17T11:53:36.200 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libuuid-devel-2.32.1-43.el8.x86_64 123/162 2023-12-17T11:53:36.200 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 124/162 2023-12-17T11:53:36.200 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 125/162 2023-12-17T11:53:36.200 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 126/162 2023-12-17T11:53:36.200 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 127/162 2023-12-17T11:53:36.200 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 128/162 2023-12-17T11:53:36.200 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 129/162 2023-12-17T11:53:36.200 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 130/162 2023-12-17T11:53:36.200 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librados2-2:19.0.0-119.ga62fda73.el8.x86_64 131/162 2023-12-17T11:53:36.201 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 132/162 2023-12-17T11:53:36.201 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librbd1-2:19.0.0-119.ga62fda73.el8.x86_64 133/162 2023-12-17T11:53:36.201 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 134/162 2023-12-17T11:53:36.201 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openssl-1:1.1.1k-9.el8_7.x86_64 135/162 2023-12-17T11:53:36.201 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 136/162 2023-12-17T11:53:36.201 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8_7.x86_64 137/162 2023-12-17T11:53:36.201 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 138/162 2023-12-17T11:53:36.201 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 139/162 2023-12-17T11:53:36.201 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 140/162 2023-12-17T11:53:36.201 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 141/162 2023-12-17T11:53:36.201 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 142/162 2023-12-17T11:53:36.201 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 143/162 2023-12-17T11:53:36.201 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 144/162 2023-12-17T11:53:36.201 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 145/162 2023-12-17T11:53:36.202 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 146/162 2023-12-17T11:53:36.202 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 147/162 2023-12-17T11:53:36.202 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 148/162 2023-12-17T11:53:36.202 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 149/162 2023-12-17T11:53:36.202 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 150/162 2023-12-17T11:53:36.202 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 151/162 2023-12-17T11:53:36.202 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 152/162 2023-12-17T11:53:36.202 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 153/162 2023-12-17T11:53:36.202 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 154/162 2023-12-17T11:53:36.202 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 155/162 2023-12-17T11:53:36.202 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 156/162 2023-12-17T11:53:36.202 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 157/162 2023-12-17T11:53:36.202 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 158/162 2023-12-17T11:53:36.202 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 159/162 2023-12-17T11:53:36.202 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 160/162 2023-12-17T11:53:36.203 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 161/162 2023-12-17T11:53:36.206 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: libsmartcols-2.32.1-35.el8.x86_64 160/162 2023-12-17T11:53:36.365 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : elfutils-libelf-0.186-1.el8.x86_64 161/162 2023-12-17T11:53:36.365 INFO:teuthology.orchestra.run.smithi008.stdout: Cleanup : openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2023-12-17T11:53:36.973 INFO:teuthology.orchestra.run.smithi008.stdout: Running scriptlet: openssl-libs-1:1.1.1k-6.el8_5.x86_64 162/162 2023-12-17T11:53:36.974 INFO:teuthology.orchestra.run.smithi008.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-17T11:53:36.974 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T11:53:37.708 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-2:19.0.0-119.ga62fda73.el8.x86_64 1/162 2023-12-17T11:53:37.709 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-base-2:19.0.0-119.ga62fda73.el8.x86_64 2/162 2023-12-17T11:53:37.709 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-common-2:19.0.0-119.ga62fda73.el8.x86_64 3/162 2023-12-17T11:53:37.709 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-fuse-2:19.0.0-119.ga62fda73.el8.x86_64 4/162 2023-12-17T11:53:37.709 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-119.ga62fda 5/162 2023-12-17T11:53:37.709 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mds-2:19.0.0-119.ga62fda73.el8.x86_64 6/162 2023-12-17T11:53:37.709 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-2:19.0.0-119.ga62fda73.el8.x86_64 7/162 2023-12-17T11:53:37.709 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mon-2:19.0.0-119.ga62fda73.el8.x86_64 8/162 2023-12-17T11:53:37.709 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-osd-2:19.0.0-119.ga62fda73.el8.x86_64 9/162 2023-12-17T11:53:37.709 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-radosgw-2:19.0.0-119.ga62fda73.el8.x86_64 10/162 2023-12-17T11:53:37.709 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-selinux-2:19.0.0-119.ga62fda73.el8.x86_64 11/162 2023-12-17T11:53:37.709 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-test-2:19.0.0-119.ga62fda73.el8.x86_64 12/162 2023-12-17T11:53:37.709 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cephfs-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 13/162 2023-12-17T11:53:37.710 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephfs-devel-2:19.0.0-119.ga62fda73.el8.x86_6 14/162 2023-12-17T11:53:37.710 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephfs2-2:19.0.0-119.ga62fda73.el8.x86_64 15/162 2023-12-17T11:53:37.710 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcephsqlite-2:19.0.0-119.ga62fda73.el8.x86_64 16/162 2023-12-17T11:53:37.710 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados-devel-2:19.0.0-119.ga62fda73.el8.x86_64 17/162 2023-12-17T11:53:37.710 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libradosstriper1-2:19.0.0-119.ga62fda73.el8.x86_ 18/162 2023-12-17T11:53:37.710 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librgw2-2:19.0.0-119.ga62fda73.el8.x86_64 19/162 2023-12-17T11:53:37.710 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-ceph-argparse-2:19.0.0-119.ga62fda73.el8 20/162 2023-12-17T11:53:37.710 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-ceph-common-2:19.0.0-119.ga62fda73.el8.x 21/162 2023-12-17T11:53:37.711 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cephfs-2:19.0.0-119.ga62fda73.el8.x86_64 22/162 2023-12-17T11:53:37.711 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rados-2:19.0.0-119.ga62fda73.el8.x86_64 23/162 2023-12-17T11:53:37.711 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rbd-2:19.0.0-119.ga62fda73.el8.x86_64 24/162 2023-12-17T11:53:37.711 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rgw-2:19.0.0-119.ga62fda73.el8.x86_64 25/162 2023-12-17T11:53:37.711 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-fuse-2:19.0.0-119.ga62fda73.el8.x86_64 26/162 2023-12-17T11:53:37.711 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 27/162 2023-12-17T11:53:37.725 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : rbd-nbd-2:19.0.0-119.ga62fda73.el8.x86_64 28/162 2023-12-17T11:53:37.725 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-119.ga62fda73.e 29/162 2023-12-17T11:53:37.725 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el8.noar 30/162 2023-12-17T11:53:37.725 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el8.no 31/162 2023-12-17T11:53:37.725 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-119.ga62f 32/162 2023-12-17T11:53:37.725 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-119.ga62fda73.el8 33/162 2023-12-17T11:53:37.725 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-mgr-rook-2:19.0.0-119.ga62fda73.el8.noarch 34/162 2023-12-17T11:53:37.725 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-119.ga62fda73.el 35/162 2023-12-17T11:53:37.725 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : ceph-volume-2:19.0.0-119.ga62fda73.el8.noarch 36/162 2023-12-17T11:53:37.726 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cephadm-2:19.0.0-119.ga62fda73.el8.noarch 37/162 2023-12-17T11:53:37.726 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : cephfs-top-2:19.0.0-119.ga62fda73.el8.noarch 38/162 2023-12-17T11:53:37.726 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/162 2023-12-17T11:53:37.726 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/162 2023-12-17T11:53:37.726 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/162 2023-12-17T11:53:37.726 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : luarocks-3.5.0-1.el8.noarch 42/162 2023-12-17T11:53:37.726 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 43/162 2023-12-17T11:53:37.726 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 44/162 2023-12-17T11:53:37.726 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 45/162 2023-12-17T11:53:37.726 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 46/162 2023-12-17T11:53:37.726 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 47/162 2023-12-17T11:53:37.726 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 48/162 2023-12-17T11:53:37.726 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 49/162 2023-12-17T11:53:37.726 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 50/162 2023-12-17T11:53:37.726 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 51/162 2023-12-17T11:53:37.727 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 52/162 2023-12-17T11:53:37.727 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 53/162 2023-12-17T11:53:37.727 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 54/162 2023-12-17T11:53:37.727 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 55/162 2023-12-17T11:53:37.727 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 56/162 2023-12-17T11:53:37.727 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 57/162 2023-12-17T11:53:37.727 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-portend-2.6-1.el8.noarch 58/162 2023-12-17T11:53:37.727 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 59/162 2023-12-17T11:53:37.727 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 60/162 2023-12-17T11:53:37.727 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 61/162 2023-12-17T11:53:37.727 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 62/162 2023-12-17T11:53:37.727 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 63/162 2023-12-17T11:53:37.727 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 64/162 2023-12-17T11:53:37.727 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 65/162 2023-12-17T11:53:37.727 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 66/162 2023-12-17T11:53:37.728 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 67/162 2023-12-17T11:53:37.728 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 68/162 2023-12-17T11:53:37.728 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 69/162 2023-12-17T11:53:37.728 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 70/162 2023-12-17T11:53:37.728 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 71/162 2023-12-17T11:53:37.728 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 72/162 2023-12-17T11:53:37.728 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 73/162 2023-12-17T11:53:37.728 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 74/162 2023-12-17T11:53:37.728 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 75/162 2023-12-17T11:53:37.728 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/162 2023-12-17T11:53:37.728 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 77/162 2023-12-17T11:53:37.728 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 78/162 2023-12-17T11:53:37.728 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libzstd-devel-1.4.4-1.el8.x86_64 79/162 2023-12-17T11:53:37.728 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 80/162 2023-12-17T11:53:37.729 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 81/162 2023-12-17T11:53:37.729 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 82/162 2023-12-17T11:53:37.729 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 83/162 2023-12-17T11:53:37.729 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 84/162 2023-12-17T11:53:37.729 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 85/162 2023-12-17T11:53:37.729 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 86/162 2023-12-17T11:53:37.729 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 87/162 2023-12-17T11:53:37.729 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openssl-devel-1:1.1.1k-9.el8_7.x86_64 88/162 2023-12-17T11:53:37.729 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : fuse-2.9.7-17.el8.x86_64 89/162 2023-12-17T11:53:37.729 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libgfortran-8.5.0-20.el8.x86_64 90/162 2023-12-17T11:53:37.729 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libquadmath-8.5.0-20.el8.x86_64 91/162 2023-12-17T11:53:37.729 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libuuid-devel-2.32.1-43.el8.x86_64 92/162 2023-12-17T11:53:37.729 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 93/162 2023-12-17T11:53:37.729 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-cryptography-3.2.1-6.el8.x86_64 94/162 2023-12-17T11:53:37.730 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xfsprogs-devel-5.0.0-12.el8.x86_64 95/162 2023-12-17T11:53:37.730 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : NetworkManager-initscripts-updown-1:1.40.16-9.el 96/162 2023-12-17T11:53:37.730 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-libelf-devel-0.189-3.el8.x86_64 97/162 2023-12-17T11:53:37.730 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librabbitmq-0.9.0-4.el8.x86_64 98/162 2023-12-17T11:53:37.730 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : krb5-devel-1.18.2-26.el8_9.x86_64 99/162 2023-12-17T11:53:37.730 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 100/162 2023-12-17T11:53:37.730 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 101/162 2023-12-17T11:53:37.730 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 102/162 2023-12-17T11:53:37.730 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 103/162 2023-12-17T11:53:37.730 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 104/162 2023-12-17T11:53:37.730 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 105/162 2023-12-17T11:53:37.730 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : bison-3.0.4-10.el8.x86_64 106/162 2023-12-17T11:53:37.730 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : flex-2.6.1-9.el8.x86_64 107/162 2023-12-17T11:53:37.730 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 108/162 2023-12-17T11:53:37.731 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 109/162 2023-12-17T11:53:37.731 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 110/162 2023-12-17T11:53:37.731 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 111/162 2023-12-17T11:53:37.731 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 112/162 2023-12-17T11:53:37.731 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 113/162 2023-12-17T11:53:37.731 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 114/162 2023-12-17T11:53:37.731 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 115/162 2023-12-17T11:53:37.731 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 116/162 2023-12-17T11:53:37.731 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 117/162 2023-12-17T11:53:37.731 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 118/162 2023-12-17T11:53:37.731 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 119/162 2023-12-17T11:53:37.731 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openblas-threads-0.3.15-6.el8.x86_64 120/162 2023-12-17T11:53:37.731 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 121/162 2023-12-17T11:53:37.731 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openblas-0.3.15-6.el8.x86_64 122/162 2023-12-17T11:53:37.732 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : automake-1.16.1-8.el8.noarch 123/162 2023-12-17T11:53:37.732 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libpq-13.11-1.el8.x86_64 124/162 2023-12-17T11:53:37.732 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : jq-1.6-7.el8.x86_64 125/162 2023-12-17T11:53:37.732 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 126/162 2023-12-17T11:53:37.732 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : postgresql-10.23-3.module+el8.9.0+20831+78489779 127/162 2023-12-17T11:53:37.732 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : postgresql-contrib-10.23-3.module+el8.9.0+20831+ 128/162 2023-12-17T11:53:37.732 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : postgresql-server-10.23-3.module+el8.9.0+20831+7 129/162 2023-12-17T11:53:37.732 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c3 130/162 2023-12-17T11:53:37.732 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados2-2:19.0.0-119.ga62fda73.el8.x86_64 131/162 2023-12-17T11:53:37.732 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 132/162 2023-12-17T11:53:37.732 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librbd1-2:19.0.0-119.ga62fda73.el8.x86_64 133/162 2023-12-17T11:53:37.732 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 134/162 2023-12-17T11:53:37.732 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openssl-1:1.1.1k-9.el8_7.x86_64 135/162 2023-12-17T11:53:37.732 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openssl-1:1.1.1k-6.el8_5.x86_64 136/162 2023-12-17T11:53:37.732 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openssl-libs-1:1.1.1k-9.el8_7.x86_64 137/162 2023-12-17T11:53:37.733 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : openssl-libs-1:1.1.1k-6.el8_5.x86_64 138/162 2023-12-17T11:53:37.733 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-libelf-0.189-3.el8.x86_64 139/162 2023-12-17T11:53:37.733 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-libelf-0.186-1.el8.x86_64 140/162 2023-12-17T11:53:37.733 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-libs-0.189-3.el8.x86_64 141/162 2023-12-17T11:53:37.733 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : elfutils-libs-0.186-1.el8.x86_64 142/162 2023-12-17T11:53:37.733 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libmount-2.32.1-43.el8.x86_64 143/162 2023-12-17T11:53:37.733 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libmount-2.32.1-35.el8.x86_64 144/162 2023-12-17T11:53:37.733 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libsmartcols-2.32.1-43.el8.x86_64 145/162 2023-12-17T11:53:37.733 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libsmartcols-2.32.1-35.el8.x86_64 146/162 2023-12-17T11:53:37.733 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libuuid-2.32.1-43.el8.x86_64 147/162 2023-12-17T11:53:37.733 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libuuid-2.32.1-35.el8.x86_64 148/162 2023-12-17T11:53:37.733 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : util-linux-2.32.1-43.el8.x86_64 149/162 2023-12-17T11:53:37.733 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : util-linux-2.32.1-35.el8.x86_64 150/162 2023-12-17T11:53:37.734 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : util-linux-user-2.32.1-43.el8.x86_64 151/162 2023-12-17T11:53:37.734 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : util-linux-user-2.32.1-35.el8.x86_64 152/162 2023-12-17T11:53:37.734 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xfsdump-3.1.8-6.el8.x86_64 153/162 2023-12-17T11:53:37.734 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xfsdump-3.1.8-4.el8.x86_64 154/162 2023-12-17T11:53:37.734 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : iproute-6.2.0-5.el8_9.x86_64 155/162 2023-12-17T11:53:37.734 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 156/162 2023-12-17T11:53:37.734 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libblkid-2.32.1-43.el8.x86_64 157/162 2023-12-17T11:53:37.734 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libblkid-2.32.1-35.el8.x86_64 158/162 2023-12-17T11:53:37.734 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libfdisk-2.32.1-43.el8.x86_64 159/162 2023-12-17T11:53:37.734 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : libfdisk-2.32.1-35.el8.x86_64 160/162 2023-12-17T11:53:37.734 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xfsprogs-5.0.0-12.el8.x86_64 161/162 2023-12-17T11:53:42.665 INFO:teuthology.orchestra.run.smithi100.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 162/162 2023-12-17T11:53:42.665 INFO:teuthology.orchestra.run.smithi100.stdout:Installed products updated. 2023-12-17T11:53:44.714 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-17T11:53:44.714 INFO:teuthology.orchestra.run.smithi100.stdout:Upgraded: 2023-12-17T11:53:44.714 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-12-17T11:53:44.714 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-12-17T11:53:44.714 INFO:teuthology.orchestra.run.smithi100.stdout: iproute-6.2.0-5.el8_9.x86_64 2023-12-17T11:53:44.714 INFO:teuthology.orchestra.run.smithi100.stdout: libblkid-2.32.1-43.el8.x86_64 2023-12-17T11:53:44.714 INFO:teuthology.orchestra.run.smithi100.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-12-17T11:53:44.714 INFO:teuthology.orchestra.run.smithi100.stdout: libmount-2.32.1-43.el8.x86_64 2023-12-17T11:53:44.714 INFO:teuthology.orchestra.run.smithi100.stdout: librados2-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:44.714 INFO:teuthology.orchestra.run.smithi100.stdout: librbd1-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:44.714 INFO:teuthology.orchestra.run.smithi100.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-12-17T11:53:44.715 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-2.32.1-43.el8.x86_64 2023-12-17T11:53:44.715 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-1:1.1.1k-9.el8_7.x86_64 2023-12-17T11:53:44.715 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-libs-1:1.1.1k-9.el8_7.x86_64 2023-12-17T11:53:44.715 INFO:teuthology.orchestra.run.smithi100.stdout: util-linux-2.32.1-43.el8.x86_64 2023-12-17T11:53:44.715 INFO:teuthology.orchestra.run.smithi100.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-12-17T11:53:44.715 INFO:teuthology.orchestra.run.smithi100.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-12-17T11:53:44.715 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-12-17T11:53:44.715 INFO:teuthology.orchestra.run.smithi100.stdout:Installed: 2023-12-17T11:53:44.715 INFO:teuthology.orchestra.run.smithi100.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-12-17T11:53:44.715 INFO:teuthology.orchestra.run.smithi100.stdout: automake-1.16.1-8.el8.noarch 2023-12-17T11:53:44.715 INFO:teuthology.orchestra.run.smithi100.stdout: bison-3.0.4-10.el8.x86_64 2023-12-17T11:53:44.716 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:44.716 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-base-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:44.716 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-common-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:44.716 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-fuse-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:44.716 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-grafana-dashboards-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-17T11:53:44.716 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-immutable-object-cache-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:44.716 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mds-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:44.716 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:44.716 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-17T11:53:44.716 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-17T11:53:44.716 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-diskprediction-local-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-17T11:53:44.716 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-modules-core-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-17T11:53:44.716 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mgr-rook-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-17T11:53:44.716 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-mon-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:44.717 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-osd-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:44.717 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-prometheus-alerts-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-17T11:53:44.717 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-radosgw-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:44.717 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-selinux-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:44.717 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-test-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:44.717 INFO:teuthology.orchestra.run.smithi100.stdout: ceph-volume-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-17T11:53:44.717 INFO:teuthology.orchestra.run.smithi100.stdout: cephadm-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-17T11:53:44.717 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:44.717 INFO:teuthology.orchestra.run.smithi100.stdout: cephfs-top-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-17T11:53:44.717 INFO:teuthology.orchestra.run.smithi100.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-12-17T11:53:44.718 INFO:teuthology.orchestra.run.smithi100.stdout: flex-2.6.1-9.el8.x86_64 2023-12-17T11:53:44.718 INFO:teuthology.orchestra.run.smithi100.stdout: fuse-2.9.7-17.el8.x86_64 2023-12-17T11:53:44.718 INFO:teuthology.orchestra.run.smithi100.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-17T11:53:44.718 INFO:teuthology.orchestra.run.smithi100.stdout: jq-1.6-7.el8.x86_64 2023-12-17T11:53:44.718 INFO:teuthology.orchestra.run.smithi100.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-12-17T11:53:44.718 INFO:teuthology.orchestra.run.smithi100.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2023-12-17T11:53:44.718 INFO:teuthology.orchestra.run.smithi100.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-12-17T11:53:44.718 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs-devel-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:44.718 INFO:teuthology.orchestra.run.smithi100.stdout: libcephfs2-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:44.718 INFO:teuthology.orchestra.run.smithi100.stdout: libcephsqlite-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:44.718 INFO:teuthology.orchestra.run.smithi100.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-12-17T11:53:44.718 INFO:teuthology.orchestra.run.smithi100.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-12-17T11:53:44.718 INFO:teuthology.orchestra.run.smithi100.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-17T11:53:44.718 INFO:teuthology.orchestra.run.smithi100.stdout: libpq-13.11-1.el8.x86_64 2023-12-17T11:53:44.719 INFO:teuthology.orchestra.run.smithi100.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-12-17T11:53:44.719 INFO:teuthology.orchestra.run.smithi100.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-12-17T11:53:44.719 INFO:teuthology.orchestra.run.smithi100.stdout: librados-devel-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:44.719 INFO:teuthology.orchestra.run.smithi100.stdout: libradosstriper1-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:44.719 INFO:teuthology.orchestra.run.smithi100.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-12-17T11:53:44.719 INFO:teuthology.orchestra.run.smithi100.stdout: librgw2-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:44.719 INFO:teuthology.orchestra.run.smithi100.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-12-17T11:53:44.719 INFO:teuthology.orchestra.run.smithi100.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-12-17T11:53:44.719 INFO:teuthology.orchestra.run.smithi100.stdout: libtool-2.4.6-25.el8.x86_64 2023-12-17T11:53:44.719 INFO:teuthology.orchestra.run.smithi100.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-17T11:53:44.719 INFO:teuthology.orchestra.run.smithi100.stdout: libuuid-devel-2.32.1-43.el8.x86_64 2023-12-17T11:53:44.719 INFO:teuthology.orchestra.run.smithi100.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-12-17T11:53:44.719 INFO:teuthology.orchestra.run.smithi100.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-12-17T11:53:44.719 INFO:teuthology.orchestra.run.smithi100.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-17T11:53:44.720 INFO:teuthology.orchestra.run.smithi100.stdout: luarocks-3.5.0-1.el8.noarch 2023-12-17T11:53:44.720 INFO:teuthology.orchestra.run.smithi100.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-17T11:53:44.720 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-0.3.15-6.el8.x86_64 2023-12-17T11:53:44.720 INFO:teuthology.orchestra.run.smithi100.stdout: openblas-threads-0.3.15-6.el8.x86_64 2023-12-17T11:53:44.720 INFO:teuthology.orchestra.run.smithi100.stdout: openssl-devel-1:1.1.1k-9.el8_7.x86_64 2023-12-17T11:53:44.720 INFO:teuthology.orchestra.run.smithi100.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-12-17T11:53:44.720 INFO:teuthology.orchestra.run.smithi100.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-12-17T11:53:44.720 INFO:teuthology.orchestra.run.smithi100.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-12-17T11:53:44.720 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-10.23-3.module+el8.9.0+20831+78489779.x86_64 2023-12-17T11:53:44.720 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-contrib-10.23-3.module+el8.9.0+20831+78489779.x86_64 2023-12-17T11:53:44.720 INFO:teuthology.orchestra.run.smithi100.stdout: postgresql-server-10.23-3.module+el8.9.0+20831+78489779.x86_64 2023-12-17T11:53:44.720 INFO:teuthology.orchestra.run.smithi100.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-17T11:53:44.720 INFO:teuthology.orchestra.run.smithi100.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-17T11:53:44.720 INFO:teuthology.orchestra.run.smithi100.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-17T11:53:44.721 INFO:teuthology.orchestra.run.smithi100.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-17T11:53:44.721 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-17T11:53:44.721 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-argparse-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:44.721 INFO:teuthology.orchestra.run.smithi100.stdout: python3-ceph-common-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:44.721 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cephfs-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:44.721 INFO:teuthology.orchestra.run.smithi100.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-17T11:53:44.721 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-12-17T11:53:44.721 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-17T11:53:44.721 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-17T11:53:44.721 INFO:teuthology.orchestra.run.smithi100.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-12-17T11:53:44.721 INFO:teuthology.orchestra.run.smithi100.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-17T11:53:44.721 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-17T11:53:44.721 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-17T11:53:44.722 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-17T11:53:44.722 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-17T11:53:44.722 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-17T11:53:44.722 INFO:teuthology.orchestra.run.smithi100.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-17T11:53:44.722 INFO:teuthology.orchestra.run.smithi100.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-17T11:53:44.722 INFO:teuthology.orchestra.run.smithi100.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-17T11:53:44.722 INFO:teuthology.orchestra.run.smithi100.stdout: python3-mako-1.0.6-14.el8.noarch 2023-12-17T11:53:44.722 INFO:teuthology.orchestra.run.smithi100.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-17T11:53:44.722 INFO:teuthology.orchestra.run.smithi100.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-17T11:53:44.722 INFO:teuthology.orchestra.run.smithi100.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-17T11:53:44.722 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-17T11:53:44.722 INFO:teuthology.orchestra.run.smithi100.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-17T11:53:44.722 INFO:teuthology.orchestra.run.smithi100.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-17T11:53:44.722 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-17T11:53:44.723 INFO:teuthology.orchestra.run.smithi100.stdout: python3-portend-2.6-1.el8.noarch 2023-12-17T11:53:44.723 INFO:teuthology.orchestra.run.smithi100.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-17T11:53:44.723 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-17T11:53:44.723 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-17T11:53:44.723 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-17T11:53:44.723 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-17T11:53:44.723 INFO:teuthology.orchestra.run.smithi100.stdout: python3-pytz-2017.2-11.el8.noarch 2023-12-17T11:53:44.723 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rados-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:44.723 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rbd-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:44.723 INFO:teuthology.orchestra.run.smithi100.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-17T11:53:44.723 INFO:teuthology.orchestra.run.smithi100.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-17T11:53:44.723 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rgw-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:44.723 INFO:teuthology.orchestra.run.smithi100.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-17T11:53:44.723 INFO:teuthology.orchestra.run.smithi100.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-17T11:53:44.723 INFO:teuthology.orchestra.run.smithi100.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2023-12-17T11:53:44.724 INFO:teuthology.orchestra.run.smithi100.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-17T11:53:44.724 INFO:teuthology.orchestra.run.smithi100.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-17T11:53:44.724 INFO:teuthology.orchestra.run.smithi100.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-17T11:53:44.724 INFO:teuthology.orchestra.run.smithi100.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-17T11:53:44.724 INFO:teuthology.orchestra.run.smithi100.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-17T11:53:44.724 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-17T11:53:44.724 INFO:teuthology.orchestra.run.smithi100.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-17T11:53:44.724 INFO:teuthology.orchestra.run.smithi100.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-17T11:53:44.724 INFO:teuthology.orchestra.run.smithi100.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-17T11:53:44.724 INFO:teuthology.orchestra.run.smithi100.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-17T11:53:44.724 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-fuse-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:44.724 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:44.724 INFO:teuthology.orchestra.run.smithi100.stdout: rbd-nbd-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:44.724 INFO:teuthology.orchestra.run.smithi100.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-17T11:53:44.725 INFO:teuthology.orchestra.run.smithi100.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-17T11:53:44.725 INFO:teuthology.orchestra.run.smithi100.stdout: uuid-1.6.2-43.el8.x86_64 2023-12-17T11:53:44.725 INFO:teuthology.orchestra.run.smithi100.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-12-17T11:53:44.725 INFO:teuthology.orchestra.run.smithi100.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-17T11:53:44.725 INFO:teuthology.orchestra.run.smithi100.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-12-17T11:53:44.725 INFO:teuthology.orchestra.run.smithi100.stdout: 2023-12-17T11:53:44.725 INFO:teuthology.orchestra.run.smithi100.stdout:Complete! 2023-12-17T11:53:45.063 DEBUG:teuthology.parallel:result is None 2023-12-17T11:53:50.383 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 162/162 2023-12-17T11:53:50.383 INFO:teuthology.orchestra.run.smithi186.stdout:Installed products updated. 2023-12-17T11:53:50.698 INFO:teuthology.orchestra.run.smithi008.stdout: Verifying : xfsprogs-5.0.0-10.el8.x86_64 162/162 2023-12-17T11:53:50.698 INFO:teuthology.orchestra.run.smithi008.stdout:Installed products updated. 2023-12-17T11:53:51.373 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T11:53:51.373 INFO:teuthology.orchestra.run.smithi008.stdout:Upgraded: 2023-12-17T11:53:51.373 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-12-17T11:53:51.373 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-12-17T11:53:51.373 INFO:teuthology.orchestra.run.smithi008.stdout: iproute-6.2.0-5.el8_9.x86_64 2023-12-17T11:53:51.373 INFO:teuthology.orchestra.run.smithi008.stdout: libblkid-2.32.1-43.el8.x86_64 2023-12-17T11:53:51.374 INFO:teuthology.orchestra.run.smithi008.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-12-17T11:53:51.374 INFO:teuthology.orchestra.run.smithi008.stdout: libmount-2.32.1-43.el8.x86_64 2023-12-17T11:53:51.374 INFO:teuthology.orchestra.run.smithi008.stdout: librados2-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.374 INFO:teuthology.orchestra.run.smithi008.stdout: librbd1-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.374 INFO:teuthology.orchestra.run.smithi008.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-12-17T11:53:51.374 INFO:teuthology.orchestra.run.smithi008.stdout: libuuid-2.32.1-43.el8.x86_64 2023-12-17T11:53:51.374 INFO:teuthology.orchestra.run.smithi008.stdout: openssl-1:1.1.1k-9.el8_7.x86_64 2023-12-17T11:53:51.374 INFO:teuthology.orchestra.run.smithi008.stdout: openssl-libs-1:1.1.1k-9.el8_7.x86_64 2023-12-17T11:53:51.374 INFO:teuthology.orchestra.run.smithi008.stdout: util-linux-2.32.1-43.el8.x86_64 2023-12-17T11:53:51.374 INFO:teuthology.orchestra.run.smithi008.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-12-17T11:53:51.374 INFO:teuthology.orchestra.run.smithi008.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-12-17T11:53:51.374 INFO:teuthology.orchestra.run.smithi008.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-12-17T11:53:51.375 INFO:teuthology.orchestra.run.smithi008.stdout:Installed: 2023-12-17T11:53:51.375 INFO:teuthology.orchestra.run.smithi008.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-12-17T11:53:51.375 INFO:teuthology.orchestra.run.smithi008.stdout: automake-1.16.1-8.el8.noarch 2023-12-17T11:53:51.375 INFO:teuthology.orchestra.run.smithi008.stdout: bison-3.0.4-10.el8.x86_64 2023-12-17T11:53:51.375 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.375 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-base-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.375 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-common-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.375 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-fuse-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.375 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-grafana-dashboards-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-17T11:53:51.375 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-immutable-object-cache-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.375 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mds-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.375 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.376 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-17T11:53:51.376 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-17T11:53:51.376 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-diskprediction-local-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-17T11:53:51.376 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-modules-core-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-17T11:53:51.376 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mgr-rook-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-17T11:53:51.376 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-mon-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.376 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-osd-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.376 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-prometheus-alerts-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-17T11:53:51.376 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-radosgw-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.376 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-selinux-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.376 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-test-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.376 INFO:teuthology.orchestra.run.smithi008.stdout: ceph-volume-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-17T11:53:51.376 INFO:teuthology.orchestra.run.smithi008.stdout: cephadm-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-17T11:53:51.376 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.376 INFO:teuthology.orchestra.run.smithi008.stdout: cephfs-top-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-17T11:53:51.377 INFO:teuthology.orchestra.run.smithi008.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-12-17T11:53:51.377 INFO:teuthology.orchestra.run.smithi008.stdout: flex-2.6.1-9.el8.x86_64 2023-12-17T11:53:51.377 INFO:teuthology.orchestra.run.smithi008.stdout: fuse-2.9.7-17.el8.x86_64 2023-12-17T11:53:51.377 INFO:teuthology.orchestra.run.smithi008.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-17T11:53:51.377 INFO:teuthology.orchestra.run.smithi008.stdout: jq-1.6-7.el8.x86_64 2023-12-17T11:53:51.377 INFO:teuthology.orchestra.run.smithi008.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-12-17T11:53:51.377 INFO:teuthology.orchestra.run.smithi008.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2023-12-17T11:53:51.377 INFO:teuthology.orchestra.run.smithi008.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-12-17T11:53:51.377 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs-devel-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.377 INFO:teuthology.orchestra.run.smithi008.stdout: libcephfs2-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.378 INFO:teuthology.orchestra.run.smithi008.stdout: libcephsqlite-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.378 INFO:teuthology.orchestra.run.smithi008.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-12-17T11:53:51.378 INFO:teuthology.orchestra.run.smithi008.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-12-17T11:53:51.378 INFO:teuthology.orchestra.run.smithi008.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-17T11:53:51.378 INFO:teuthology.orchestra.run.smithi008.stdout: libpq-13.11-1.el8.x86_64 2023-12-17T11:53:51.378 INFO:teuthology.orchestra.run.smithi008.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-12-17T11:53:51.378 INFO:teuthology.orchestra.run.smithi008.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-12-17T11:53:51.378 INFO:teuthology.orchestra.run.smithi008.stdout: librados-devel-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.378 INFO:teuthology.orchestra.run.smithi008.stdout: libradosstriper1-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.378 INFO:teuthology.orchestra.run.smithi008.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-12-17T11:53:51.378 INFO:teuthology.orchestra.run.smithi008.stdout: librgw2-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.378 INFO:teuthology.orchestra.run.smithi008.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-12-17T11:53:51.379 INFO:teuthology.orchestra.run.smithi008.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-12-17T11:53:51.379 INFO:teuthology.orchestra.run.smithi008.stdout: libtool-2.4.6-25.el8.x86_64 2023-12-17T11:53:51.379 INFO:teuthology.orchestra.run.smithi008.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-17T11:53:51.379 INFO:teuthology.orchestra.run.smithi008.stdout: libuuid-devel-2.32.1-43.el8.x86_64 2023-12-17T11:53:51.379 INFO:teuthology.orchestra.run.smithi008.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-12-17T11:53:51.379 INFO:teuthology.orchestra.run.smithi008.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-12-17T11:53:51.379 INFO:teuthology.orchestra.run.smithi008.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-17T11:53:51.379 INFO:teuthology.orchestra.run.smithi008.stdout: luarocks-3.5.0-1.el8.noarch 2023-12-17T11:53:51.379 INFO:teuthology.orchestra.run.smithi008.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-17T11:53:51.379 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-0.3.15-6.el8.x86_64 2023-12-17T11:53:51.379 INFO:teuthology.orchestra.run.smithi008.stdout: openblas-threads-0.3.15-6.el8.x86_64 2023-12-17T11:53:51.379 INFO:teuthology.orchestra.run.smithi008.stdout: openssl-devel-1:1.1.1k-9.el8_7.x86_64 2023-12-17T11:53:51.379 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-12-17T11:53:51.380 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-12-17T11:53:51.380 INFO:teuthology.orchestra.run.smithi008.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-12-17T11:53:51.380 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-10.23-3.module+el8.9.0+20831+78489779.x86_64 2023-12-17T11:53:51.380 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-contrib-10.23-3.module+el8.9.0+20831+78489779.x86_64 2023-12-17T11:53:51.380 INFO:teuthology.orchestra.run.smithi008.stdout: postgresql-server-10.23-3.module+el8.9.0+20831+78489779.x86_64 2023-12-17T11:53:51.380 INFO:teuthology.orchestra.run.smithi008.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-17T11:53:51.380 INFO:teuthology.orchestra.run.smithi008.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-17T11:53:51.380 INFO:teuthology.orchestra.run.smithi008.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-17T11:53:51.380 INFO:teuthology.orchestra.run.smithi008.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-17T11:53:51.380 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-17T11:53:51.380 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-argparse-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.380 INFO:teuthology.orchestra.run.smithi008.stdout: python3-ceph-common-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.380 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cephfs-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.380 INFO:teuthology.orchestra.run.smithi008.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-17T11:53:51.380 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-12-17T11:53:51.380 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-17T11:53:51.381 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-17T11:53:51.381 INFO:teuthology.orchestra.run.smithi008.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-12-17T11:53:51.381 INFO:teuthology.orchestra.run.smithi008.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-17T11:53:51.381 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-17T11:53:51.381 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-17T11:53:51.381 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-17T11:53:51.381 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-17T11:53:51.381 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-17T11:53:51.381 INFO:teuthology.orchestra.run.smithi008.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-17T11:53:51.381 INFO:teuthology.orchestra.run.smithi008.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-17T11:53:51.381 INFO:teuthology.orchestra.run.smithi008.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-17T11:53:51.381 INFO:teuthology.orchestra.run.smithi008.stdout: python3-mako-1.0.6-14.el8.noarch 2023-12-17T11:53:51.381 INFO:teuthology.orchestra.run.smithi008.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-17T11:53:51.381 INFO:teuthology.orchestra.run.smithi008.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-17T11:53:51.382 INFO:teuthology.orchestra.run.smithi008.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-17T11:53:51.382 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-17T11:53:51.382 INFO:teuthology.orchestra.run.smithi008.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-17T11:53:51.382 INFO:teuthology.orchestra.run.smithi008.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-17T11:53:51.382 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-17T11:53:51.382 INFO:teuthology.orchestra.run.smithi008.stdout: python3-portend-2.6-1.el8.noarch 2023-12-17T11:53:51.382 INFO:teuthology.orchestra.run.smithi008.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-17T11:53:51.382 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-17T11:53:51.382 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-17T11:53:51.382 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-17T11:53:51.382 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-17T11:53:51.382 INFO:teuthology.orchestra.run.smithi008.stdout: python3-pytz-2017.2-11.el8.noarch 2023-12-17T11:53:51.383 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rados-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.383 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rbd-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.383 INFO:teuthology.orchestra.run.smithi008.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-17T11:53:51.383 INFO:teuthology.orchestra.run.smithi008.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-17T11:53:51.383 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rgw-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.383 INFO:teuthology.orchestra.run.smithi008.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-17T11:53:51.383 INFO:teuthology.orchestra.run.smithi008.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-17T11:53:51.383 INFO:teuthology.orchestra.run.smithi008.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2023-12-17T11:53:51.383 INFO:teuthology.orchestra.run.smithi008.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-17T11:53:51.383 INFO:teuthology.orchestra.run.smithi008.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-17T11:53:51.383 INFO:teuthology.orchestra.run.smithi008.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-17T11:53:51.383 INFO:teuthology.orchestra.run.smithi008.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-17T11:53:51.383 INFO:teuthology.orchestra.run.smithi008.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-17T11:53:51.383 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-17T11:53:51.384 INFO:teuthology.orchestra.run.smithi008.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-17T11:53:51.384 INFO:teuthology.orchestra.run.smithi008.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-17T11:53:51.384 INFO:teuthology.orchestra.run.smithi008.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-17T11:53:51.384 INFO:teuthology.orchestra.run.smithi008.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-17T11:53:51.384 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-fuse-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.384 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.384 INFO:teuthology.orchestra.run.smithi008.stdout: rbd-nbd-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.384 INFO:teuthology.orchestra.run.smithi008.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-17T11:53:51.384 INFO:teuthology.orchestra.run.smithi008.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-17T11:53:51.384 INFO:teuthology.orchestra.run.smithi008.stdout: uuid-1.6.2-43.el8.x86_64 2023-12-17T11:53:51.384 INFO:teuthology.orchestra.run.smithi008.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-12-17T11:53:51.384 INFO:teuthology.orchestra.run.smithi008.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-17T11:53:51.385 INFO:teuthology.orchestra.run.smithi008.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-12-17T11:53:51.385 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T11:53:51.385 INFO:teuthology.orchestra.run.smithi008.stdout:Complete! 2023-12-17T11:53:51.737 DEBUG:teuthology.parallel:result is None 2023-12-17T11:53:51.894 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-12-17T11:53:51.894 INFO:teuthology.orchestra.run.smithi186.stdout:Upgraded: 2023-12-17T11:53:51.895 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-libelf-0.189-3.el8.x86_64 2023-12-17T11:53:51.895 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-libs-0.189-3.el8.x86_64 2023-12-17T11:53:51.895 INFO:teuthology.orchestra.run.smithi186.stdout: iproute-6.2.0-5.el8_9.x86_64 2023-12-17T11:53:51.895 INFO:teuthology.orchestra.run.smithi186.stdout: libblkid-2.32.1-43.el8.x86_64 2023-12-17T11:53:51.895 INFO:teuthology.orchestra.run.smithi186.stdout: libfdisk-2.32.1-43.el8.x86_64 2023-12-17T11:53:51.895 INFO:teuthology.orchestra.run.smithi186.stdout: libmount-2.32.1-43.el8.x86_64 2023-12-17T11:53:51.895 INFO:teuthology.orchestra.run.smithi186.stdout: librados2-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.895 INFO:teuthology.orchestra.run.smithi186.stdout: librbd1-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.895 INFO:teuthology.orchestra.run.smithi186.stdout: libsmartcols-2.32.1-43.el8.x86_64 2023-12-17T11:53:51.895 INFO:teuthology.orchestra.run.smithi186.stdout: libuuid-2.32.1-43.el8.x86_64 2023-12-17T11:53:51.895 INFO:teuthology.orchestra.run.smithi186.stdout: openssl-1:1.1.1k-9.el8_7.x86_64 2023-12-17T11:53:51.896 INFO:teuthology.orchestra.run.smithi186.stdout: openssl-libs-1:1.1.1k-9.el8_7.x86_64 2023-12-17T11:53:51.896 INFO:teuthology.orchestra.run.smithi186.stdout: util-linux-2.32.1-43.el8.x86_64 2023-12-17T11:53:51.896 INFO:teuthology.orchestra.run.smithi186.stdout: util-linux-user-2.32.1-43.el8.x86_64 2023-12-17T11:53:51.896 INFO:teuthology.orchestra.run.smithi186.stdout: xfsdump-3.1.8-6.el8.x86_64 2023-12-17T11:53:51.896 INFO:teuthology.orchestra.run.smithi186.stdout: xfsprogs-5.0.0-12.el8.x86_64 2023-12-17T11:53:51.896 INFO:teuthology.orchestra.run.smithi186.stdout:Installed: 2023-12-17T11:53:51.896 INFO:teuthology.orchestra.run.smithi186.stdout: NetworkManager-initscripts-updown-1:1.40.16-9.el8.noarch 2023-12-17T11:53:51.896 INFO:teuthology.orchestra.run.smithi186.stdout: automake-1.16.1-8.el8.noarch 2023-12-17T11:53:51.896 INFO:teuthology.orchestra.run.smithi186.stdout: bison-3.0.4-10.el8.x86_64 2023-12-17T11:53:51.896 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.896 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-base-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.896 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-common-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.897 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-fuse-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.897 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-grafana-dashboards-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-17T11:53:51.897 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-immutable-object-cache-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.897 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mds-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.897 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.897 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-17T11:53:51.897 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-17T11:53:51.897 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-diskprediction-local-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-17T11:53:51.897 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-modules-core-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-17T11:53:51.897 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-rook-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-17T11:53:51.897 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mon-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.897 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-osd-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.897 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-prometheus-alerts-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-17T11:53:51.897 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-radosgw-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.898 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-selinux-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.898 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-test-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.898 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-volume-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-17T11:53:51.898 INFO:teuthology.orchestra.run.smithi186.stdout: cephadm-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-17T11:53:51.898 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.898 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-top-2:19.0.0-119.ga62fda73.el8.noarch 2023-12-17T11:53:51.898 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-libelf-devel-0.189-3.el8.x86_64 2023-12-17T11:53:51.898 INFO:teuthology.orchestra.run.smithi186.stdout: flex-2.6.1-9.el8.x86_64 2023-12-17T11:53:51.898 INFO:teuthology.orchestra.run.smithi186.stdout: fuse-2.9.7-17.el8.x86_64 2023-12-17T11:53:51.898 INFO:teuthology.orchestra.run.smithi186.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-12-17T11:53:51.898 INFO:teuthology.orchestra.run.smithi186.stdout: jq-1.6-7.el8.x86_64 2023-12-17T11:53:51.898 INFO:teuthology.orchestra.run.smithi186.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-12-17T11:53:51.898 INFO:teuthology.orchestra.run.smithi186.stdout: krb5-devel-1.18.2-26.el8_9.x86_64 2023-12-17T11:53:51.898 INFO:teuthology.orchestra.run.smithi186.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-12-17T11:53:51.899 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs-devel-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.899 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs2-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.899 INFO:teuthology.orchestra.run.smithi186.stdout: libcephsqlite-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.899 INFO:teuthology.orchestra.run.smithi186.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-12-17T11:53:51.899 INFO:teuthology.orchestra.run.smithi186.stdout: libgfortran-8.5.0-20.el8.x86_64 2023-12-17T11:53:51.899 INFO:teuthology.orchestra.run.smithi186.stdout: liboath-2.6.2-3.el8.x86_64 2023-12-17T11:53:51.899 INFO:teuthology.orchestra.run.smithi186.stdout: libpq-13.11-1.el8.x86_64 2023-12-17T11:53:51.899 INFO:teuthology.orchestra.run.smithi186.stdout: libquadmath-8.5.0-20.el8.x86_64 2023-12-17T11:53:51.899 INFO:teuthology.orchestra.run.smithi186.stdout: librabbitmq-0.9.0-4.el8.x86_64 2023-12-17T11:53:51.899 INFO:teuthology.orchestra.run.smithi186.stdout: librados-devel-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.899 INFO:teuthology.orchestra.run.smithi186.stdout: libradosstriper1-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.899 INFO:teuthology.orchestra.run.smithi186.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-12-17T11:53:51.899 INFO:teuthology.orchestra.run.smithi186.stdout: librgw2-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.899 INFO:teuthology.orchestra.run.smithi186.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-12-17T11:53:51.900 INFO:teuthology.orchestra.run.smithi186.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-12-17T11:53:51.900 INFO:teuthology.orchestra.run.smithi186.stdout: libtool-2.4.6-25.el8.x86_64 2023-12-17T11:53:51.900 INFO:teuthology.orchestra.run.smithi186.stdout: libunwind-1.3.1-3.el8.x86_64 2023-12-17T11:53:51.900 INFO:teuthology.orchestra.run.smithi186.stdout: libuuid-devel-2.32.1-43.el8.x86_64 2023-12-17T11:53:51.900 INFO:teuthology.orchestra.run.smithi186.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-12-17T11:53:51.900 INFO:teuthology.orchestra.run.smithi186.stdout: libzstd-devel-1.4.4-1.el8.x86_64 2023-12-17T11:53:51.900 INFO:teuthology.orchestra.run.smithi186.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-12-17T11:53:51.900 INFO:teuthology.orchestra.run.smithi186.stdout: luarocks-3.5.0-1.el8.noarch 2023-12-17T11:53:51.900 INFO:teuthology.orchestra.run.smithi186.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-12-17T11:53:51.900 INFO:teuthology.orchestra.run.smithi186.stdout: openblas-0.3.15-6.el8.x86_64 2023-12-17T11:53:51.900 INFO:teuthology.orchestra.run.smithi186.stdout: openblas-threads-0.3.15-6.el8.x86_64 2023-12-17T11:53:51.900 INFO:teuthology.orchestra.run.smithi186.stdout: openssl-devel-1:1.1.1k-9.el8_7.x86_64 2023-12-17T11:53:51.900 INFO:teuthology.orchestra.run.smithi186.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-12-17T11:53:51.900 INFO:teuthology.orchestra.run.smithi186.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-12-17T11:53:51.900 INFO:teuthology.orchestra.run.smithi186.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-12-17T11:53:51.901 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-10.23-3.module+el8.9.0+20831+78489779.x86_64 2023-12-17T11:53:51.901 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-contrib-10.23-3.module+el8.9.0+20831+78489779.x86_64 2023-12-17T11:53:51.901 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-server-10.23-3.module+el8.9.0+20831+78489779.x86_64 2023-12-17T11:53:51.901 INFO:teuthology.orchestra.run.smithi186.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-12-17T11:53:51.901 INFO:teuthology.orchestra.run.smithi186.stdout: python3-babel-2.5.1-7.el8.noarch 2023-12-17T11:53:51.901 INFO:teuthology.orchestra.run.smithi186.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-12-17T11:53:51.901 INFO:teuthology.orchestra.run.smithi186.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-12-17T11:53:51.901 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-12-17T11:53:51.901 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-argparse-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.901 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-common-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.901 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cephfs-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.901 INFO:teuthology.orchestra.run.smithi186.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-12-17T11:53:51.901 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cffi-1.11.5-6.el8.x86_64 2023-12-17T11:53:51.902 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-12-17T11:53:51.902 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-12-17T11:53:51.902 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cryptography-3.2.1-6.el8.x86_64 2023-12-17T11:53:51.902 INFO:teuthology.orchestra.run.smithi186.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-12-17T11:53:51.902 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-6.2-6.el8.noarch 2023-12-17T11:53:51.902 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-12-17T11:53:51.902 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-12-17T11:53:51.902 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-12-17T11:53:51.902 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-12-17T11:53:51.902 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-12-17T11:53:51.902 INFO:teuthology.orchestra.run.smithi186.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-12-17T11:53:51.902 INFO:teuthology.orchestra.run.smithi186.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-12-17T11:53:51.902 INFO:teuthology.orchestra.run.smithi186.stdout: python3-mako-1.0.6-14.el8.noarch 2023-12-17T11:53:51.902 INFO:teuthology.orchestra.run.smithi186.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-12-17T11:53:51.902 INFO:teuthology.orchestra.run.smithi186.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-12-17T11:53:51.902 INFO:teuthology.orchestra.run.smithi186.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-12-17T11:53:51.903 INFO:teuthology.orchestra.run.smithi186.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-12-17T11:53:51.903 INFO:teuthology.orchestra.run.smithi186.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-12-17T11:53:51.903 INFO:teuthology.orchestra.run.smithi186.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-12-17T11:53:51.903 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-12-17T11:53:51.903 INFO:teuthology.orchestra.run.smithi186.stdout: python3-portend-2.6-1.el8.noarch 2023-12-17T11:53:51.903 INFO:teuthology.orchestra.run.smithi186.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-12-17T11:53:51.903 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-12-17T11:53:51.903 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-12-17T11:53:51.903 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-12-17T11:53:51.903 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pycparser-2.14-14.el8.noarch 2023-12-17T11:53:51.903 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pytz-2017.2-11.el8.noarch 2023-12-17T11:53:51.903 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rados-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.903 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rbd-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.903 INFO:teuthology.orchestra.run.smithi186.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-12-17T11:53:51.903 INFO:teuthology.orchestra.run.smithi186.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-12-17T11:53:51.904 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rgw-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.904 INFO:teuthology.orchestra.run.smithi186.stdout: python3-routes-2.4.1-12.el8.noarch 2023-12-17T11:53:51.904 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rsa-4.9-2.el8.noarch 2023-12-17T11:53:51.904 INFO:teuthology.orchestra.run.smithi186.stdout: python3-scipy-1.0.0-21.module+el8.9.0+20976+d3c38525.x86_64 2023-12-17T11:53:51.904 INFO:teuthology.orchestra.run.smithi186.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-12-17T11:53:51.904 INFO:teuthology.orchestra.run.smithi186.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-12-17T11:53:51.904 INFO:teuthology.orchestra.run.smithi186.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-12-17T11:53:51.904 INFO:teuthology.orchestra.run.smithi186.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-12-17T11:53:51.904 INFO:teuthology.orchestra.run.smithi186.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-12-17T11:53:51.904 INFO:teuthology.orchestra.run.smithi186.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-12-17T11:53:51.904 INFO:teuthology.orchestra.run.smithi186.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-12-17T11:53:51.905 INFO:teuthology.orchestra.run.smithi186.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-12-17T11:53:51.905 INFO:teuthology.orchestra.run.smithi186.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-12-17T11:53:51.905 INFO:teuthology.orchestra.run.smithi186.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-12-17T11:53:51.905 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-fuse-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.905 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-mirror-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.905 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-nbd-2:19.0.0-119.ga62fda73.el8.x86_64 2023-12-17T11:53:51.905 INFO:teuthology.orchestra.run.smithi186.stdout: socat-1.7.4.1-1.el8.x86_64 2023-12-17T11:53:51.905 INFO:teuthology.orchestra.run.smithi186.stdout: thrift-0.13.0-2.el8.x86_64 2023-12-17T11:53:51.905 INFO:teuthology.orchestra.run.smithi186.stdout: uuid-1.6.2-43.el8.x86_64 2023-12-17T11:53:51.905 INFO:teuthology.orchestra.run.smithi186.stdout: xfsprogs-devel-5.0.0-12.el8.x86_64 2023-12-17T11:53:51.905 INFO:teuthology.orchestra.run.smithi186.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-12-17T11:53:51.906 INFO:teuthology.orchestra.run.smithi186.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-12-17T11:53:51.906 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-12-17T11:53:51.906 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2023-12-17T11:53:52.303 DEBUG:teuthology.parallel:result is None 2023-12-17T11:53:52.304 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-17T11:53:52.452 DEBUG:teuthology.orchestra.run.smithi008:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-17T11:53:52.513 INFO:teuthology.orchestra.run.smithi008.stdout:19.0.0-119.ga62fda73.el8 2023-12-17T11:53:52.514 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-119.ga62fda73.el8 2023-12-17T11:53:52.514 INFO:teuthology.task.install:The correct ceph version 19.0.0-119.ga62fda73 is installed. 2023-12-17T11:53:52.517 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-17T11:53:52.735 DEBUG:teuthology.orchestra.run.smithi100:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-17T11:53:52.795 INFO:teuthology.orchestra.run.smithi100.stdout:19.0.0-119.ga62fda73.el8 2023-12-17T11:53:52.795 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-119.ga62fda73.el8 2023-12-17T11:53:52.796 INFO:teuthology.task.install:The correct ceph version 19.0.0-119.ga62fda73 is installed. 2023-12-17T11:53:52.797 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-17T11:53:52.937 DEBUG:teuthology.orchestra.run.smithi186:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-17T11:53:52.995 INFO:teuthology.orchestra.run.smithi186.stdout:19.0.0-119.ga62fda73.el8 2023-12-17T11:53:52.995 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-119.ga62fda73.el8 2023-12-17T11:53:52.995 INFO:teuthology.task.install:The correct ceph version 19.0.0-119.ga62fda73 is installed. 2023-12-17T11:53:52.998 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-17T11:53:52.998 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-12-17T11:53:52.998 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-17T11:53:53.097 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-12-17T11:53:53.098 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-17T11:53:53.192 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-12-17T11:53:53.192 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-17T11:53:53.282 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-17T11:53:53.282 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-12-17T11:53:53.282 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/daemon-helper 2023-12-17T11:53:53.355 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-17T11:53:53.465 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-12-17T11:53:53.465 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/daemon-helper 2023-12-17T11:53:53.538 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-17T11:53:53.648 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-12-17T11:53:53.648 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/usr/bin/daemon-helper 2023-12-17T11:53:53.716 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-17T11:53:53.825 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-17T11:53:53.825 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-12-17T11:53:53.825 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-17T11:53:53.897 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-17T11:53:54.006 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-12-17T11:53:54.006 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-17T11:53:54.076 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-17T11:53:54.183 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-12-17T11:53:54.183 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-17T11:53:54.252 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-17T11:53:54.361 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-17T11:53:54.361 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-12-17T11:53:54.361 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/usr/bin/stdin-killer 2023-12-17T11:53:54.431 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-17T11:53:54.540 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-12-17T11:53:54.540 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/usr/bin/stdin-killer 2023-12-17T11:53:54.608 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-17T11:53:54.715 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-12-17T11:53:54.715 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/usr/bin/stdin-killer 2023-12-17T11:53:54.784 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-17T11:53:54.891 INFO:teuthology.run_tasks:Running task cephadm... 2023-12-17T11:53:54.991 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d', 'subvols': {'create': 2}} 2023-12-17T11:53:54.991 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-17T11:53:54.992 INFO:tasks.cephadm:Cluster fsid is f43f508a-9cd2-11ee-95a5-87774f69a715 2023-12-17T11:53:54.992 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-12-17T11:53:54.992 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.8', 'mon.b': '172.21.15.100', 'mon.c': '172.21.15.186'} 2023-12-17T11:53:54.992 INFO:tasks.cephadm:First mon is mon.a on smithi008 2023-12-17T11:53:54.992 INFO:tasks.cephadm:First mgr is x 2023-12-17T11:53:54.992 INFO:tasks.cephadm:Normalizing hostnames... 2023-12-17T11:53:54.992 DEBUG:teuthology.orchestra.run.smithi008:> sudo hostname $(hostname -s) 2023-12-17T11:53:55.066 DEBUG:teuthology.orchestra.run.smithi100:> sudo hostname $(hostname -s) 2023-12-17T11:53:55.136 DEBUG:teuthology.orchestra.run.smithi186:> sudo hostname $(hostname -s) 2023-12-17T11:53:55.206 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2023-12-17T11:53:55.207 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-17T11:53:55.349 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/74860/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-119-ga62fda73', 'node_name': '172.21.4.63+confusa01', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-119.ga62fda73'}, 'url': 'https://3.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2023-12-11 13:31:01.711792', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'rishabh-2023dec11', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/flavors/default/', 'archs': ['x86_64', 'source', 'arm64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/74860/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-119-ga62fda73', 'node_name': '172.21.2.8+braggi08', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-119.ga62fda73'}, 'url': 'https://4.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2023-12-11 12:43:31.974707', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'rishabh-2023dec11', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2023-12-17T11:53:55.566 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref rishabh-2023dec11, sha1 a62fda73efba5520d409bb5a21bd8373289dda5d from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-17T11:53:55.567 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/x86_64/flavors/default/cephadm 2023-12-17T11:53:55.568 DEBUG:teuthology.orchestra.run.smithi008:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-17T11:54:00.591 INFO:teuthology.orchestra.run.smithi008.stdout:-rw-rw-r--. 1 ubuntu ubuntu 2272057 Dec 17 11:54 /home/ubuntu/cephtest/cephadm 2023-12-17T11:54:00.592 DEBUG:teuthology.orchestra.run.smithi100:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-17T11:54:05.311 INFO:teuthology.orchestra.run.smithi100.stdout:-rw-rw-r--. 1 ubuntu ubuntu 2272057 Dec 17 11:54 /home/ubuntu/cephtest/cephadm 2023-12-17T11:54:05.312 DEBUG:teuthology.orchestra.run.smithi186:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-12-17T11:54:10.406 INFO:teuthology.orchestra.run.smithi186.stdout:-rw-rw-r--. 1 ubuntu ubuntu 2272057 Dec 17 11:54 /home/ubuntu/cephtest/cephadm 2023-12-17T11:54:10.407 DEBUG:teuthology.orchestra.run.smithi008:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-17T11:54:10.458 DEBUG:teuthology.orchestra.run.smithi100:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-17T11:54:10.510 DEBUG:teuthology.orchestra.run.smithi186:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-12-17T11:54:10.578 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d on all hosts... 2023-12-17T11:54:10.579 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d pull 2023-12-17T11:54:10.583 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d pull 2023-12-17T11:54:10.588 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d pull 2023-12-17T11:54:12.029 INFO:teuthology.orchestra.run.smithi186.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d... 2023-12-17T11:54:12.043 INFO:teuthology.orchestra.run.smithi008.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d... 2023-12-17T11:54:12.058 INFO:teuthology.orchestra.run.smithi100.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d... 2023-12-17T11:54:54.547 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-12-17T11:54:54.548 INFO:teuthology.orchestra.run.smithi008.stdout: "ceph_version": "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)", 2023-12-17T11:54:54.548 INFO:teuthology.orchestra.run.smithi008.stdout: "image_id": "0b0a5e4a17a719ce4a079eef54b8d4e11d1472aa5fe9b5fa219d86551499aa8a", 2023-12-17T11:54:54.548 INFO:teuthology.orchestra.run.smithi008.stdout: "repo_digests": [ 2023-12-17T11:54:54.548 INFO:teuthology.orchestra.run.smithi008.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:84f4c788adfc97059464515a751d874ddacbeb7bf7cdb46b264d7a0bd4fc9d40" 2023-12-17T11:54:54.548 INFO:teuthology.orchestra.run.smithi008.stdout: ] 2023-12-17T11:54:54.548 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-12-17T11:55:12.273 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2023-12-17T11:55:12.273 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_version": "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)", 2023-12-17T11:55:12.273 INFO:teuthology.orchestra.run.smithi186.stdout: "image_id": "0b0a5e4a17a719ce4a079eef54b8d4e11d1472aa5fe9b5fa219d86551499aa8a", 2023-12-17T11:55:12.273 INFO:teuthology.orchestra.run.smithi186.stdout: "repo_digests": [ 2023-12-17T11:55:12.273 INFO:teuthology.orchestra.run.smithi186.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:84f4c788adfc97059464515a751d874ddacbeb7bf7cdb46b264d7a0bd4fc9d40" 2023-12-17T11:55:12.273 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2023-12-17T11:55:12.273 INFO:teuthology.orchestra.run.smithi186.stdout:} 2023-12-17T11:55:14.167 INFO:teuthology.orchestra.run.smithi100.stdout:{ 2023-12-17T11:55:14.167 INFO:teuthology.orchestra.run.smithi100.stdout: "ceph_version": "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)", 2023-12-17T11:55:14.167 INFO:teuthology.orchestra.run.smithi100.stdout: "image_id": "0b0a5e4a17a719ce4a079eef54b8d4e11d1472aa5fe9b5fa219d86551499aa8a", 2023-12-17T11:55:14.167 INFO:teuthology.orchestra.run.smithi100.stdout: "repo_digests": [ 2023-12-17T11:55:14.167 INFO:teuthology.orchestra.run.smithi100.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:84f4c788adfc97059464515a751d874ddacbeb7bf7cdb46b264d7a0bd4fc9d40" 2023-12-17T11:55:14.167 INFO:teuthology.orchestra.run.smithi100.stdout: ] 2023-12-17T11:55:14.168 INFO:teuthology.orchestra.run.smithi100.stdout:} 2023-12-17T11:55:14.204 DEBUG:teuthology.orchestra.run.smithi008:> sudo mkdir -p /etc/ceph 2023-12-17T11:55:14.285 DEBUG:teuthology.orchestra.run.smithi100:> sudo mkdir -p /etc/ceph 2023-12-17T11:55:14.357 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /etc/ceph 2023-12-17T11:55:14.438 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 777 /etc/ceph 2023-12-17T11:55:14.512 DEBUG:teuthology.orchestra.run.smithi100:> sudo chmod 777 /etc/ceph 2023-12-17T11:55:14.580 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 777 /etc/ceph 2023-12-17T11:55:14.651 INFO:tasks.cephadm:Writing seed config... 2023-12-17T11:55:14.652 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2023-12-17T11:55:14.652 INFO:tasks.cephadm: override: [client] debug client = 20 2023-12-17T11:55:14.652 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-12-17T11:55:14.652 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2023-12-17T11:55:14.652 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2023-12-17T11:55:14.652 INFO:tasks.cephadm: override: [mds] debug mds = 20 2023-12-17T11:55:14.653 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2023-12-17T11:55:14.653 INFO:tasks.cephadm: override: [mds] debug ms = 1 2023-12-17T11:55:14.653 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2023-12-17T11:55:14.653 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2023-12-17T11:55:14.653 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2023-12-17T11:55:14.653 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2023-12-17T11:55:14.653 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2023-12-17T11:55:14.653 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2023-12-17T11:55:14.653 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2023-12-17T11:55:14.653 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2023-12-17T11:55:14.653 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2023-12-17T11:55:14.653 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2023-12-17T11:55:14.653 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2023-12-17T11:55:14.653 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2023-12-17T11:55:14.654 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-12-17T11:55:14.654 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-12-17T11:55:14.654 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-12-17T11:55:14.654 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-12-17T11:55:14.654 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-12-17T11:55:14.654 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2023-12-17T11:55:14.654 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-12-17T11:55:14.654 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2023-12-17T11:55:14.654 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-12-17T11:55:14.654 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2023-12-17T11:55:14.654 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2023-12-17T11:55:14.654 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-12-17T11:55:14.654 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-12-17T11:55:14.654 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2023-12-17T11:55:14.654 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-12-17T11:55:14.654 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-12-17T11:55:14.655 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-12-17T11:55:14.655 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-12-17T11:55:14.655 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-12-17T11:55:14.655 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2023-12-17T11:55:14.655 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2023-12-17T11:55:14.655 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2023-12-17T11:55:14.656 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-12-17T11:55:14.656 DEBUG:teuthology.orchestra.run.smithi008:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-12-17T11:55:14.700 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = f43f508a-9cd2-11ee-95a5-87774f69a715 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2023-12-17T11:55:14.700 DEBUG:teuthology.orchestra.run.smithi008:mon.a> sudo journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mon.a.service 2023-12-17T11:55:14.746 DEBUG:teuthology.orchestra.run.smithi008:mgr.x> sudo journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mgr.x.service 2023-12-17T11:55:14.792 INFO:tasks.cephadm:Bootstrapping... 2023-12-17T11:55:14.793 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d -v bootstrap --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.8 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-12-17T11:55:14.817 INFO:journalctl@ceph.mon.a.smithi008.stdout:-- Logs begin at Sun 2023-12-17 11:40:41 UTC. -- 2023-12-17T11:55:14.863 INFO:journalctl@ceph.mgr.x.smithi008.stdout:-- Logs begin at Sun 2023-12-17 11:40:41 UTC. -- 2023-12-17T11:55:15.073 INFO:teuthology.orchestra.run.smithi008.stdout:-------------------------------------------------------------------------------- 2023-12-17T11:55:15.073 INFO:teuthology.orchestra.run.smithi008.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d', '-v', 'bootstrap', '--fsid', 'f43f508a-9cd2-11ee-95a5-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.8', '--skip-admin-label'] 2023-12-17T11:55:15.121 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stdout 4.6.1 2023-12-17T11:55:15.122 INFO:teuthology.orchestra.run.smithi008.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-12-17T11:55:15.122 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying podman|docker is present... 2023-12-17T11:55:15.169 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stdout 4.6.1 2023-12-17T11:55:15.169 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying lvm2 is present... 2023-12-17T11:55:15.169 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying time synchronization is in place... 2023-12-17T11:55:15.182 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-12-17T11:55:15.182 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-12-17T11:55:15.195 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-12-17T11:55:15.195 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout inactive 2023-12-17T11:55:15.209 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout enabled 2023-12-17T11:55:15.222 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout active 2023-12-17T11:55:15.222 INFO:teuthology.orchestra.run.smithi008.stdout:Unit chronyd.service is enabled and running 2023-12-17T11:55:15.222 INFO:teuthology.orchestra.run.smithi008.stdout:Repeating the final host check... 2023-12-17T11:55:15.270 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stdout 4.6.1 2023-12-17T11:55:15.270 INFO:teuthology.orchestra.run.smithi008.stdout:podman (/bin/podman) version 4.6.1 is present 2023-12-17T11:55:15.270 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl is present 2023-12-17T11:55:15.270 INFO:teuthology.orchestra.run.smithi008.stdout:lvcreate is present 2023-12-17T11:55:15.284 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-12-17T11:55:15.284 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-12-17T11:55:15.297 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-12-17T11:55:15.297 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout inactive 2023-12-17T11:55:15.311 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout enabled 2023-12-17T11:55:15.324 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout active 2023-12-17T11:55:15.324 INFO:teuthology.orchestra.run.smithi008.stdout:Unit chronyd.service is enabled and running 2023-12-17T11:55:15.324 INFO:teuthology.orchestra.run.smithi008.stdout:Host looks OK 2023-12-17T11:55:15.325 INFO:teuthology.orchestra.run.smithi008.stdout:Cluster fsid: f43f508a-9cd2-11ee-95a5-87774f69a715 2023-12-17T11:55:15.325 INFO:teuthology.orchestra.run.smithi008.stdout:Acquiring lock 140412868496912 on /run/cephadm/f43f508a-9cd2-11ee-95a5-87774f69a715.lock 2023-12-17T11:55:15.325 INFO:teuthology.orchestra.run.smithi008.stdout:Lock 140412868496912 acquired on /run/cephadm/f43f508a-9cd2-11ee-95a5-87774f69a715.lock 2023-12-17T11:55:15.325 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying IP 172.21.15.8 port 3300 ... 2023-12-17T11:55:15.325 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying IP 172.21.15.8 port 6789 ... 2023-12-17T11:55:15.325 INFO:teuthology.orchestra.run.smithi008.stdout:Base mon IP(s) is [172.21.15.8:3300, 172.21.15.8:6789], mon addrv is [v2:172.21.15.8:3300,v1:172.21.15.8:6789] 2023-12-17T11:55:15.333 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp metric 100 2023-12-17T11:55:15.334 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.8 metric 100 2023-12-17T11:55:15.341 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-12-17T11:55:15.341 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2023-12-17T11:55:15.341 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1743sec hoplimit 64 pref medium 2023-12-17T11:55:15.348 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-12-17T11:55:15.348 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-12-17T11:55:15.348 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-12-17T11:55:15.348 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2023-12-17T11:55:15.348 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout inet6 fe80::ae1f:6bff:fef8:25fe/64 scope link 2023-12-17T11:55:15.349 INFO:teuthology.orchestra.run.smithi008.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-12-17T11:55:15.349 INFO:teuthology.orchestra.run.smithi008.stdout:Mon IP `172.21.15.8` is in CIDR network `172.21.0.0/20` 2023-12-17T11:55:15.349 INFO:teuthology.orchestra.run.smithi008.stdout:Mon IP `172.21.15.8` is in CIDR network `172.21.0.0/20` 2023-12-17T11:55:15.349 INFO:teuthology.orchestra.run.smithi008.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-12-17T11:55:15.350 INFO:teuthology.orchestra.run.smithi008.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-12-17T11:55:15.352 INFO:teuthology.orchestra.run.smithi008.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d... 2023-12-17T11:55:15.764 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stdout 0b0a5e4a17a719ce4a079eef54b8d4e11d1472aa5fe9b5fa219d86551499aa8a 2023-12-17T11:55:15.764 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d... 2023-12-17T11:55:15.764 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stderr Getting image source signatures 2023-12-17T11:55:15.764 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stderr Copying blob sha256:933954f0af8f706d6a6186e87e0ea462c846b5abc6ef29ee9ef20dac46eff0f7 2023-12-17T11:55:15.764 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stderr Copying blob sha256:d3e436ac93e4b5a6d94c7ac8024df331e66e67275836276615dc044fd3cbf83a 2023-12-17T11:55:15.764 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stderr Copying config sha256:0b0a5e4a17a719ce4a079eef54b8d4e11d1472aa5fe9b5fa219d86551499aa8a 2023-12-17T11:55:15.764 INFO:teuthology.orchestra.run.smithi008.stdout:/bin/podman: stderr Writing manifest to image destination 2023-12-17T11:55:16.485 INFO:teuthology.orchestra.run.smithi008.stdout:ceph: stdout ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev) 2023-12-17T11:55:16.485 INFO:teuthology.orchestra.run.smithi008.stdout:Ceph version: ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev) 2023-12-17T11:55:16.485 INFO:teuthology.orchestra.run.smithi008.stdout:Extracting ceph user uid/gid from container image... 2023-12-17T11:55:17.110 INFO:teuthology.orchestra.run.smithi008.stdout:stat: stdout 167 167 2023-12-17T11:55:17.110 INFO:teuthology.orchestra.run.smithi008.stdout:Creating initial keys... 2023-12-17T11:55:26.247 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph-authtool: stdout AQCn4X5lh0XZAxAAyah+8RE+rTkCxOEA69RWWA== 2023-12-17T11:55:27.025 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph-authtool: stdout AQCu4X5lnS94IBAA9Ya3QT4Vh7xcfW+ncGHOUw== 2023-12-17T11:55:27.617 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph-authtool: stdout AQCv4X5lB0QFEhAADvi+ZN2oQHsGg6DvtmwdGw== 2023-12-17T11:55:27.617 INFO:teuthology.orchestra.run.smithi008.stdout:Creating initial monmap... 2023-12-17T11:55:28.205 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-12-17T11:55:28.206 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2023-12-17T11:55:28.206 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to f43f508a-9cd2-11ee-95a5-87774f69a715 2023-12-17T11:55:28.206 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-12-17T11:55:28.206 INFO:teuthology.orchestra.run.smithi008.stdout:monmaptool for a [v2:172.21.15.8:3300,v1:172.21.15.8:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-12-17T11:55:28.206 INFO:teuthology.orchestra.run.smithi008.stdout:setting min_mon_release = pacific 2023-12-17T11:55:28.206 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/monmaptool: set fsid to f43f508a-9cd2-11ee-95a5-87774f69a715 2023-12-17T11:55:28.206 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-12-17T11:55:28.206 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T11:55:28.206 INFO:teuthology.orchestra.run.smithi008.stdout:Creating mon... 2023-12-17T11:55:28.837 INFO:teuthology.orchestra.run.smithi008.stdout:create mon.a on 2023-12-17T11:55:29.092 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-12-17T11:55:29.298 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-12-17T11:55:29.546 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-f43f508a-9cd2-11ee-95a5-87774f69a715.target → /etc/systemd/system/ceph-f43f508a-9cd2-11ee-95a5-87774f69a715.target. 2023-12-17T11:55:29.546 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-f43f508a-9cd2-11ee-95a5-87774f69a715.target → /etc/systemd/system/ceph-f43f508a-9cd2-11ee-95a5-87774f69a715.target. 2023-12-17T11:55:29.934 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mon.a 2023-12-17T11:55:29.934 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mon.a.service: Unit ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mon.a.service not loaded. 2023-12-17T11:55:30.141 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f43f508a-9cd2-11ee-95a5-87774f69a715.target.wants/ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mon.a.service → /etc/systemd/system/ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@.service. 2023-12-17T11:55:30.236 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:30 smithi008 systemd[1]: Starting Ceph mon.a for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T11:55:30.660 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-17T11:55:30.660 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout disabled 2023-12-17T11:55:30.678 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-17T11:55:30.678 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout inactive 2023-12-17T11:55:30.678 INFO:teuthology.orchestra.run.smithi008.stdout:firewalld.service is not enabled 2023-12-17T11:55:30.678 INFO:teuthology.orchestra.run.smithi008.stdout:Not possible to enable service . firewalld.service is not available 2023-12-17T11:55:30.679 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for mon to start... 2023-12-17T11:55:30.679 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for mon... 2023-12-17T11:55:30.881 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:30 smithi008 bash[36303]: cc57aa074291e883296d8bb001eaf4d1a96eacc3f4cfa24a93a1ed26570072b1 2023-12-17T11:55:30.882 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:30 smithi008 systemd[1]: Started Ceph mon.a for f43f508a-9cd2-11ee-95a5-87774f69a715. 2023-12-17T11:55:30.882 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:30 smithi008 ceph-mon[36341]: mkfs f43f508a-9cd2-11ee-95a5-87774f69a715 2023-12-17T11:55:30.882 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:30 smithi008 ceph-mon[36341]: mon.a is new leader, mons a in quorum (ranks 0) 2023-12-17T11:55:31.608 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout cluster: 2023-12-17T11:55:31.609 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout id: f43f508a-9cd2-11ee-95a5-87774f69a715 2023-12-17T11:55:31.609 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-12-17T11:55:31.609 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-12-17T11:55:31.609 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout services: 2023-12-17T11:55:31.609 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.569404s) 2023-12-17T11:55:31.609 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-12-17T11:55:31.609 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-12-17T11:55:31.609 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-12-17T11:55:31.609 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout data: 2023-12-17T11:55:31.609 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-12-17T11:55:31.610 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-12-17T11:55:31.610 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-12-17T11:55:31.610 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout pgs: 2023-12-17T11:55:31.610 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-12-17T11:55:31.610 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.145+0000 7fb84e676700 1 Processor -- start 2023-12-17T11:55:31.610 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.145+0000 7fb84e676700 1 -- start start 2023-12-17T11:55:31.610 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.145+0000 7fb84e676700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb84807cec0 0x7fb84807b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:31.610 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.145+0000 7fb84e676700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84807b8f0 con 0x7fb84807cec0 2023-12-17T11:55:31.610 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.146+0000 7fb847fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb84807cec0 0x7fb84807b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:31.610 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.146+0000 7fb847fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb84807cec0 0x7fb84807b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45098/0 (socket says 172.21.15.8:45098) 2023-12-17T11:55:31.610 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.146+0000 7fb847fff700 1 -- 172.21.15.8:0/3651580850 learned_addr learned my addr 172.21.15.8:0/3651580850 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:55:31.610 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.147+0000 7fb847fff700 1 -- 172.21.15.8:0/3651580850 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb84807ba30 con 0x7fb84807cec0 2023-12-17T11:55:31.610 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.147+0000 7fb847fff700 1 --2- 172.21.15.8:0/3651580850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb84807cec0 0x7fb84807b320 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb8380098a0 tx=0x7fb838009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21ffd2e4bcde89b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:31.610 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.147+0000 7fb846ffd700 1 -- 172.21.15.8:0/3651580850 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb838004160 con 0x7fb84807cec0 2023-12-17T11:55:31.611 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.147+0000 7fb846ffd700 1 -- 172.21.15.8:0/3651580850 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8380042c0 con 0x7fb84807cec0 2023-12-17T11:55:31.611 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.147+0000 7fb846ffd700 1 -- 172.21.15.8:0/3651580850 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb8380045a0 con 0x7fb84807cec0 2023-12-17T11:55:31.611 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.148+0000 7fb84e676700 1 -- 172.21.15.8:0/3651580850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb84807cec0 msgr2=0x7fb84807b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:31.611 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.148+0000 7fb84e676700 1 --2- 172.21.15.8:0/3651580850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb84807cec0 0x7fb84807b320 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb8380098a0 tx=0x7fb838009bb0 comp rx=0 tx=0).stop 2023-12-17T11:55:31.611 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.148+0000 7fb84e676700 1 -- 172.21.15.8:0/3651580850 shutdown_connections 2023-12-17T11:55:31.611 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.148+0000 7fb84e676700 1 --2- 172.21.15.8:0/3651580850 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb84807cec0 0x7fb84807b320 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:31.611 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.148+0000 7fb84e676700 1 -- 172.21.15.8:0/3651580850 >> 172.21.15.8:0/3651580850 conn(0x7fb848102030 msgr2=0x7fb8481044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:31.611 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.148+0000 7fb84e676700 1 -- 172.21.15.8:0/3651580850 shutdown_connections 2023-12-17T11:55:31.611 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.148+0000 7fb84e676700 1 -- 172.21.15.8:0/3651580850 wait complete. 2023-12-17T11:55:31.611 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.149+0000 7fb84e676700 1 Processor -- start 2023-12-17T11:55:31.611 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.150+0000 7fb84e676700 1 -- start start 2023-12-17T11:55:31.611 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.150+0000 7fb84e676700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb84807cec0 0x7fb8481a0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:31.611 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.150+0000 7fb84e676700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8481a0b50 con 0x7fb84807cec0 2023-12-17T11:55:31.611 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.150+0000 7fb847fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb84807cec0 0x7fb8481a0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:31.612 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.151+0000 7fb847fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb84807cec0 0x7fb8481a0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45102/0 (socket says 172.21.15.8:45102) 2023-12-17T11:55:31.612 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.151+0000 7fb847fff700 1 -- 172.21.15.8:0/3475056827 learned_addr learned my addr 172.21.15.8:0/3475056827 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:55:31.612 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.151+0000 7fb847fff700 1 -- 172.21.15.8:0/3475056827 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb838009550 con 0x7fb84807cec0 2023-12-17T11:55:31.612 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.151+0000 7fb847fff700 1 --2- 172.21.15.8:0/3475056827 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb84807cec0 0x7fb8481a0610 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb838004000 tx=0x7fb838004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:31.612 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.151+0000 7fb8457fa700 1 -- 172.21.15.8:0/3475056827 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb838011630 con 0x7fb84807cec0 2023-12-17T11:55:31.612 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.151+0000 7fb8457fa700 1 -- 172.21.15.8:0/3475056827 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb838011790 con 0x7fb84807cec0 2023-12-17T11:55:31.612 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.151+0000 7fb8457fa700 1 -- 172.21.15.8:0/3475056827 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb838011a30 con 0x7fb84807cec0 2023-12-17T11:55:31.612 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.151+0000 7fb84e676700 1 -- 172.21.15.8:0/3475056827 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8481a0d50 con 0x7fb84807cec0 2023-12-17T11:55:31.612 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.151+0000 7fb84e676700 1 -- 172.21.15.8:0/3475056827 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8481a11f0 con 0x7fb84807cec0 2023-12-17T11:55:31.612 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.152+0000 7fb8457fa700 1 -- 172.21.15.8:0/3475056827 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb838021070 con 0x7fb84807cec0 2023-12-17T11:55:31.612 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.152+0000 7fb8457fa700 1 -- 172.21.15.8:0/3475056827 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb83801b440 con 0x7fb84807cec0 2023-12-17T11:55:31.612 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.153+0000 7fb84e676700 1 -- 172.21.15.8:0/3475056827 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb84807bda0 con 0x7fb84807cec0 2023-12-17T11:55:31.613 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.156+0000 7fb8457fa700 1 -- 172.21.15.8:0/3475056827 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fb83801a460 con 0x7fb84807cec0 2023-12-17T11:55:31.613 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.233+0000 7fb84e676700 1 -- 172.21.15.8:0/3475056827 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fb8481a3cb0 con 0x7fb84807cec0 2023-12-17T11:55:31.613 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.233+0000 7fb8457fa700 1 -- 172.21.15.8:0/3475056827 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7fb83801a600 con 0x7fb84807cec0 2023-12-17T11:55:31.613 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.234+0000 7fb84e676700 1 -- 172.21.15.8:0/3475056827 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb84807cec0 msgr2=0x7fb8481a0610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:31.613 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.234+0000 7fb84e676700 1 --2- 172.21.15.8:0/3475056827 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb84807cec0 0x7fb8481a0610 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fb838004000 tx=0x7fb838004750 comp rx=0 tx=0).stop 2023-12-17T11:55:31.613 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.234+0000 7fb84e676700 1 -- 172.21.15.8:0/3475056827 shutdown_connections 2023-12-17T11:55:31.613 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.234+0000 7fb84e676700 1 --2- 172.21.15.8:0/3475056827 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb84807cec0 0x7fb8481a0610 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:31.613 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.234+0000 7fb84e676700 1 -- 172.21.15.8:0/3475056827 >> 172.21.15.8:0/3475056827 conn(0x7fb848102030 msgr2=0x7fb8481044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:31.613 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.234+0000 7fb84e676700 1 -- 172.21.15.8:0/3475056827 shutdown_connections 2023-12-17T11:55:31.613 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:31.234+0000 7fb84e676700 1 -- 172.21.15.8:0/3475056827 wait complete. 2023-12-17T11:55:31.613 INFO:teuthology.orchestra.run.smithi008.stdout:mon is available 2023-12-17T11:55:31.613 INFO:teuthology.orchestra.run.smithi008.stdout:Assimilating anything we can from ceph.conf... 2023-12-17T11:55:31.871 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:31 smithi008 ceph-mon[36341]: mon.a is new leader, mons a in quorum (ranks 0) 2023-12-17T11:55:31.871 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:31 smithi008 ceph-mon[36341]: monmap e1: 1 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-17T11:55:31.871 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:31 smithi008 ceph-mon[36341]: fsmap 2023-12-17T11:55:31.871 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:31 smithi008 ceph-mon[36341]: osdmap e1: 0 total, 0 up, 0 in 2023-12-17T11:55:31.871 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:31 smithi008 ceph-mon[36341]: mgrmap e1: no daemons active 2023-12-17T11:55:31.871 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:31 smithi008 ceph-mon[36341]: from='client.? 172.21.15.8:0/3475056827' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-12-17T11:55:32.618 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-12-17T11:55:32.618 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout [global] 2023-12-17T11:55:32.618 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout fsid = f43f508a-9cd2-11ee-95a5-87774f69a715 2023-12-17T11:55:32.618 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.8:3300,v1:172.21.15.8:6789] 2023-12-17T11:55:32.618 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-12-17T11:55:32.618 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-12-17T11:55:32.619 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-12-17T11:55:32.619 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-12-17T11:55:32.619 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-12-17T11:55:32.619 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout [mgr] 2023-12-17T11:55:32.619 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-12-17T11:55:32.619 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-12-17T11:55:32.619 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout [osd] 2023-12-17T11:55:32.619 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-12-17T11:55:32.619 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-12-17T11:55:32.619 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-12-17T11:55:32.619 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-12-17T11:55:32.619 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-12-17T11:55:32.619 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.110+0000 7f11e4b94700 1 Processor -- start 2023-12-17T11:55:32.619 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.110+0000 7f11e4b94700 1 -- start start 2023-12-17T11:55:32.619 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.111+0000 7f11e4b94700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11e0106ad0 0x7f11e0106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:32.620 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.111+0000 7f11e4b94700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e01074c0 con 0x7f11e0106ad0 2023-12-17T11:55:32.620 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.111+0000 7f11de59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11e0106ad0 0x7f11e0106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:32.620 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.111+0000 7f11de59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11e0106ad0 0x7f11e0106ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45108/0 (socket says 172.21.15.8:45108) 2023-12-17T11:55:32.620 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.111+0000 7f11de59c700 1 -- 172.21.15.8:0/3616128792 learned_addr learned my addr 172.21.15.8:0/3616128792 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:55:32.620 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.111+0000 7f11de59c700 1 -- 172.21.15.8:0/3616128792 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11e0107cd0 con 0x7f11e0106ad0 2023-12-17T11:55:32.620 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.112+0000 7f11de59c700 1 --2- 172.21.15.8:0/3616128792 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11e0106ad0 0x7f11e0106ef0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f11d00098a0 tx=0x7f11d0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e738ecbcf79ce4f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:32.620 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.112+0000 7f11dd59a700 1 -- 172.21.15.8:0/3616128792 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11d0004160 con 0x7f11e0106ad0 2023-12-17T11:55:32.620 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.112+0000 7f11dd59a700 1 -- 172.21.15.8:0/3616128792 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d00042c0 con 0x7f11e0106ad0 2023-12-17T11:55:32.620 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.112+0000 7f11dd59a700 1 -- 172.21.15.8:0/3616128792 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11d00045a0 con 0x7f11e0106ad0 2023-12-17T11:55:32.620 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.112+0000 7f11e4b94700 1 -- 172.21.15.8:0/3616128792 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11e0106ad0 msgr2=0x7f11e0106ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:32.620 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.112+0000 7f11e4b94700 1 --2- 172.21.15.8:0/3616128792 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11e0106ad0 0x7f11e0106ef0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f11d00098a0 tx=0x7f11d0009bb0 comp rx=0 tx=0).stop 2023-12-17T11:55:32.620 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.113+0000 7f11e4b94700 1 -- 172.21.15.8:0/3616128792 shutdown_connections 2023-12-17T11:55:32.620 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.113+0000 7f11e4b94700 1 --2- 172.21.15.8:0/3616128792 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11e0106ad0 0x7f11e0106ef0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:32.621 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.113+0000 7f11e4b94700 1 -- 172.21.15.8:0/3616128792 >> 172.21.15.8:0/3616128792 conn(0x7f11e0102030 msgr2=0x7f11e01044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:32.621 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.113+0000 7f11e4b94700 1 -- 172.21.15.8:0/3616128792 shutdown_connections 2023-12-17T11:55:32.621 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.113+0000 7f11e4b94700 1 -- 172.21.15.8:0/3616128792 wait complete. 2023-12-17T11:55:32.621 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.114+0000 7f11e4b94700 1 Processor -- start 2023-12-17T11:55:32.621 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.114+0000 7f11e4b94700 1 -- start start 2023-12-17T11:55:32.621 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.114+0000 7f11e4b94700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11e0106ad0 0x7f11e019a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:32.621 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.114+0000 7f11e4b94700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11e019a540 con 0x7f11e0106ad0 2023-12-17T11:55:32.621 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.114+0000 7f11de59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11e0106ad0 0x7f11e019a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:32.621 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.114+0000 7f11de59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11e0106ad0 0x7f11e019a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45116/0 (socket says 172.21.15.8:45116) 2023-12-17T11:55:32.621 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.114+0000 7f11de59c700 1 -- 172.21.15.8:0/3626367674 learned_addr learned my addr 172.21.15.8:0/3626367674 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:55:32.621 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.115+0000 7f11de59c700 1 -- 172.21.15.8:0/3626367674 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11d0009550 con 0x7f11e0106ad0 2023-12-17T11:55:32.621 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.115+0000 7f11de59c700 1 --2- 172.21.15.8:0/3626367674 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11e0106ad0 0x7f11e019a000 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f11d0004000 tx=0x7f11d0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:32.621 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.115+0000 7f11cf7fe700 1 -- 172.21.15.8:0/3626367674 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11d0011630 con 0x7f11e0106ad0 2023-12-17T11:55:32.621 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.115+0000 7f11cf7fe700 1 -- 172.21.15.8:0/3626367674 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11d0011790 con 0x7f11e0106ad0 2023-12-17T11:55:32.622 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.115+0000 7f11e4b94700 1 -- 172.21.15.8:0/3626367674 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11e019a740 con 0x7f11e0106ad0 2023-12-17T11:55:32.622 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.115+0000 7f11cf7fe700 1 -- 172.21.15.8:0/3626367674 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f11d0011a30 con 0x7f11e0106ad0 2023-12-17T11:55:32.622 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.115+0000 7f11e4b94700 1 -- 172.21.15.8:0/3626367674 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11e019abe0 con 0x7f11e0106ad0 2023-12-17T11:55:32.622 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.116+0000 7f11cf7fe700 1 -- 172.21.15.8:0/3626367674 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f11d0021070 con 0x7f11e0106ad0 2023-12-17T11:55:32.622 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.116+0000 7f11cf7fe700 1 -- 172.21.15.8:0/3626367674 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f11d001b780 con 0x7f11e0106ad0 2023-12-17T11:55:32.622 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.117+0000 7f11e4b94700 1 -- 172.21.15.8:0/3626367674 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11e0193c90 con 0x7f11e0106ad0 2023-12-17T11:55:32.622 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.119+0000 7f11cf7fe700 1 -- 172.21.15.8:0/3626367674 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f11d001ad60 con 0x7f11e0106ad0 2023-12-17T11:55:32.622 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.194+0000 7f11e4b94700 1 -- 172.21.15.8:0/3626367674 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f11e0108270 con 0x7f11e0106ad0 2023-12-17T11:55:32.622 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.198+0000 7f11cf7fe700 1 -- 172.21.15.8:0/3626367674 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+427 (secure 0 0 0) 0x7f11d001a460 con 0x7f11e0106ad0 2023-12-17T11:55:32.622 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.198+0000 7f11cf7fe700 1 -- 172.21.15.8:0/3626367674 <== mon.0 v2:172.21.15.8:3300/0 8 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f11d001b940 con 0x7f11e0106ad0 2023-12-17T11:55:32.622 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.199+0000 7f11e4b94700 1 -- 172.21.15.8:0/3626367674 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11e0106ad0 msgr2=0x7f11e019a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:32.622 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.199+0000 7f11e4b94700 1 --2- 172.21.15.8:0/3626367674 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11e0106ad0 0x7f11e019a000 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f11d0004000 tx=0x7f11d0004750 comp rx=0 tx=0).stop 2023-12-17T11:55:32.622 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.199+0000 7f11e4b94700 1 -- 172.21.15.8:0/3626367674 shutdown_connections 2023-12-17T11:55:32.622 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.199+0000 7f11e4b94700 1 --2- 172.21.15.8:0/3626367674 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f11e0106ad0 0x7f11e019a000 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:32.623 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.199+0000 7f11e4b94700 1 -- 172.21.15.8:0/3626367674 >> 172.21.15.8:0/3626367674 conn(0x7f11e0102030 msgr2=0x7f11e0190dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:32.623 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.199+0000 7f11e4b94700 1 -- 172.21.15.8:0/3626367674 shutdown_connections 2023-12-17T11:55:32.623 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:32.200+0000 7f11e4b94700 1 -- 172.21.15.8:0/3626367674 wait complete. 2023-12-17T11:55:32.623 INFO:teuthology.orchestra.run.smithi008.stdout:Generating new minimal ceph.conf... 2023-12-17T11:55:32.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:32 smithi008 ceph-mon[36341]: from='client.? 172.21.15.8:0/3626367674' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-12-17T11:55:32.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:32 smithi008 ceph-mon[36341]: from='client.? 172.21.15.8:0/3626367674' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-12-17T11:55:33.486 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.034+0000 7f0c7208b700 1 Processor -- start 2023-12-17T11:55:33.486 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.034+0000 7f0c7208b700 1 -- start start 2023-12-17T11:55:33.486 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.034+0000 7f0c7208b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c6c07ce60 0x7f0c6c07b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:33.486 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.034+0000 7f0c7208b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c07b890 con 0x7f0c6c07ce60 2023-12-17T11:55:33.486 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.034+0000 7f0c6b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c6c07ce60 0x7f0c6c07b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:33.486 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.034+0000 7f0c6b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c6c07ce60 0x7f0c6c07b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45126/0 (socket says 172.21.15.8:45126) 2023-12-17T11:55:33.487 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.034+0000 7f0c6b7fe700 1 -- 172.21.15.8:0/1908409941 learned_addr learned my addr 172.21.15.8:0/1908409941 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:55:33.487 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.035+0000 7f0c6b7fe700 1 -- 172.21.15.8:0/1908409941 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6c07b9d0 con 0x7f0c6c07ce60 2023-12-17T11:55:33.487 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.035+0000 7f0c6b7fe700 1 --2- 172.21.15.8:0/1908409941 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c6c07ce60 0x7f0c6c07b2c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c0098a0 tx=0x7f0c5c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b840b7a1e0afc504 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:33.487 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.035+0000 7f0c6a7fc700 1 -- 172.21.15.8:0/1908409941 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c5c004160 con 0x7f0c6c07ce60 2023-12-17T11:55:33.487 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.035+0000 7f0c6a7fc700 1 -- 172.21.15.8:0/1908409941 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f0c5c0042c0 con 0x7f0c6c07ce60 2023-12-17T11:55:33.487 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.035+0000 7f0c6a7fc700 1 -- 172.21.15.8:0/1908409941 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c5c011940 con 0x7f0c6c07ce60 2023-12-17T11:55:33.487 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.036+0000 7f0c7208b700 1 -- 172.21.15.8:0/1908409941 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c6c07ce60 msgr2=0x7f0c6c07b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:33.487 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.036+0000 7f0c7208b700 1 --2- 172.21.15.8:0/1908409941 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c6c07ce60 0x7f0c6c07b2c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c0098a0 tx=0x7f0c5c009bb0 comp rx=0 tx=0).stop 2023-12-17T11:55:33.487 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.036+0000 7f0c7208b700 1 -- 172.21.15.8:0/1908409941 shutdown_connections 2023-12-17T11:55:33.487 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.036+0000 7f0c7208b700 1 --2- 172.21.15.8:0/1908409941 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c6c07ce60 0x7f0c6c07b2c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:33.487 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.036+0000 7f0c7208b700 1 -- 172.21.15.8:0/1908409941 >> 172.21.15.8:0/1908409941 conn(0x7f0c6c102030 msgr2=0x7f0c6c1044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:33.487 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.036+0000 7f0c7208b700 1 -- 172.21.15.8:0/1908409941 shutdown_connections 2023-12-17T11:55:33.487 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.036+0000 7f0c7208b700 1 -- 172.21.15.8:0/1908409941 wait complete. 2023-12-17T11:55:33.487 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.037+0000 7f0c7208b700 1 Processor -- start 2023-12-17T11:55:33.487 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.037+0000 7f0c7208b700 1 -- start start 2023-12-17T11:55:33.488 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.037+0000 7f0c7208b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c6c07ce60 0x7f0c6c19c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:33.488 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.037+0000 7f0c7208b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c19cef0 con 0x7f0c6c07ce60 2023-12-17T11:55:33.488 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.038+0000 7f0c6b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c6c07ce60 0x7f0c6c19c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:33.488 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.038+0000 7f0c6b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c6c07ce60 0x7f0c6c19c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45134/0 (socket says 172.21.15.8:45134) 2023-12-17T11:55:33.488 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.038+0000 7f0c6b7fe700 1 -- 172.21.15.8:0/129433351 learned_addr learned my addr 172.21.15.8:0/129433351 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:55:33.488 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.038+0000 7f0c6b7fe700 1 -- 172.21.15.8:0/129433351 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c5c009550 con 0x7f0c6c07ce60 2023-12-17T11:55:33.488 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.038+0000 7f0c6b7fe700 1 --2- 172.21.15.8:0/129433351 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c6c07ce60 0x7f0c6c19c9b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c003f20 tx=0x7f0c5c011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:33.488 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.038+0000 7f0c68ff9700 1 -- 172.21.15.8:0/129433351 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c5c0037d0 con 0x7f0c6c07ce60 2023-12-17T11:55:33.488 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.038+0000 7f0c68ff9700 1 -- 172.21.15.8:0/129433351 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f0c5c01b440 con 0x7f0c6c07ce60 2023-12-17T11:55:33.488 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.039+0000 7f0c68ff9700 1 -- 172.21.15.8:0/129433351 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0c5c023590 con 0x7f0c6c07ce60 2023-12-17T11:55:33.488 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.039+0000 7f0c7208b700 1 -- 172.21.15.8:0/129433351 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c6c19d0f0 con 0x7f0c6c07ce60 2023-12-17T11:55:33.488 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.039+0000 7f0c7208b700 1 -- 172.21.15.8:0/129433351 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c6c19d590 con 0x7f0c6c07ce60 2023-12-17T11:55:33.488 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.039+0000 7f0c68ff9700 1 -- 172.21.15.8:0/129433351 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0c5c023b50 con 0x7f0c6c07ce60 2023-12-17T11:55:33.488 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.039+0000 7f0c68ff9700 1 -- 172.21.15.8:0/129433351 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0c5c0193d0 con 0x7f0c6c07ce60 2023-12-17T11:55:33.488 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.040+0000 7f0c7208b700 1 -- 172.21.15.8:0/129433351 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c6c10ce60 con 0x7f0c6c07ce60 2023-12-17T11:55:33.489 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.043+0000 7f0c68ff9700 1 -- 172.21.15.8:0/129433351 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f0c5c02ce50 con 0x7f0c6c07ce60 2023-12-17T11:55:33.489 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.116+0000 7f0c7208b700 1 -- 172.21.15.8:0/129433351 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f0c6c10d020 con 0x7f0c6c07ce60 2023-12-17T11:55:33.489 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.117+0000 7f0c68ff9700 1 -- 172.21.15.8:0/129433351 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+173 (secure 0 0 0) 0x7f0c5c006d60 con 0x7f0c6c07ce60 2023-12-17T11:55:33.489 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.118+0000 7f0c7208b700 1 -- 172.21.15.8:0/129433351 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c6c07ce60 msgr2=0x7f0c6c19c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:33.489 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.118+0000 7f0c7208b700 1 --2- 172.21.15.8:0/129433351 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c6c07ce60 0x7f0c6c19c9b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c003f20 tx=0x7f0c5c011f00 comp rx=0 tx=0).stop 2023-12-17T11:55:33.489 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.118+0000 7f0c7208b700 1 -- 172.21.15.8:0/129433351 shutdown_connections 2023-12-17T11:55:33.489 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.118+0000 7f0c7208b700 1 --2- 172.21.15.8:0/129433351 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0c6c07ce60 0x7f0c6c19c9b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:33.489 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.118+0000 7f0c7208b700 1 -- 172.21.15.8:0/129433351 >> 172.21.15.8:0/129433351 conn(0x7f0c6c102030 msgr2=0x7f0c6c102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:33.489 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.118+0000 7f0c7208b700 1 -- 172.21.15.8:0/129433351 shutdown_connections 2023-12-17T11:55:33.489 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:33.118+0000 7f0c7208b700 1 -- 172.21.15.8:0/129433351 wait complete. 2023-12-17T11:55:33.489 INFO:teuthology.orchestra.run.smithi008.stdout:Restarting the monitor... 2023-12-17T11:55:33.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:33 smithi008 systemd[1]: Stopping Ceph mon.a for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T11:55:33.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:33 smithi008 ceph-mon[36341]: from='client.? 172.21.15.8:0/129433351' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:55:34.119 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:33 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mon-a[36318]: 2023-12-17T11:55:33.784+0000 7f5a2f8e9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T11:55:34.119 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:33 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mon-a[36318]: 2023-12-17T11:55:33.784+0000 7f5a2f8e9700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-12-17T11:55:34.119 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 bash[36671]: ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mon-a 2023-12-17T11:55:34.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 systemd[1]: ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mon.a.service: Succeeded. 2023-12-17T11:55:34.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 systemd[1]: Stopped Ceph mon.a for f43f508a-9cd2-11ee-95a5-87774f69a715. 2023-12-17T11:55:34.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 systemd[1]: Starting Ceph mon.a for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T11:55:34.826 INFO:teuthology.orchestra.run.smithi008.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2023-12-17T11:55:35.247 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 bash[36793]: ad84dd1c02c0bfbdab565879585e6ffd55092f8cfe43db5f95c09c9e01c2e5b7 2023-12-17T11:55:35.247 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 systemd[1]: Started Ceph mon.a for f43f508a-9cd2-11ee-95a5-87774f69a715. 2023-12-17T11:55:35.247 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: set uid:gid to 167:167 (ceph:ceph) 2023-12-17T11:55:35.247 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev), process ceph-mon, pid 7 2023-12-17T11:55:35.247 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: pidfile_write: ignore empty --pid-file 2023-12-17T11:55:35.247 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: load: jerasure load: lrc 2023-12-17T11:55:35.247 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: RocksDB version: 7.9.2 2023-12-17T11:55:35.247 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Git sha 0 2023-12-17T11:55:35.248 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Compile date 2023-12-11 11:29:13 2023-12-17T11:55:35.248 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: DB SUMMARY 2023-12-17T11:55:35.248 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: DB Session ID: YBKH6S9ZKXS6RD834UR1 2023-12-17T11:55:35.248 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: CURRENT file: CURRENT 2023-12-17T11:55:35.248 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: IDENTITY file: IDENTITY 2023-12-17T11:55:35.248 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2023-12-17T11:55:35.248 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2023-12-17T11:55:35.248 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 97858 ; 2023-12-17T11:55:35.248 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.error_if_exists: 0 2023-12-17T11:55:35.248 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.create_if_missing: 0 2023-12-17T11:55:35.248 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.paranoid_checks: 1 2023-12-17T11:55:35.248 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.flush_verify_memtable_count: 1 2023-12-17T11:55:35.248 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-17T11:55:35.249 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-17T11:55:35.249 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.env: 0x564b39834a60 2023-12-17T11:55:35.249 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.fs: PosixFileSystem 2023-12-17T11:55:35.249 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.info_log: 0x564b3be09780 2023-12-17T11:55:35.249 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.max_file_opening_threads: 16 2023-12-17T11:55:35.249 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.statistics: (nil) 2023-12-17T11:55:35.249 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.use_fsync: 0 2023-12-17T11:55:35.249 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.max_log_file_size: 0 2023-12-17T11:55:35.249 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-17T11:55:35.249 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-17T11:55:35.249 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.keep_log_file_num: 1000 2023-12-17T11:55:35.249 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.recycle_log_file_num: 0 2023-12-17T11:55:35.249 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.allow_fallocate: 1 2023-12-17T11:55:35.250 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.allow_mmap_reads: 0 2023-12-17T11:55:35.250 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.allow_mmap_writes: 0 2023-12-17T11:55:35.250 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.use_direct_reads: 0 2023-12-17T11:55:35.250 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-17T11:55:35.250 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.create_missing_column_families: 0 2023-12-17T11:55:35.250 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.db_log_dir: 2023-12-17T11:55:35.250 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.wal_dir: 2023-12-17T11:55:35.250 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-17T11:55:35.250 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-17T11:55:35.250 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-17T11:55:35.250 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-17T11:55:35.250 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-17T11:55:35.250 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-17T11:55:35.250 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.advise_random_on_open: 1 2023-12-17T11:55:35.250 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.db_write_buffer_size: 0 2023-12-17T11:55:35.251 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.write_buffer_manager: 0x564b3bdbf360 2023-12-17T11:55:35.251 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-17T11:55:35.251 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-17T11:55:35.251 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-17T11:55:35.251 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.rate_limiter: (nil) 2023-12-17T11:55:35.251 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-17T11:55:35.251 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.wal_recovery_mode: 2 2023-12-17T11:55:35.251 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.enable_thread_tracking: 0 2023-12-17T11:55:35.251 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.enable_pipelined_write: 0 2023-12-17T11:55:35.251 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.unordered_write: 0 2023-12-17T11:55:35.251 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-17T11:55:35.251 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-17T11:55:35.251 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-17T11:55:35.252 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-17T11:55:35.252 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.row_cache: None 2023-12-17T11:55:35.252 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.wal_filter: None 2023-12-17T11:55:35.252 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-17T11:55:35.252 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.allow_ingest_behind: 0 2023-12-17T11:55:35.252 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.two_write_queues: 0 2023-12-17T11:55:35.252 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.manual_wal_flush: 0 2023-12-17T11:55:35.252 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.wal_compression: 0 2023-12-17T11:55:35.252 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.atomic_flush: 0 2023-12-17T11:55:35.252 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-17T11:55:35.252 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-17T11:55:35.252 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-17T11:55:35.252 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.log_readahead_size: 0 2023-12-17T11:55:35.253 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-17T11:55:35.253 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.best_efforts_recovery: 0 2023-12-17T11:55:35.253 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-17T11:55:35.253 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-17T11:55:35.253 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.allow_data_in_errors: 0 2023-12-17T11:55:35.253 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.db_host_id: __hostname__ 2023-12-17T11:55:35.253 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.enforce_single_del_contracts: true 2023-12-17T11:55:35.253 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.max_background_jobs: 2 2023-12-17T11:55:35.253 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.max_background_compactions: -1 2023-12-17T11:55:35.253 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.max_subcompactions: 1 2023-12-17T11:55:35.253 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-17T11:55:35.253 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-17T11:55:35.253 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-17T11:55:35.253 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.max_total_wal_size: 0 2023-12-17T11:55:35.253 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-17T11:55:35.254 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-17T11:55:35.254 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-17T11:55:35.254 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-17T11:55:35.254 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.max_open_files: -1 2023-12-17T11:55:35.254 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.bytes_per_sync: 0 2023-12-17T11:55:35.254 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-17T11:55:35.254 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-17T11:55:35.254 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.compaction_readahead_size: 0 2023-12-17T11:55:35.254 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.max_background_flushes: -1 2023-12-17T11:55:35.254 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Compression algorithms supported: 2023-12-17T11:55:35.254 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-17T11:55:35.254 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: kZSTD supported: 0 2023-12-17T11:55:35.254 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: kXpressCompression supported: 0 2023-12-17T11:55:35.254 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: kLZ4HCCompression supported: 1 2023-12-17T11:55:35.255 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: kZlibCompression supported: 1 2023-12-17T11:55:35.255 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: kSnappyCompression supported: 1 2023-12-17T11:55:35.255 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: kLZ4Compression supported: 1 2023-12-17T11:55:35.255 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: kBZip2Compression supported: 0 2023-12-17T11:55:35.255 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-17T11:55:35.255 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: DMutex implementation: pthread_mutex_t 2023-12-17T11:55:35.255 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-12-17T11:55:35.255 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-17T11:55:35.255 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-17T11:55:35.255 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.merge_operator: 2023-12-17T11:55:35.255 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.compaction_filter: None 2023-12-17T11:55:35.255 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.compaction_filter_factory: None 2023-12-17T11:55:35.255 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.sst_partitioner_factory: None 2023-12-17T11:55:35.255 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-17T11:55:35.256 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-17T11:55:35.256 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564b3be098a0) 2023-12-17T11:55:35.256 INFO:journalctl@ceph.mon.a.smithi008.stdout: cache_index_and_filter_blocks: 1 2023-12-17T11:55:35.256 INFO:journalctl@ceph.mon.a.smithi008.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-17T11:55:35.256 INFO:journalctl@ceph.mon.a.smithi008.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-17T11:55:35.256 INFO:journalctl@ceph.mon.a.smithi008.stdout: pin_top_level_index_and_filter: 1 2023-12-17T11:55:35.256 INFO:journalctl@ceph.mon.a.smithi008.stdout: index_type: 0 2023-12-17T11:55:35.256 INFO:journalctl@ceph.mon.a.smithi008.stdout: data_block_index_type: 0 2023-12-17T11:55:35.256 INFO:journalctl@ceph.mon.a.smithi008.stdout: index_shortening: 1 2023-12-17T11:55:35.256 INFO:journalctl@ceph.mon.a.smithi008.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-17T11:55:35.256 INFO:journalctl@ceph.mon.a.smithi008.stdout: checksum: 4 2023-12-17T11:55:35.256 INFO:journalctl@ceph.mon.a.smithi008.stdout: no_block_cache: 0 2023-12-17T11:55:35.256 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_cache: 0x564b3be5f090 2023-12-17T11:55:35.256 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_cache_name: BinnedLRUCache 2023-12-17T11:55:35.256 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_cache_options: 2023-12-17T11:55:35.257 INFO:journalctl@ceph.mon.a.smithi008.stdout: capacity : 536870912 2023-12-17T11:55:35.257 INFO:journalctl@ceph.mon.a.smithi008.stdout: num_shard_bits : 4 2023-12-17T11:55:35.257 INFO:journalctl@ceph.mon.a.smithi008.stdout: strict_capacity_limit : 0 2023-12-17T11:55:35.257 INFO:journalctl@ceph.mon.a.smithi008.stdout: high_pri_pool_ratio: 0.000 2023-12-17T11:55:35.257 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_cache_compressed: (nil) 2023-12-17T11:55:35.257 INFO:journalctl@ceph.mon.a.smithi008.stdout: persistent_cache: (nil) 2023-12-17T11:55:35.257 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_size: 4096 2023-12-17T11:55:35.257 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_size_deviation: 10 2023-12-17T11:55:35.257 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_restart_interval: 16 2023-12-17T11:55:35.257 INFO:journalctl@ceph.mon.a.smithi008.stdout: index_block_restart_interval: 1 2023-12-17T11:55:35.257 INFO:journalctl@ceph.mon.a.smithi008.stdout: metadata_block_size: 4096 2023-12-17T11:55:35.257 INFO:journalctl@ceph.mon.a.smithi008.stdout: partition_filters: 0 2023-12-17T11:55:35.257 INFO:journalctl@ceph.mon.a.smithi008.stdout: use_delta_encoding: 1 2023-12-17T11:55:35.257 INFO:journalctl@ceph.mon.a.smithi008.stdout: filter_policy: bloomfilter 2023-12-17T11:55:35.257 INFO:journalctl@ceph.mon.a.smithi008.stdout: whole_key_filtering: 1 2023-12-17T11:55:35.258 INFO:journalctl@ceph.mon.a.smithi008.stdout: verify_compression: 0 2023-12-17T11:55:35.258 INFO:journalctl@ceph.mon.a.smithi008.stdout: read_amp_bytes_per_bit: 0 2023-12-17T11:55:35.258 INFO:journalctl@ceph.mon.a.smithi008.stdout: format_version: 5 2023-12-17T11:55:35.258 INFO:journalctl@ceph.mon.a.smithi008.stdout: enable_index_compression: 1 2023-12-17T11:55:35.258 INFO:journalctl@ceph.mon.a.smithi008.stdout: block_align: 0 2023-12-17T11:55:35.258 INFO:journalctl@ceph.mon.a.smithi008.stdout: max_auto_readahead_size: 262144 2023-12-17T11:55:35.258 INFO:journalctl@ceph.mon.a.smithi008.stdout: prepopulate_block_cache: 0 2023-12-17T11:55:35.258 INFO:journalctl@ceph.mon.a.smithi008.stdout: initial_auto_readahead_size: 8192 2023-12-17T11:55:35.258 INFO:journalctl@ceph.mon.a.smithi008.stdout: num_file_reads_for_auto_readahead: 2 2023-12-17T11:55:35.258 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.write_buffer_size: 33554432 2023-12-17T11:55:35.258 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.max_write_buffer_number: 2 2023-12-17T11:55:35.258 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.compression: NoCompression 2023-12-17T11:55:35.258 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.bottommost_compression: Disabled 2023-12-17T11:55:35.259 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.prefix_extractor: nullptr 2023-12-17T11:55:35.259 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-17T11:55:35.259 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.num_levels: 7 2023-12-17T11:55:35.259 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-17T11:55:35.259 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-17T11:55:35.259 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-17T11:55:35.259 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-17T11:55:35.259 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-17T11:55:35.259 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-17T11:55:35.259 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-17T11:55:35.259 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-17T11:55:35.259 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-17T11:55:35.259 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-17T11:55:35.260 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-17T11:55:35.260 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-17T11:55:35.260 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-17T11:55:35.260 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.compression_opts.level: 32767 2023-12-17T11:55:35.260 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.compression_opts.strategy: 0 2023-12-17T11:55:35.260 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-17T11:55:35.260 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-17T11:55:35.260 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-17T11:55:35.260 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-17T11:55:35.260 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.compression_opts.enabled: false 2023-12-17T11:55:35.260 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-17T11:55:35.260 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-17T11:55:35.261 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-17T11:55:35.261 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-17T11:55:35.261 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.target_file_size_base: 67108864 2023-12-17T11:55:35.261 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-17T11:55:35.261 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-17T11:55:35.261 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-17T11:55:35.261 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-17T11:55:35.261 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-17T11:55:35.261 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-17T11:55:35.261 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-17T11:55:35.261 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-17T11:55:35.261 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-17T11:55:35.262 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-17T11:55:35.262 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-17T11:55:35.262 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-17T11:55:35.263 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-17T11:55:35.263 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-17T11:55:35.263 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.arena_block_size: 1048576 2023-12-17T11:55:35.263 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-17T11:55:35.263 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-17T11:55:35.263 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.disable_auto_compactions: 0 2023-12-17T11:55:35.263 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-17T11:55:35.263 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-17T11:55:35.263 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-17T11:55:35.263 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-17T11:55:35.263 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-17T11:55:35.263 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-17T11:55:35.264 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-17T11:55:35.264 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-17T11:55:35.264 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-17T11:55:35.264 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-17T11:55:35.264 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.table_properties_collectors: 2023-12-17T11:55:35.264 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.inplace_update_support: 0 2023-12-17T11:55:35.264 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-17T11:55:35.264 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-17T11:55:35.264 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-17T11:55:35.264 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-17T11:55:35.264 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.bloom_locality: 0 2023-12-17T11:55:35.264 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.max_successive_merges: 0 2023-12-17T11:55:35.264 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-17T11:55:35.265 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.paranoid_file_checks: 0 2023-12-17T11:55:35.265 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.force_consistency_checks: 1 2023-12-17T11:55:35.265 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.report_bg_io_stats: 0 2023-12-17T11:55:35.265 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.ttl: 2592000 2023-12-17T11:55:35.265 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-17T11:55:35.265 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-17T11:55:35.265 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-17T11:55:35.265 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.enable_blob_files: false 2023-12-17T11:55:35.265 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.min_blob_size: 0 2023-12-17T11:55:35.265 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.blob_file_size: 268435456 2023-12-17T11:55:35.265 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-17T11:55:35.266 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-17T11:55:35.266 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-17T11:55:35.266 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-17T11:55:35.266 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-17T11:55:35.266 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.blob_file_starting_level: 0 2023-12-17T11:55:35.266 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-17T11:55:35.266 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2023-12-17T11:55:35.266 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2023-12-17T11:55:35.266 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 0e7efb12-4d34-49c5-a180-4a9d3436a46e 2023-12-17T11:55:35.266 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702814134843008, "job": 1, "event": "recovery_started", "wal_files": [9]} 2023-12-17T11:55:35.266 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2023-12-17T11:55:35.266 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702814134845894, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 93177, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 310, "table_properties": {"data_size": 91205, "index_size": 254, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13394, "raw_average_key_size": 49, "raw_value_size": 83902, "raw_average_value_size": 311, "num_data_blocks": 11, "num_entries": 269, "num_filter_entries": 269, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1702814134, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "0e7efb12-4d34-49c5-a180-4a9d3436a46e", "db_session_id": "YBKH6S9ZKXS6RD834UR1", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2023-12-17T11:55:35.266 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702814134846083, "job": 1, "event": "recovery_finished"} 2023-12-17T11:55:35.266 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2023-12-17T11:55:35.267 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-17T11:55:35.267 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x564b3befa000 2023-12-17T11:55:35.267 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: DB pointer 0x564b3bee6000 2023-12-17T11:55:35.267 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-17T11:55:35.267 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-17T11:55:35.267 INFO:journalctl@ceph.mon.a.smithi008.stdout: ** DB Stats ** 2023-12-17T11:55:35.267 INFO:journalctl@ceph.mon.a.smithi008.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-17T11:55:35.267 INFO:journalctl@ceph.mon.a.smithi008.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-17T11:55:35.267 INFO:journalctl@ceph.mon.a.smithi008.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-17T11:55:35.267 INFO:journalctl@ceph.mon.a.smithi008.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-17T11:55:35.267 INFO:journalctl@ceph.mon.a.smithi008.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-17T11:55:35.267 INFO:journalctl@ceph.mon.a.smithi008.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-17T11:55:35.267 INFO:journalctl@ceph.mon.a.smithi008.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-17T11:55:35.267 INFO:journalctl@ceph.mon.a.smithi008.stdout: 2023-12-17T11:55:35.268 INFO:journalctl@ceph.mon.a.smithi008.stdout: ** Compaction Stats [default] ** 2023-12-17T11:55:35.268 INFO:journalctl@ceph.mon.a.smithi008.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-17T11:55:35.268 INFO:journalctl@ceph.mon.a.smithi008.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-17T11:55:35.268 INFO:journalctl@ceph.mon.a.smithi008.stdout: L0 2/0 92.83 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 46.8 0.00 0.00 1 0.002 0 0 0.0 0.0 2023-12-17T11:55:35.268 INFO:journalctl@ceph.mon.a.smithi008.stdout: Sum 2/0 92.83 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 46.8 0.00 0.00 1 0.002 0 0 0.0 0.0 2023-12-17T11:55:35.268 INFO:journalctl@ceph.mon.a.smithi008.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 46.8 0.00 0.00 1 0.002 0 0 0.0 0.0 2023-12-17T11:55:35.268 INFO:journalctl@ceph.mon.a.smithi008.stdout: 2023-12-17T11:55:35.268 INFO:journalctl@ceph.mon.a.smithi008.stdout: ** Compaction Stats [default] ** 2023-12-17T11:55:35.268 INFO:journalctl@ceph.mon.a.smithi008.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-17T11:55:35.268 INFO:journalctl@ceph.mon.a.smithi008.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-17T11:55:35.268 INFO:journalctl@ceph.mon.a.smithi008.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 46.8 0.00 0.00 1 0.002 0 0 0.0 0.0 2023-12-17T11:55:35.268 INFO:journalctl@ceph.mon.a.smithi008.stdout: 2023-12-17T11:55:35.268 INFO:journalctl@ceph.mon.a.smithi008.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-17T11:55:35.268 INFO:journalctl@ceph.mon.a.smithi008.stdout: 2023-12-17T11:55:35.269 INFO:journalctl@ceph.mon.a.smithi008.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-17T11:55:35.269 INFO:journalctl@ceph.mon.a.smithi008.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-17T11:55:35.269 INFO:journalctl@ceph.mon.a.smithi008.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-17T11:55:35.269 INFO:journalctl@ceph.mon.a.smithi008.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-17T11:55:35.269 INFO:journalctl@ceph.mon.a.smithi008.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-17T11:55:35.269 INFO:journalctl@ceph.mon.a.smithi008.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-17T11:55:35.269 INFO:journalctl@ceph.mon.a.smithi008.stdout: Cumulative compaction: 0.00 GB write, 9.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-17T11:55:35.269 INFO:journalctl@ceph.mon.a.smithi008.stdout: Interval compaction: 0.00 GB write, 9.63 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-17T11:55:35.269 INFO:journalctl@ceph.mon.a.smithi008.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-17T11:55:35.269 INFO:journalctl@ceph.mon.a.smithi008.stdout: Block cache BinnedLRUCache@0x564b3be5f090#7 capacity: 512.00 MB usage: 1.33 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2023-12-17T11:55:35.269 INFO:journalctl@ceph.mon.a.smithi008.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.44 KB,8.34465e-05%) Misc(1,0.00 KB,0%) 2023-12-17T11:55:35.270 INFO:journalctl@ceph.mon.a.smithi008.stdout: 2023-12-17T11:55:35.270 INFO:journalctl@ceph.mon.a.smithi008.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-17T11:55:35.270 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: starting mon.a rank 0 at public addrs [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] at bind addrs [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid f43f508a-9cd2-11ee-95a5-87774f69a715 2023-12-17T11:55:35.270 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: mon.a@-1(???) e1 preinit fsid f43f508a-9cd2-11ee-95a5-87774f69a715 2023-12-17T11:55:35.270 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: mon.a@-1(???).mds e1 new map 2023-12-17T11:55:35.270 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: mon.a@-1(???).mds e1 print_map 2023-12-17T11:55:35.270 INFO:journalctl@ceph.mon.a.smithi008.stdout: e1 2023-12-17T11:55:35.270 INFO:journalctl@ceph.mon.a.smithi008.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-17T11:55:35.270 INFO:journalctl@ceph.mon.a.smithi008.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-12-17T11:55:35.271 INFO:journalctl@ceph.mon.a.smithi008.stdout: legacy client fscid: -1 2023-12-17T11:55:35.271 INFO:journalctl@ceph.mon.a.smithi008.stdout: 2023-12-17T11:55:35.271 INFO:journalctl@ceph.mon.a.smithi008.stdout: No filesystems configured 2023-12-17T11:55:35.271 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-17T11:55:35.271 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-17T11:55:35.271 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-17T11:55:35.271 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-12-17T11:55:35.271 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-12-17T11:55:35.271 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: mon.a is new leader, mons a in quorum (ranks 0) 2023-12-17T11:55:35.271 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: monmap e1: 1 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-17T11:55:35.272 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: fsmap 2023-12-17T11:55:35.272 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: osdmap e1: 0 total, 0 up, 0 in 2023-12-17T11:55:35.272 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:34 smithi008 ceph-mon[36830]: mgrmap e1: no daemons active 2023-12-17T11:55:35.702 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.272+0000 7fde6e182700 1 Processor -- start 2023-12-17T11:55:35.707 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.273+0000 7fde6e182700 1 -- start start 2023-12-17T11:55:35.707 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.273+0000 7fde6e182700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde6807ce80 0x7fde6807b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:35.707 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.273+0000 7fde6e182700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde6807b8b0 con 0x7fde6807ce80 2023-12-17T11:55:35.707 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.273+0000 7fde677fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde6807ce80 0x7fde6807b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:35.707 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.274+0000 7fde677fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde6807ce80 0x7fde6807b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45146/0 (socket says 172.21.15.8:45146) 2023-12-17T11:55:35.707 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.274+0000 7fde677fe700 1 -- 172.21.15.8:0/613894953 learned_addr learned my addr 172.21.15.8:0/613894953 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:55:35.707 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.274+0000 7fde677fe700 1 -- 172.21.15.8:0/613894953 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde6807b9f0 con 0x7fde6807ce80 2023-12-17T11:55:35.707 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.274+0000 7fde677fe700 1 --2- 172.21.15.8:0/613894953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde6807ce80 0x7fde6807b2e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fde580098a0 tx=0x7fde58009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82b04e76ff1fe4ff server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:35.707 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.274+0000 7fde667fc700 1 -- 172.21.15.8:0/613894953 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde58004160 con 0x7fde6807ce80 2023-12-17T11:55:35.708 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.275+0000 7fde667fc700 1 -- 172.21.15.8:0/613894953 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fde580042c0 con 0x7fde6807ce80 2023-12-17T11:55:35.708 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.275+0000 7fde667fc700 1 -- 172.21.15.8:0/613894953 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde58011940 con 0x7fde6807ce80 2023-12-17T11:55:35.708 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.275+0000 7fde6e182700 1 -- 172.21.15.8:0/613894953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde6807ce80 msgr2=0x7fde6807b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:35.708 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.275+0000 7fde6e182700 1 --2- 172.21.15.8:0/613894953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde6807ce80 0x7fde6807b2e0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fde580098a0 tx=0x7fde58009bb0 comp rx=0 tx=0).stop 2023-12-17T11:55:35.708 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.275+0000 7fde6e182700 1 -- 172.21.15.8:0/613894953 shutdown_connections 2023-12-17T11:55:35.708 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.275+0000 7fde6e182700 1 --2- 172.21.15.8:0/613894953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde6807ce80 0x7fde6807b2e0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:35.708 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.275+0000 7fde6e182700 1 -- 172.21.15.8:0/613894953 >> 172.21.15.8:0/613894953 conn(0x7fde68102030 msgr2=0x7fde681044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:35.708 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.275+0000 7fde6e182700 1 -- 172.21.15.8:0/613894953 shutdown_connections 2023-12-17T11:55:35.708 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.275+0000 7fde6e182700 1 -- 172.21.15.8:0/613894953 wait complete. 2023-12-17T11:55:35.708 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.277+0000 7fde6e182700 1 Processor -- start 2023-12-17T11:55:35.708 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.277+0000 7fde6e182700 1 -- start start 2023-12-17T11:55:35.708 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.277+0000 7fde6e182700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde6807ce80 0x7fde6819c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:35.708 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.277+0000 7fde6e182700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde6819cea0 con 0x7fde6807ce80 2023-12-17T11:55:35.708 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.278+0000 7fde677fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde6807ce80 0x7fde6819c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:35.709 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.278+0000 7fde677fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde6807ce80 0x7fde6819c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45152/0 (socket says 172.21.15.8:45152) 2023-12-17T11:55:35.709 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.278+0000 7fde677fe700 1 -- 172.21.15.8:0/2672026153 learned_addr learned my addr 172.21.15.8:0/2672026153 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:55:35.709 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.278+0000 7fde677fe700 1 -- 172.21.15.8:0/2672026153 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde58009550 con 0x7fde6807ce80 2023-12-17T11:55:35.709 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.278+0000 7fde677fe700 1 --2- 172.21.15.8:0/2672026153 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde6807ce80 0x7fde6819c960 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fde58003f20 tx=0x7fde58011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:35.709 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.279+0000 7fde64ff9700 1 -- 172.21.15.8:0/2672026153 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde580036a0 con 0x7fde6807ce80 2023-12-17T11:55:35.709 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.279+0000 7fde64ff9700 1 -- 172.21.15.8:0/2672026153 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fde58003c70 con 0x7fde6807ce80 2023-12-17T11:55:35.709 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.279+0000 7fde6e182700 1 -- 172.21.15.8:0/2672026153 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde6819d0a0 con 0x7fde6807ce80 2023-12-17T11:55:35.709 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.279+0000 7fde64ff9700 1 -- 172.21.15.8:0/2672026153 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fde5801be80 con 0x7fde6807ce80 2023-12-17T11:55:35.709 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.279+0000 7fde6e182700 1 -- 172.21.15.8:0/2672026153 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde6819d540 con 0x7fde6807ce80 2023-12-17T11:55:35.709 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.279+0000 7fde64ff9700 1 -- 172.21.15.8:0/2672026153 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fde580237e0 con 0x7fde6807ce80 2023-12-17T11:55:35.709 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.279+0000 7fde64ff9700 1 -- 172.21.15.8:0/2672026153 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fde5802cda0 con 0x7fde6807ce80 2023-12-17T11:55:35.709 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.280+0000 7fde6e182700 1 -- 172.21.15.8:0/2672026153 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde6810ce40 con 0x7fde6807ce80 2023-12-17T11:55:35.709 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.283+0000 7fde64ff9700 1 -- 172.21.15.8:0/2672026153 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fde5801b440 con 0x7fde6807ce80 2023-12-17T11:55:35.709 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.356+0000 7fde6e182700 1 -- 172.21.15.8:0/2672026153 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fde6819fdd0 con 0x7fde6807ce80 2023-12-17T11:55:35.710 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.358+0000 7fde64ff9700 1 -- 172.21.15.8:0/2672026153 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fde5802c3f0 con 0x7fde6807ce80 2023-12-17T11:55:35.710 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.359+0000 7fde6e182700 1 -- 172.21.15.8:0/2672026153 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde6807ce80 msgr2=0x7fde6819c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:35.710 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.359+0000 7fde6e182700 1 --2- 172.21.15.8:0/2672026153 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde6807ce80 0x7fde6819c960 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fde58003f20 tx=0x7fde58011f00 comp rx=0 tx=0).stop 2023-12-17T11:55:35.710 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.359+0000 7fde6e182700 1 -- 172.21.15.8:0/2672026153 shutdown_connections 2023-12-17T11:55:35.710 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.359+0000 7fde6e182700 1 --2- 172.21.15.8:0/2672026153 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fde6807ce80 0x7fde6819c960 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:35.710 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.359+0000 7fde6e182700 1 -- 172.21.15.8:0/2672026153 >> 172.21.15.8:0/2672026153 conn(0x7fde68102030 msgr2=0x7fde68102bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:35.710 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.359+0000 7fde6e182700 1 -- 172.21.15.8:0/2672026153 shutdown_connections 2023-12-17T11:55:35.710 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:35.359+0000 7fde6e182700 1 -- 172.21.15.8:0/2672026153 wait complete. 2023-12-17T11:55:35.710 INFO:teuthology.orchestra.run.smithi008.stdout:Wrote config to /etc/ceph/ceph.conf 2023-12-17T11:55:35.731 INFO:teuthology.orchestra.run.smithi008.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-12-17T11:55:35.731 INFO:teuthology.orchestra.run.smithi008.stdout:Creating mgr... 2023-12-17T11:55:35.731 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying port 0.0.0.0:9283 ... 2023-12-17T11:55:35.732 INFO:teuthology.orchestra.run.smithi008.stdout:Verifying port 0.0.0.0:8765 ... 2023-12-17T11:55:36.115 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mgr.x 2023-12-17T11:55:36.115 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mgr.x.service: Unit ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mgr.x.service not loaded. 2023-12-17T11:55:36.334 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f43f508a-9cd2-11ee-95a5-87774f69a715.target.wants/ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mgr.x.service → /etc/systemd/system/ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@.service. 2023-12-17T11:55:36.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:36 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/2672026153' entity='client.admin' 2023-12-17T11:55:36.496 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:36 smithi008 systemd[1]: Starting Ceph mgr.x for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T11:55:36.924 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-17T11:55:36.924 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout disabled 2023-12-17T11:55:36.941 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-17T11:55:36.941 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout inactive 2023-12-17T11:55:36.941 INFO:teuthology.orchestra.run.smithi008.stdout:firewalld.service is not enabled 2023-12-17T11:55:36.941 INFO:teuthology.orchestra.run.smithi008.stdout:Not possible to enable service . firewalld.service is not available 2023-12-17T11:55:36.959 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-17T11:55:36.959 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout disabled 2023-12-17T11:55:36.976 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-17T11:55:36.976 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout inactive 2023-12-17T11:55:36.976 INFO:teuthology.orchestra.run.smithi008.stdout:firewalld.service is not enabled 2023-12-17T11:55:36.976 INFO:teuthology.orchestra.run.smithi008.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2023-12-17T11:55:36.977 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for mgr to start... 2023-12-17T11:55:36.977 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for mgr... 2023-12-17T11:55:37.164 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:36 smithi008 bash[37067]: a0d35217752d66efd5661e5b74f20e8a6ea94ba8a0b8bc726368b87937ba366c 2023-12-17T11:55:37.164 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:36 smithi008 systemd[1]: Started Ceph mgr.x for f43f508a-9cd2-11ee-95a5-87774f69a715. 2023-12-17T11:55:37.708 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:37 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/4162679029' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-17T11:55:37.708 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:37 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:37.441+0000 7fe437cec200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-17T11:55:37.708 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:37 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:37.584+0000 7fe437cec200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-17T11:55:37.810 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-12-17T11:55:37.810 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout { 2023-12-17T11:55:37.810 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "fsid": "f43f508a-9cd2-11ee-95a5-87774f69a715", 2023-12-17T11:55:37.810 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "health": { 2023-12-17T11:55:37.810 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-17T11:55:37.810 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-17T11:55:37.810 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-17T11:55:37.810 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:55:37.811 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-17T11:55:37.811 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-17T11:55:37.811 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 0 2023-12-17T11:55:37.811 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-12-17T11:55:37.811 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-17T11:55:37.811 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "a" 2023-12-17T11:55:37.811 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-12-17T11:55:37.811 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2023-12-17T11:55:37.811 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-17T11:55:37.812 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:55:37.812 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-12-17T11:55:37.812 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-17T11:55:37.812 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:55:37.812 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-17T11:55:37.812 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:55:37.812 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-17T11:55:37.812 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-17T11:55:37.812 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-17T11:55:37.820 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-17T11:55:37.820 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-17T11:55:37.820 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-17T11:55:37.820 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:55:37.820 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-17T11:55:37.820 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-17T11:55:37.820 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-17T11:55:37.820 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-17T11:55:37.820 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-17T11:55:37.820 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-17T11:55:37.820 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-17T11:55:37.820 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-17T11:55:37.820 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-17T11:55:37.820 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:55:37.821 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-17T11:55:37.821 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:55:37.821 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-17T11:55:37.821 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-17T11:55:37.821 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:55:37.821 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-17T11:55:37.821 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-17T11:55:37.821 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-17T11:55:37.821 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-17T11:55:37.821 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-17T11:55:37.821 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-17T11:55:37.821 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "restful" 2023-12-17T11:55:37.821 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-12-17T11:55:37.821 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-17T11:55:37.821 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:55:37.822 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-17T11:55:37.822 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:55:37.822 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "modified": "2023-12-17T11:55:30.667293+0000", 2023-12-17T11:55:37.822 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-17T11:55:37.822 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:55:37.822 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-17T11:55:37.822 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout } 2023-12-17T11:55:37.822 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.388+0000 7f233db68700 1 Processor -- start 2023-12-17T11:55:37.822 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.388+0000 7f233db68700 1 -- start start 2023-12-17T11:55:37.822 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.388+0000 7f233db68700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2338105330 0x7f2338107760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:37.822 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.388+0000 7f233db68700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f233807ae90 con 0x7f2338105330 2023-12-17T11:55:37.822 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.389+0000 7f23377fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2338105330 0x7f2338107760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:37.822 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.389+0000 7f23377fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2338105330 0x7f2338107760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45180/0 (socket says 172.21.15.8:45180) 2023-12-17T11:55:37.822 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.389+0000 7f23377fe700 1 -- 172.21.15.8:0/396656724 learned_addr learned my addr 172.21.15.8:0/396656724 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:55:37.822 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.389+0000 7f23377fe700 1 -- 172.21.15.8:0/396656724 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2338107ca0 con 0x7f2338105330 2023-12-17T11:55:37.823 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.389+0000 7f23377fe700 1 --2- 172.21.15.8:0/396656724 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2338105330 0x7f2338107760 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f23280098a0 tx=0x7f2328009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390925c62afa3caf server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:37.823 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.390+0000 7f23367fc700 1 -- 172.21.15.8:0/396656724 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2328004160 con 0x7f2338105330 2023-12-17T11:55:37.823 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.390+0000 7f23367fc700 1 -- 172.21.15.8:0/396656724 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f23280042c0 con 0x7f2338105330 2023-12-17T11:55:37.823 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.390+0000 7f23367fc700 1 -- 172.21.15.8:0/396656724 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2328011940 con 0x7f2338105330 2023-12-17T11:55:37.823 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.390+0000 7f233db68700 1 -- 172.21.15.8:0/396656724 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2338105330 msgr2=0x7f2338107760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:37.823 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.390+0000 7f233db68700 1 --2- 172.21.15.8:0/396656724 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2338105330 0x7f2338107760 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f23280098a0 tx=0x7f2328009bb0 comp rx=0 tx=0).stop 2023-12-17T11:55:37.823 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.391+0000 7f233db68700 1 -- 172.21.15.8:0/396656724 shutdown_connections 2023-12-17T11:55:37.823 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.391+0000 7f233db68700 1 --2- 172.21.15.8:0/396656724 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2338105330 0x7f2338107760 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:37.823 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.391+0000 7f233db68700 1 -- 172.21.15.8:0/396656724 >> 172.21.15.8:0/396656724 conn(0x7f2338100f70 msgr2=0x7f23381033b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:37.823 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.391+0000 7f233db68700 1 -- 172.21.15.8:0/396656724 shutdown_connections 2023-12-17T11:55:37.823 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.391+0000 7f233db68700 1 -- 172.21.15.8:0/396656724 wait complete. 2023-12-17T11:55:37.823 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.392+0000 7f233db68700 1 Processor -- start 2023-12-17T11:55:37.823 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.392+0000 7f233db68700 1 -- start start 2023-12-17T11:55:37.823 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.392+0000 7f233db68700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2338105330 0x7f23381a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:37.823 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.392+0000 7f233db68700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23381a1290 con 0x7f2338105330 2023-12-17T11:55:37.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.392+0000 7f23377fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2338105330 0x7f23381a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:37.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.392+0000 7f23377fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2338105330 0x7f23381a0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45182/0 (socket says 172.21.15.8:45182) 2023-12-17T11:55:37.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.392+0000 7f23377fe700 1 -- 172.21.15.8:0/4162679029 learned_addr learned my addr 172.21.15.8:0/4162679029 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:55:37.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.393+0000 7f23377fe700 1 -- 172.21.15.8:0/4162679029 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2328009550 con 0x7f2338105330 2023-12-17T11:55:37.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.393+0000 7f23377fe700 1 --2- 172.21.15.8:0/4162679029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2338105330 0x7f23381a0d50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2328003f20 tx=0x7f2328011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:37.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.393+0000 7f2334ff9700 1 -- 172.21.15.8:0/4162679029 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f23280037d0 con 0x7f2338105330 2023-12-17T11:55:37.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.393+0000 7f2334ff9700 1 -- 172.21.15.8:0/4162679029 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f232801b440 con 0x7f2338105330 2023-12-17T11:55:37.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.393+0000 7f2334ff9700 1 -- 172.21.15.8:0/4162679029 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2328023590 con 0x7f2338105330 2023-12-17T11:55:37.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.393+0000 7f233db68700 1 -- 172.21.15.8:0/4162679029 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23381a1490 con 0x7f2338105330 2023-12-17T11:55:37.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.393+0000 7f233db68700 1 -- 172.21.15.8:0/4162679029 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23381a1930 con 0x7f2338105330 2023-12-17T11:55:37.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.394+0000 7f2334ff9700 1 -- 172.21.15.8:0/4162679029 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2328023b50 con 0x7f2338105330 2023-12-17T11:55:37.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.394+0000 7f2334ff9700 1 -- 172.21.15.8:0/4162679029 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f23280193d0 con 0x7f2338105330 2023-12-17T11:55:37.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.395+0000 7f233db68700 1 -- 172.21.15.8:0/4162679029 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f233819a610 con 0x7f2338105330 2023-12-17T11:55:37.824 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.397+0000 7f2334ff9700 1 -- 172.21.15.8:0/4162679029 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f232802ce50 con 0x7f2338105330 2023-12-17T11:55:37.825 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.475+0000 7f233db68700 1 -- 172.21.15.8:0/4162679029 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f2338108d20 con 0x7f2338105330 2023-12-17T11:55:37.825 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.476+0000 7f2334ff9700 1 -- 172.21.15.8:0/4162679029 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f2328006d60 con 0x7f2338105330 2023-12-17T11:55:37.825 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.477+0000 7f233db68700 1 -- 172.21.15.8:0/4162679029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2338105330 msgr2=0x7f23381a0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:37.825 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.477+0000 7f233db68700 1 --2- 172.21.15.8:0/4162679029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2338105330 0x7f23381a0d50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f2328003f20 tx=0x7f2328011f00 comp rx=0 tx=0).stop 2023-12-17T11:55:37.825 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.477+0000 7f233db68700 1 -- 172.21.15.8:0/4162679029 shutdown_connections 2023-12-17T11:55:37.825 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.477+0000 7f233db68700 1 --2- 172.21.15.8:0/4162679029 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2338105330 0x7f23381a0d50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:37.825 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.477+0000 7f233db68700 1 -- 172.21.15.8:0/4162679029 >> 172.21.15.8:0/4162679029 conn(0x7f2338100f70 msgr2=0x7f23381033b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:37.825 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.477+0000 7f233db68700 1 -- 172.21.15.8:0/4162679029 shutdown_connections 2023-12-17T11:55:37.825 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:37.477+0000 7f233db68700 1 -- 172.21.15.8:0/4162679029 wait complete. 2023-12-17T11:55:37.825 INFO:teuthology.orchestra.run.smithi008.stdout:mgr not available, waiting (1/15)... 2023-12-17T11:55:37.995 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:37 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:37.705+0000 7fe437cec200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-17T11:55:37.996 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:37 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:37.826+0000 7fe437cec200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-17T11:55:38.995 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:38 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:38.711+0000 7fe437cec200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-17T11:55:39.284 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:39 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:39.022+0000 7fe437cec200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-17T11:55:39.285 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:39 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:39.139+0000 7fe437cec200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-17T11:55:39.661 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:39 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:39.283+0000 7fe437cec200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-17T11:55:39.661 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:39 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:39.482+0000 7fe437cec200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-17T11:55:39.930 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:39 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:39.659+0000 7fe437cec200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-17T11:55:39.930 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:39 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:39.776+0000 7fe437cec200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-17T11:55:40.549 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:40 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:40.294+0000 7fe437cec200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-17T11:55:40.674 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-12-17T11:55:40.674 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout { 2023-12-17T11:55:40.674 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "fsid": "f43f508a-9cd2-11ee-95a5-87774f69a715", 2023-12-17T11:55:40.674 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "health": { 2023-12-17T11:55:40.674 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-17T11:55:40.675 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-17T11:55:40.675 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-17T11:55:40.675 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:55:40.675 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-17T11:55:40.675 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-17T11:55:40.675 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 0 2023-12-17T11:55:40.675 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-12-17T11:55:40.675 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-17T11:55:40.675 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "a" 2023-12-17T11:55:40.675 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-12-17T11:55:40.675 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2023-12-17T11:55:40.675 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-17T11:55:40.675 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:55:40.675 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-12-17T11:55:40.675 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-17T11:55:40.676 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:55:40.676 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-17T11:55:40.676 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:55:40.676 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-17T11:55:40.676 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-17T11:55:40.684 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-17T11:55:40.684 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-17T11:55:40.684 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-17T11:55:40.684 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-17T11:55:40.684 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:55:40.684 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-17T11:55:40.684 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-17T11:55:40.684 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-17T11:55:40.685 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-17T11:55:40.685 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-17T11:55:40.685 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-17T11:55:40.685 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-17T11:55:40.685 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-17T11:55:40.685 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-17T11:55:40.685 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:55:40.685 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-17T11:55:40.685 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:55:40.685 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-17T11:55:40.685 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-17T11:55:40.685 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:55:40.685 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-17T11:55:40.685 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-17T11:55:40.685 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-17T11:55:40.686 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-17T11:55:40.686 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-17T11:55:40.686 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-17T11:55:40.686 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "restful" 2023-12-17T11:55:40.686 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-12-17T11:55:40.686 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-17T11:55:40.686 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:55:40.686 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-17T11:55:40.686 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:55:40.686 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "modified": "2023-12-17T11:55:30.667293+0000", 2023-12-17T11:55:40.686 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-17T11:55:40.686 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:55:40.686 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-17T11:55:40.686 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout } 2023-12-17T11:55:40.686 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.238+0000 7efdd3168700 1 Processor -- start 2023-12-17T11:55:40.687 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.238+0000 7efdd3168700 1 -- start start 2023-12-17T11:55:40.687 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.239+0000 7efdd3168700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efdcc07ce40 0x7efdcc07b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:40.687 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.239+0000 7efdd3168700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdcc07b870 con 0x7efdcc07ce40 2023-12-17T11:55:40.687 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.239+0000 7efdd0f04700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efdcc07ce40 0x7efdcc07b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:40.687 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.239+0000 7efdd0f04700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efdcc07ce40 0x7efdcc07b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45196/0 (socket says 172.21.15.8:45196) 2023-12-17T11:55:40.687 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.239+0000 7efdd0f04700 1 -- 172.21.15.8:0/4158601947 learned_addr learned my addr 172.21.15.8:0/4158601947 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:55:40.687 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.240+0000 7efdd0f04700 1 -- 172.21.15.8:0/4158601947 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdcc07b9b0 con 0x7efdcc07ce40 2023-12-17T11:55:40.687 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.240+0000 7efdd0f04700 1 --2- 172.21.15.8:0/4158601947 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efdcc07ce40 0x7efdcc07b2a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efdc00098a0 tx=0x7efdc0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdbacb41ee0456e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:40.687 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.240+0000 7efdcb7fe700 1 -- 172.21.15.8:0/4158601947 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efdc0004160 con 0x7efdcc07ce40 2023-12-17T11:55:40.687 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.240+0000 7efdcb7fe700 1 -- 172.21.15.8:0/4158601947 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7efdc00042c0 con 0x7efdcc07ce40 2023-12-17T11:55:40.687 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.240+0000 7efdcb7fe700 1 -- 172.21.15.8:0/4158601947 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efdc0011940 con 0x7efdcc07ce40 2023-12-17T11:55:40.687 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.241+0000 7efdd3168700 1 -- 172.21.15.8:0/4158601947 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efdcc07ce40 msgr2=0x7efdcc07b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:40.687 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.241+0000 7efdd3168700 1 --2- 172.21.15.8:0/4158601947 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efdcc07ce40 0x7efdcc07b2a0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7efdc00098a0 tx=0x7efdc0009bb0 comp rx=0 tx=0).stop 2023-12-17T11:55:40.687 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.241+0000 7efdd3168700 1 -- 172.21.15.8:0/4158601947 shutdown_connections 2023-12-17T11:55:40.688 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.241+0000 7efdd3168700 1 --2- 172.21.15.8:0/4158601947 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efdcc07ce40 0x7efdcc07b2a0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:40.688 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.241+0000 7efdd3168700 1 -- 172.21.15.8:0/4158601947 >> 172.21.15.8:0/4158601947 conn(0x7efdcc102030 msgr2=0x7efdcc1044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:40.688 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.241+0000 7efdd3168700 1 -- 172.21.15.8:0/4158601947 shutdown_connections 2023-12-17T11:55:40.688 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.241+0000 7efdd3168700 1 -- 172.21.15.8:0/4158601947 wait complete. 2023-12-17T11:55:40.688 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.242+0000 7efdd3168700 1 Processor -- start 2023-12-17T11:55:40.688 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.242+0000 7efdd3168700 1 -- start start 2023-12-17T11:55:40.688 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.243+0000 7efdd3168700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efdcc07ce40 0x7efdcc19c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:40.688 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.243+0000 7efdd3168700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdcc19ce80 con 0x7efdcc07ce40 2023-12-17T11:55:40.688 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.243+0000 7efdd0f04700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efdcc07ce40 0x7efdcc19c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:40.688 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.243+0000 7efdd0f04700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efdcc07ce40 0x7efdcc19c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:45202/0 (socket says 172.21.15.8:45202) 2023-12-17T11:55:40.688 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.243+0000 7efdd0f04700 1 -- 172.21.15.8:0/3719804501 learned_addr learned my addr 172.21.15.8:0/3719804501 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:55:40.688 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.243+0000 7efdd0f04700 1 -- 172.21.15.8:0/3719804501 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc0009550 con 0x7efdcc07ce40 2023-12-17T11:55:40.688 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.243+0000 7efdd0f04700 1 --2- 172.21.15.8:0/3719804501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efdcc07ce40 0x7efdcc19c940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efdc0003f20 tx=0x7efdc0011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:40.688 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.244+0000 7efdc9ffb700 1 -- 172.21.15.8:0/3719804501 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efdc00037d0 con 0x7efdcc07ce40 2023-12-17T11:55:40.688 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.244+0000 7efdc9ffb700 1 -- 172.21.15.8:0/3719804501 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7efdc001b440 con 0x7efdcc07ce40 2023-12-17T11:55:40.689 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.244+0000 7efdc9ffb700 1 -- 172.21.15.8:0/3719804501 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efdc0023590 con 0x7efdcc07ce40 2023-12-17T11:55:40.689 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.244+0000 7efdd3168700 1 -- 172.21.15.8:0/3719804501 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdcc19d080 con 0x7efdcc07ce40 2023-12-17T11:55:40.689 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.244+0000 7efdd3168700 1 -- 172.21.15.8:0/3719804501 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdcc19d520 con 0x7efdcc07ce40 2023-12-17T11:55:40.689 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.244+0000 7efdc9ffb700 1 -- 172.21.15.8:0/3719804501 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7efdc00239f0 con 0x7efdcc07ce40 2023-12-17T11:55:40.689 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.244+0000 7efdc9ffb700 1 -- 172.21.15.8:0/3719804501 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7efdc002cd20 con 0x7efdcc07ce40 2023-12-17T11:55:40.689 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.245+0000 7efdd3168700 1 -- 172.21.15.8:0/3719804501 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdcc10ce20 con 0x7efdcc07ce40 2023-12-17T11:55:40.689 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.248+0000 7efdc9ffb700 1 -- 172.21.15.8:0/3719804501 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7efdc0023e30 con 0x7efdcc07ce40 2023-12-17T11:55:40.689 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.326+0000 7efdd3168700 1 -- 172.21.15.8:0/3719804501 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7efdcc1a0020 con 0x7efdcc07ce40 2023-12-17T11:55:40.689 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.327+0000 7efdc9ffb700 1 -- 172.21.15.8:0/3719804501 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7efdc001b5b0 con 0x7efdcc07ce40 2023-12-17T11:55:40.689 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.328+0000 7efdd3168700 1 -- 172.21.15.8:0/3719804501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efdcc07ce40 msgr2=0x7efdcc19c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:40.689 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.328+0000 7efdd3168700 1 --2- 172.21.15.8:0/3719804501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efdcc07ce40 0x7efdcc19c940 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efdc0003f20 tx=0x7efdc0011f00 comp rx=0 tx=0).stop 2023-12-17T11:55:40.689 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.328+0000 7efdd3168700 1 -- 172.21.15.8:0/3719804501 shutdown_connections 2023-12-17T11:55:40.689 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.328+0000 7efdd3168700 1 --2- 172.21.15.8:0/3719804501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efdcc07ce40 0x7efdcc19c940 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:40.689 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.328+0000 7efdd3168700 1 -- 172.21.15.8:0/3719804501 >> 172.21.15.8:0/3719804501 conn(0x7efdcc102030 msgr2=0x7efdcc102c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:40.690 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.328+0000 7efdd3168700 1 -- 172.21.15.8:0/3719804501 shutdown_connections 2023-12-17T11:55:40.690 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:40.328+0000 7efdd3168700 1 -- 172.21.15.8:0/3719804501 wait complete. 2023-12-17T11:55:40.690 INFO:teuthology.orchestra.run.smithi008.stdout:mgr not available, waiting (2/15)... 2023-12-17T11:55:40.862 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:40 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:40.674+0000 7fe437cec200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-17T11:55:41.170 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:40 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/3719804501' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-17T11:55:41.170 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:41 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:41.040+0000 7fe437cec200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-17T11:55:41.495 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:41 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:41.168+0000 7fe437cec200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-17T11:55:42.484 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:42 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:42.155+0000 7fe437cec200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-17T11:55:42.485 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:42 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:42.282+0000 7fe437cec200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-17T11:55:42.745 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:42 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:42.483+0000 7fe437cec200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-17T11:55:43.586 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-12-17T11:55:43.586 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout { 2023-12-17T11:55:43.586 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "fsid": "f43f508a-9cd2-11ee-95a5-87774f69a715", 2023-12-17T11:55:43.586 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "health": { 2023-12-17T11:55:43.586 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-17T11:55:43.586 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-17T11:55:43.586 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-17T11:55:43.587 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:43 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/34461434' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-17T11:55:43.587 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:43 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:43.363+0000 7fe437cec200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-17T11:55:43.589 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:55:43.589 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-17T11:55:43.589 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-17T11:55:43.589 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 0 2023-12-17T11:55:43.589 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-12-17T11:55:43.590 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-17T11:55:43.590 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "a" 2023-12-17T11:55:43.590 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-12-17T11:55:43.590 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2023-12-17T11:55:43.590 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-17T11:55:43.590 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:55:43.590 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-12-17T11:55:43.590 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-17T11:55:43.590 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:55:43.590 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-17T11:55:43.590 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:55:43.590 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-17T11:55:43.590 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-17T11:55:43.590 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-17T11:55:43.590 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-17T11:55:43.590 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-17T11:55:43.591 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-17T11:55:43.591 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:55:43.591 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-17T11:55:43.591 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-17T11:55:43.591 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-17T11:55:43.591 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-17T11:55:43.600 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-17T11:55:43.600 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-17T11:55:43.600 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-17T11:55:43.600 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-17T11:55:43.600 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-17T11:55:43.600 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:55:43.600 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-17T11:55:43.600 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:55:43.600 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-17T11:55:43.600 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-17T11:55:43.601 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:55:43.601 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-17T11:55:43.601 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-17T11:55:43.601 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-17T11:55:43.601 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-17T11:55:43.601 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-17T11:55:43.601 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-17T11:55:43.601 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "restful" 2023-12-17T11:55:43.601 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-12-17T11:55:43.601 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-17T11:55:43.601 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:55:43.601 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-17T11:55:43.601 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:55:43.601 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "modified": "2023-12-17T11:55:30.667293+0000", 2023-12-17T11:55:43.602 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-17T11:55:43.602 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:55:43.602 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-17T11:55:43.602 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout } 2023-12-17T11:55:43.602 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.139+0000 7f1c4fa28700 1 Processor -- start 2023-12-17T11:55:43.602 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.140+0000 7f1c4fa28700 1 -- start start 2023-12-17T11:55:43.602 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.140+0000 7f1c4fa28700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c48106ad0 0x7f1c48106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:43.602 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.140+0000 7f1c4fa28700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c481074c0 con 0x7f1c48106ad0 2023-12-17T11:55:43.602 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.140+0000 7f1c4d7c4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c48106ad0 0x7f1c48106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:43.602 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.140+0000 7f1c4d7c4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c48106ad0 0x7f1c48106ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49930/0 (socket says 172.21.15.8:49930) 2023-12-17T11:55:43.602 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.140+0000 7f1c4d7c4700 1 -- 172.21.15.8:0/3465335565 learned_addr learned my addr 172.21.15.8:0/3465335565 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:55:43.602 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.141+0000 7f1c4d7c4700 1 -- 172.21.15.8:0/3465335565 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c48107cd0 con 0x7f1c48106ad0 2023-12-17T11:55:43.602 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.141+0000 7f1c4d7c4700 1 --2- 172.21.15.8:0/3465335565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c48106ad0 0x7f1c48106ef0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1c440098a0 tx=0x7f1c44009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f709f31580481440 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:43.603 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.141+0000 7f1c3ffff700 1 -- 172.21.15.8:0/3465335565 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c44004160 con 0x7f1c48106ad0 2023-12-17T11:55:43.603 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.141+0000 7f1c3ffff700 1 -- 172.21.15.8:0/3465335565 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f1c440042c0 con 0x7f1c48106ad0 2023-12-17T11:55:43.603 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.141+0000 7f1c3ffff700 1 -- 172.21.15.8:0/3465335565 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c44011940 con 0x7f1c48106ad0 2023-12-17T11:55:43.603 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.142+0000 7f1c4fa28700 1 -- 172.21.15.8:0/3465335565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c48106ad0 msgr2=0x7f1c48106ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:43.603 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.142+0000 7f1c4fa28700 1 --2- 172.21.15.8:0/3465335565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c48106ad0 0x7f1c48106ef0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1c440098a0 tx=0x7f1c44009bb0 comp rx=0 tx=0).stop 2023-12-17T11:55:43.603 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.142+0000 7f1c4fa28700 1 -- 172.21.15.8:0/3465335565 shutdown_connections 2023-12-17T11:55:43.604 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.142+0000 7f1c4fa28700 1 --2- 172.21.15.8:0/3465335565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c48106ad0 0x7f1c48106ef0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:43.604 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.142+0000 7f1c4fa28700 1 -- 172.21.15.8:0/3465335565 >> 172.21.15.8:0/3465335565 conn(0x7f1c48102030 msgr2=0x7f1c481044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:43.604 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.142+0000 7f1c4fa28700 1 -- 172.21.15.8:0/3465335565 shutdown_connections 2023-12-17T11:55:43.604 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.142+0000 7f1c4fa28700 1 -- 172.21.15.8:0/3465335565 wait complete. 2023-12-17T11:55:43.605 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.143+0000 7f1c4fa28700 1 Processor -- start 2023-12-17T11:55:43.605 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.144+0000 7f1c4fa28700 1 -- start start 2023-12-17T11:55:43.605 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.144+0000 7f1c4fa28700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c48106ad0 0x7f1c4819c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:43.605 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.144+0000 7f1c4fa28700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4819cea0 con 0x7f1c48106ad0 2023-12-17T11:55:43.605 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.144+0000 7f1c4d7c4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c48106ad0 0x7f1c4819c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:43.605 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.144+0000 7f1c4d7c4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c48106ad0 0x7f1c4819c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49944/0 (socket says 172.21.15.8:49944) 2023-12-17T11:55:43.606 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.144+0000 7f1c4d7c4700 1 -- 172.21.15.8:0/34461434 learned_addr learned my addr 172.21.15.8:0/34461434 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:55:43.606 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.144+0000 7f1c4d7c4700 1 -- 172.21.15.8:0/34461434 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c44009550 con 0x7f1c48106ad0 2023-12-17T11:55:43.606 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.145+0000 7f1c4d7c4700 1 --2- 172.21.15.8:0/34461434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c48106ad0 0x7f1c4819c960 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1c44003f20 tx=0x7f1c44011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:43.606 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.145+0000 7f1c3e7fc700 1 -- 172.21.15.8:0/34461434 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c440036a0 con 0x7f1c48106ad0 2023-12-17T11:55:43.606 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.145+0000 7f1c3e7fc700 1 -- 172.21.15.8:0/34461434 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f1c44003c70 con 0x7f1c48106ad0 2023-12-17T11:55:43.606 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.145+0000 7f1c4fa28700 1 -- 172.21.15.8:0/34461434 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c4819d0a0 con 0x7f1c48106ad0 2023-12-17T11:55:43.606 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.145+0000 7f1c3e7fc700 1 -- 172.21.15.8:0/34461434 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1c4401be80 con 0x7f1c48106ad0 2023-12-17T11:55:43.606 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.145+0000 7f1c4fa28700 1 -- 172.21.15.8:0/34461434 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c4819d540 con 0x7f1c48106ad0 2023-12-17T11:55:43.606 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.145+0000 7f1c3e7fc700 1 -- 172.21.15.8:0/34461434 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1c44023790 con 0x7f1c48106ad0 2023-12-17T11:55:43.607 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.146+0000 7f1c3e7fc700 1 -- 172.21.15.8:0/34461434 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f1c4402cd50 con 0x7f1c48106ad0 2023-12-17T11:55:43.607 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.146+0000 7f1c4fa28700 1 -- 172.21.15.8:0/34461434 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c480685a0 con 0x7f1c48106ad0 2023-12-17T11:55:43.607 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.149+0000 7f1c3e7fc700 1 -- 172.21.15.8:0/34461434 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f1c4401b440 con 0x7f1c48106ad0 2023-12-17T11:55:43.607 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.227+0000 7f1c4fa28700 1 -- 172.21.15.8:0/34461434 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f1c4810af00 con 0x7f1c48106ad0 2023-12-17T11:55:43.607 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.227+0000 7f1c3e7fc700 1 -- 172.21.15.8:0/34461434 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f1c44006d60 con 0x7f1c48106ad0 2023-12-17T11:55:43.607 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.228+0000 7f1c4fa28700 1 -- 172.21.15.8:0/34461434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c48106ad0 msgr2=0x7f1c4819c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:43.607 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.228+0000 7f1c4fa28700 1 --2- 172.21.15.8:0/34461434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c48106ad0 0x7f1c4819c960 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1c44003f20 tx=0x7f1c44011f00 comp rx=0 tx=0).stop 2023-12-17T11:55:43.607 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.228+0000 7f1c4fa28700 1 -- 172.21.15.8:0/34461434 shutdown_connections 2023-12-17T11:55:43.607 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.228+0000 7f1c4fa28700 1 --2- 172.21.15.8:0/34461434 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1c48106ad0 0x7f1c4819c960 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:43.607 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.228+0000 7f1c4fa28700 1 -- 172.21.15.8:0/34461434 >> 172.21.15.8:0/34461434 conn(0x7f1c48102030 msgr2=0x7f1c48102b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:43.607 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.228+0000 7f1c4fa28700 1 -- 172.21.15.8:0/34461434 shutdown_connections 2023-12-17T11:55:43.608 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:43.228+0000 7f1c4fa28700 1 -- 172.21.15.8:0/34461434 wait complete. 2023-12-17T11:55:43.608 INFO:teuthology.orchestra.run.smithi008.stdout:mgr not available, waiting (3/15)... 2023-12-17T11:55:43.881 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:43 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:43.617+0000 7fe437cec200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-17T11:55:44.245 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:43 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:43.879+0000 7fe437cec200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-17T11:55:45.428 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:45 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:45.060+0000 7fe437cec200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-17T11:55:45.737 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:45 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:45.426+0000 7fe437cec200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-17T11:55:45.737 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:45 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:45.548+0000 7fe437cec200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-17T11:55:45.995 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:45 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:45.818+0000 7fe437cec200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-17T11:55:45.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:45 smithi008 ceph-mon[36830]: Activating manager daemon x 2023-12-17T11:55:45.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:45 smithi008 ceph-mon[36830]: mgrmap e2: x(active, starting, since 0.00451805s) 2023-12-17T11:55:45.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:45 smithi008 ceph-mon[36830]: from='mgr.14100 172.21.15.8:0/498050547' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-17T11:55:45.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:45 smithi008 ceph-mon[36830]: from='mgr.14100 172.21.15.8:0/498050547' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-17T11:55:45.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:45 smithi008 ceph-mon[36830]: from='mgr.14100 172.21.15.8:0/498050547' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-17T11:55:45.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:45 smithi008 ceph-mon[36830]: from='mgr.14100 172.21.15.8:0/498050547' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-17T11:55:45.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:45 smithi008 ceph-mon[36830]: from='mgr.14100 172.21.15.8:0/498050547' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-12-17T11:55:45.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:45 smithi008 ceph-mon[36830]: Manager daemon x is now available 2023-12-17T11:55:45.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:45 smithi008 ceph-mon[36830]: from='mgr.14100 172.21.15.8:0/498050547' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-12-17T11:55:46.609 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-12-17T11:55:46.609 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout { 2023-12-17T11:55:46.609 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "fsid": "f43f508a-9cd2-11ee-95a5-87774f69a715", 2023-12-17T11:55:46.609 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "health": { 2023-12-17T11:55:46.609 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-17T11:55:46.609 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-17T11:55:46.609 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-17T11:55:46.609 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:55:46.609 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-17T11:55:46.609 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-17T11:55:46.609 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 0 2023-12-17T11:55:46.609 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-12-17T11:55:46.610 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-17T11:55:46.610 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "a" 2023-12-17T11:55:46.610 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-12-17T11:55:46.610 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum_age": 11, 2023-12-17T11:55:46.610 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-17T11:55:46.610 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:55:46.610 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-12-17T11:55:46.610 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-17T11:55:46.610 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:55:46.610 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-17T11:55:46.610 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:55:46.610 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-17T11:55:46.610 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-17T11:55:46.610 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-17T11:55:46.618 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-17T11:55:46.618 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-17T11:55:46.618 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-17T11:55:46.618 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:55:46.619 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-17T11:55:46.619 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-17T11:55:46.619 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-17T11:55:46.619 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-17T11:55:46.619 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-17T11:55:46.619 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-17T11:55:46.619 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-17T11:55:46.619 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-17T11:55:46.619 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-17T11:55:46.619 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:55:46.619 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-17T11:55:46.619 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:55:46.619 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-17T11:55:46.619 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-17T11:55:46.619 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:55:46.620 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-17T11:55:46.620 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "available": false, 2023-12-17T11:55:46.620 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-17T11:55:46.620 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-17T11:55:46.620 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-17T11:55:46.620 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-17T11:55:46.620 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "restful" 2023-12-17T11:55:46.620 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-12-17T11:55:46.620 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-17T11:55:46.620 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:55:46.620 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-17T11:55:46.620 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:55:46.620 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "modified": "2023-12-17T11:55:30.667293+0000", 2023-12-17T11:55:46.620 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-17T11:55:46.620 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:55:46.621 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-17T11:55:46.621 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout } 2023-12-17T11:55:46.621 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.006+0000 7f9d05861700 1 Processor -- start 2023-12-17T11:55:46.621 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.006+0000 7f9d05861700 1 -- start start 2023-12-17T11:55:46.621 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.006+0000 7f9d05861700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d00106ad0 0x7f9d00106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:46.621 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.006+0000 7f9d05861700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d001074c0 con 0x7f9d00106ad0 2023-12-17T11:55:46.621 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.007+0000 7f9cfeffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d00106ad0 0x7f9d00106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:46.621 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.007+0000 7f9cfeffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d00106ad0 0x7f9d00106ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50022/0 (socket says 172.21.15.8:50022) 2023-12-17T11:55:46.621 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.007+0000 7f9cfeffd700 1 -- 172.21.15.8:0/1746934890 learned_addr learned my addr 172.21.15.8:0/1746934890 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:55:46.621 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.007+0000 7f9cfeffd700 1 -- 172.21.15.8:0/1746934890 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d00107cd0 con 0x7f9d00106ad0 2023-12-17T11:55:46.621 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.007+0000 7f9cfeffd700 1 --2- 172.21.15.8:0/1746934890 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d00106ad0 0x7f9d00106ef0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9cf00098a0 tx=0x7f9cf0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bea6443530f9e8b7 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:46.621 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.008+0000 7f9cfdffb700 1 -- 172.21.15.8:0/1746934890 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9cf0004160 con 0x7f9d00106ad0 2023-12-17T11:55:46.622 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.008+0000 7f9cfdffb700 1 -- 172.21.15.8:0/1746934890 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f9cf00042c0 con 0x7f9d00106ad0 2023-12-17T11:55:46.622 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.008+0000 7f9cfdffb700 1 -- 172.21.15.8:0/1746934890 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9cf0011940 con 0x7f9d00106ad0 2023-12-17T11:55:46.622 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.008+0000 7f9d05861700 1 -- 172.21.15.8:0/1746934890 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d00106ad0 msgr2=0x7f9d00106ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:46.622 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.008+0000 7f9d05861700 1 --2- 172.21.15.8:0/1746934890 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d00106ad0 0x7f9d00106ef0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9cf00098a0 tx=0x7f9cf0009bb0 comp rx=0 tx=0).stop 2023-12-17T11:55:46.622 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.008+0000 7f9d05861700 1 -- 172.21.15.8:0/1746934890 shutdown_connections 2023-12-17T11:55:46.622 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.008+0000 7f9d05861700 1 --2- 172.21.15.8:0/1746934890 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d00106ad0 0x7f9d00106ef0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:46.622 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.008+0000 7f9d05861700 1 -- 172.21.15.8:0/1746934890 >> 172.21.15.8:0/1746934890 conn(0x7f9d00102030 msgr2=0x7f9d001044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:46.622 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.008+0000 7f9d05861700 1 -- 172.21.15.8:0/1746934890 shutdown_connections 2023-12-17T11:55:46.622 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.009+0000 7f9d05861700 1 -- 172.21.15.8:0/1746934890 wait complete. 2023-12-17T11:55:46.622 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.009+0000 7f9d05861700 1 Processor -- start 2023-12-17T11:55:46.622 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.010+0000 7f9d05861700 1 -- start start 2023-12-17T11:55:46.622 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.010+0000 7f9d05861700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d00106ad0 0x7f9d0019c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:46.622 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.010+0000 7f9d05861700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0019ceb0 con 0x7f9d00106ad0 2023-12-17T11:55:46.622 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.010+0000 7f9cfeffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d00106ad0 0x7f9d0019c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:46.623 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.010+0000 7f9cfeffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d00106ad0 0x7f9d0019c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50030/0 (socket says 172.21.15.8:50030) 2023-12-17T11:55:46.623 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.010+0000 7f9cfeffd700 1 -- 172.21.15.8:0/312198951 learned_addr learned my addr 172.21.15.8:0/312198951 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:55:46.623 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.010+0000 7f9cfeffd700 1 -- 172.21.15.8:0/312198951 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf0009550 con 0x7f9d00106ad0 2023-12-17T11:55:46.623 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.011+0000 7f9cfeffd700 1 --2- 172.21.15.8:0/312198951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d00106ad0 0x7f9d0019c970 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0003f20 tx=0x7f9cf0011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:46.623 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.011+0000 7f9d0485f700 1 -- 172.21.15.8:0/312198951 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9cf00036a0 con 0x7f9d00106ad0 2023-12-17T11:55:46.623 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.011+0000 7f9d0485f700 1 -- 172.21.15.8:0/312198951 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f9cf0003c70 con 0x7f9d00106ad0 2023-12-17T11:55:46.623 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.011+0000 7f9d0485f700 1 -- 172.21.15.8:0/312198951 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9cf001be80 con 0x7f9d00106ad0 2023-12-17T11:55:46.623 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.011+0000 7f9d05861700 1 -- 172.21.15.8:0/312198951 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d0019d0b0 con 0x7f9d00106ad0 2023-12-17T11:55:46.623 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.011+0000 7f9d05861700 1 -- 172.21.15.8:0/312198951 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d0019d550 con 0x7f9d00106ad0 2023-12-17T11:55:46.623 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.012+0000 7f9d05861700 1 -- 172.21.15.8:0/312198951 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d0010af00 con 0x7f9d00106ad0 2023-12-17T11:55:46.623 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.012+0000 7f9d0485f700 1 -- 172.21.15.8:0/312198951 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 2) v1 ==== 45336+0+0 (secure 0 0 0) 0x7f9cf001b440 con 0x7f9d00106ad0 2023-12-17T11:55:46.623 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.013+0000 7f9d0485f700 1 -- 172.21.15.8:0/312198951 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9cf004c310 con 0x7f9d00106ad0 2023-12-17T11:55:46.623 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.015+0000 7f9d0485f700 1 -- 172.21.15.8:0/312198951 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f9cf001b900 con 0x7f9d00106ad0 2023-12-17T11:55:46.624 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.092+0000 7f9d05861700 1 -- 172.21.15.8:0/312198951 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f9d0019fde0 con 0x7f9d00106ad0 2023-12-17T11:55:46.624 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.092+0000 7f9d0485f700 1 -- 172.21.15.8:0/312198951 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1239 (secure 0 0 0) 0x7f9cf000b3e0 con 0x7f9d00106ad0 2023-12-17T11:55:46.624 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.093+0000 7f9d05861700 1 -- 172.21.15.8:0/312198951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d00106ad0 msgr2=0x7f9d0019c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:46.624 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.093+0000 7f9d05861700 1 --2- 172.21.15.8:0/312198951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d00106ad0 0x7f9d0019c970 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9cf0003f20 tx=0x7f9cf0011f00 comp rx=0 tx=0).stop 2023-12-17T11:55:46.624 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.093+0000 7f9d05861700 1 -- 172.21.15.8:0/312198951 shutdown_connections 2023-12-17T11:55:46.624 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.093+0000 7f9d05861700 1 --2- 172.21.15.8:0/312198951 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d00106ad0 0x7f9d0019c970 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:46.624 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.093+0000 7f9d05861700 1 -- 172.21.15.8:0/312198951 >> 172.21.15.8:0/312198951 conn(0x7f9d00102030 msgr2=0x7f9d00102b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:46.624 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.093+0000 7f9d05861700 1 -- 172.21.15.8:0/312198951 shutdown_connections 2023-12-17T11:55:46.624 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:46.093+0000 7f9d05861700 1 -- 172.21.15.8:0/312198951 wait complete. 2023-12-17T11:55:46.624 INFO:teuthology.orchestra.run.smithi008.stdout:mgr not available, waiting (4/15)... 2023-12-17T11:55:47.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:46 smithi008 ceph-mon[36830]: from='mgr.14100 172.21.15.8:0/498050547' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-12-17T11:55:47.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:46 smithi008 ceph-mon[36830]: from='mgr.14100 172.21.15.8:0/498050547' entity='mgr.x' 2023-12-17T11:55:47.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:46 smithi008 ceph-mon[36830]: from='mgr.14100 172.21.15.8:0/498050547' entity='mgr.x' 2023-12-17T11:55:47.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:46 smithi008 ceph-mon[36830]: from='mgr.14100 172.21.15.8:0/498050547' entity='mgr.x' 2023-12-17T11:55:47.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:46 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/312198951' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-17T11:55:47.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:46 smithi008 ceph-mon[36830]: mgrmap e3: x(active, since 1.00878s) 2023-12-17T11:55:49.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:48 smithi008 ceph-mon[36830]: mgrmap e4: x(active, since 2s) 2023-12-17T11:55:49.670 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-12-17T11:55:49.670 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout { 2023-12-17T11:55:49.670 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "fsid": "f43f508a-9cd2-11ee-95a5-87774f69a715", 2023-12-17T11:55:49.670 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "health": { 2023-12-17T11:55:49.670 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-12-17T11:55:49.670 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-12-17T11:55:49.670 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-12-17T11:55:49.670 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:55:49.670 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-12-17T11:55:49.671 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-12-17T11:55:49.671 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 0 2023-12-17T11:55:49.671 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-12-17T11:55:49.671 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-12-17T11:55:49.671 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "a" 2023-12-17T11:55:49.672 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-12-17T11:55:49.672 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "quorum_age": 14, 2023-12-17T11:55:49.672 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "monmap": { 2023-12-17T11:55:49.672 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:55:49.672 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-12-17T11:55:49.672 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-12-17T11:55:49.673 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:55:49.673 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-12-17T11:55:49.673 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:55:49.673 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-12-17T11:55:49.673 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-12-17T11:55:49.673 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-12-17T11:55:49.673 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-12-17T11:55:49.673 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-12-17T11:55:49.674 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-12-17T11:55:49.674 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:55:49.674 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-12-17T11:55:49.674 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-12-17T11:55:49.674 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-12-17T11:55:49.674 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-12-17T11:55:49.675 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-12-17T11:55:49.675 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-12-17T11:55:49.675 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-12-17T11:55:49.675 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-12-17T11:55:49.675 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-12-17T11:55:49.676 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:55:49.676 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-12-17T11:55:49.676 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:55:49.676 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-12-17T11:55:49.676 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-12-17T11:55:49.676 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:55:49.676 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-12-17T11:55:49.676 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-17T11:55:49.677 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-12-17T11:55:49.677 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "modules": [ 2023-12-17T11:55:49.677 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "iostat", 2023-12-17T11:55:49.677 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "nfs", 2023-12-17T11:55:49.677 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "restful" 2023-12-17T11:55:49.677 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ], 2023-12-17T11:55:49.677 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-17T11:55:49.678 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:55:49.678 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-12-17T11:55:49.678 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-12-17T11:55:49.678 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "modified": "2023-12-17T11:55:30.667293+0000", 2023-12-17T11:55:49.678 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "services": {} 2023-12-17T11:55:49.678 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout }, 2023-12-17T11:55:49.678 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-12-17T11:55:49.678 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout } 2023-12-17T11:55:49.678 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.025+0000 7f4157187700 1 Processor -- start 2023-12-17T11:55:49.678 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.025+0000 7f4157187700 1 -- start start 2023-12-17T11:55:49.679 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.025+0000 7f4157187700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f415007ce60 0x7f415007b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:49.679 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.025+0000 7f4157187700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415007b890 con 0x7f415007ce60 2023-12-17T11:55:49.679 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.025+0000 7f4156185700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f415007ce60 0x7f415007b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:49.679 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.025+0000 7f4156185700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f415007ce60 0x7f415007b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50042/0 (socket says 172.21.15.8:50042) 2023-12-17T11:55:49.679 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.025+0000 7f4156185700 1 -- 172.21.15.8:0/442665360 learned_addr learned my addr 172.21.15.8:0/442665360 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:55:49.679 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.026+0000 7f4156185700 1 -- 172.21.15.8:0/442665360 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f415007b9d0 con 0x7f415007ce60 2023-12-17T11:55:49.679 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.026+0000 7f4156185700 1 --2- 172.21.15.8:0/442665360 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f415007ce60 0x7f415007b2c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f414c0098a0 tx=0x7f414c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69fb3b1731dd8e9a server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:49.679 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.026+0000 7f4155183700 1 -- 172.21.15.8:0/442665360 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f414c004160 con 0x7f415007ce60 2023-12-17T11:55:49.679 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.026+0000 7f4155183700 1 -- 172.21.15.8:0/442665360 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f414c0042c0 con 0x7f415007ce60 2023-12-17T11:55:49.679 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.026+0000 7f4155183700 1 -- 172.21.15.8:0/442665360 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f414c011940 con 0x7f415007ce60 2023-12-17T11:55:49.679 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.027+0000 7f4157187700 1 -- 172.21.15.8:0/442665360 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f415007ce60 msgr2=0x7f415007b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:49.679 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.027+0000 7f4157187700 1 --2- 172.21.15.8:0/442665360 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f415007ce60 0x7f415007b2c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f414c0098a0 tx=0x7f414c009bb0 comp rx=0 tx=0).stop 2023-12-17T11:55:49.679 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.027+0000 7f4157187700 1 -- 172.21.15.8:0/442665360 shutdown_connections 2023-12-17T11:55:49.679 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.027+0000 7f4157187700 1 --2- 172.21.15.8:0/442665360 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f415007ce60 0x7f415007b2c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:49.680 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.027+0000 7f4157187700 1 -- 172.21.15.8:0/442665360 >> 172.21.15.8:0/442665360 conn(0x7f4150101ea0 msgr2=0x7f41501042e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:49.680 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.027+0000 7f4157187700 1 -- 172.21.15.8:0/442665360 shutdown_connections 2023-12-17T11:55:49.680 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.027+0000 7f4157187700 1 -- 172.21.15.8:0/442665360 wait complete. 2023-12-17T11:55:49.680 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.028+0000 7f4157187700 1 Processor -- start 2023-12-17T11:55:49.680 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.028+0000 7f4157187700 1 -- start start 2023-12-17T11:55:49.680 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.029+0000 7f4157187700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f415007ce60 0x7f415019c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:49.680 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.029+0000 7f4157187700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f415019cc80 con 0x7f415007ce60 2023-12-17T11:55:49.680 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.029+0000 7f4156185700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f415007ce60 0x7f415019c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:49.680 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.029+0000 7f4156185700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f415007ce60 0x7f415019c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50058/0 (socket says 172.21.15.8:50058) 2023-12-17T11:55:49.680 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.029+0000 7f4156185700 1 -- 172.21.15.8:0/3030801986 learned_addr learned my addr 172.21.15.8:0/3030801986 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:55:49.680 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.029+0000 7f4156185700 1 -- 172.21.15.8:0/3030801986 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414c009550 con 0x7f415007ce60 2023-12-17T11:55:49.680 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.029+0000 7f4156185700 1 --2- 172.21.15.8:0/3030801986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f415007ce60 0x7f415019c740 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f414c003f20 tx=0x7f414c011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:49.680 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.030+0000 7f41477fe700 1 -- 172.21.15.8:0/3030801986 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f414c0037d0 con 0x7f415007ce60 2023-12-17T11:55:49.681 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.030+0000 7f41477fe700 1 -- 172.21.15.8:0/3030801986 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f414c01b440 con 0x7f415007ce60 2023-12-17T11:55:49.681 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.030+0000 7f4157187700 1 -- 172.21.15.8:0/3030801986 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f415019ce80 con 0x7f415007ce60 2023-12-17T11:55:49.681 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.030+0000 7f41477fe700 1 -- 172.21.15.8:0/3030801986 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f414c023590 con 0x7f415007ce60 2023-12-17T11:55:49.681 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.030+0000 7f4157187700 1 -- 172.21.15.8:0/3030801986 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f415019d320 con 0x7f415007ce60 2023-12-17T11:55:49.681 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.031+0000 7f4157187700 1 -- 172.21.15.8:0/3030801986 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f415010cc90 con 0x7f415007ce60 2023-12-17T11:55:49.681 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.031+0000 7f41477fe700 1 -- 172.21.15.8:0/3030801986 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 45569+0+0 (secure 0 0 0) 0x7f414c01b5b0 con 0x7f415007ce60 2023-12-17T11:55:49.681 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.032+0000 7f41477fe700 1 --2- 172.21.15.8:0/3030801986 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7f413c038820 0x7f413c03ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:49.681 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.032+0000 7f41477fe700 1 -- 172.21.15.8:0/3030801986 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f414c04c770 con 0x7f415007ce60 2023-12-17T11:55:49.681 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.032+0000 7f4155984700 1 --2- 172.21.15.8:0/3030801986 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7f413c038820 0x7f413c03ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:49.681 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.032+0000 7f4155984700 1 --2- 172.21.15.8:0/3030801986 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7f413c038820 0x7f413c03ace0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4140006fd0 tx=0x7f4140006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:49.681 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.037+0000 7f41477fe700 1 -- 172.21.15.8:0/3030801986 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f414c01b920 con 0x7f415007ce60 2023-12-17T11:55:49.681 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.325+0000 7f4157187700 1 -- 172.21.15.8:0/3030801986 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f415010ced0 con 0x7f415007ce60 2023-12-17T11:55:49.681 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.325+0000 7f41477fe700 1 -- 172.21.15.8:0/3030801986 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f414c016260 con 0x7f415007ce60 2023-12-17T11:55:49.681 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.327+0000 7f4157187700 1 -- 172.21.15.8:0/3030801986 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7f413c038820 msgr2=0x7f413c03ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:49.681 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.327+0000 7f4157187700 1 --2- 172.21.15.8:0/3030801986 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7f413c038820 0x7f413c03ace0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f4140006fd0 tx=0x7f4140006e40 comp rx=0 tx=0).stop 2023-12-17T11:55:49.682 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.328+0000 7f4157187700 1 -- 172.21.15.8:0/3030801986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f415007ce60 msgr2=0x7f415019c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:49.682 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.328+0000 7f4157187700 1 --2- 172.21.15.8:0/3030801986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f415007ce60 0x7f415019c740 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f414c003f20 tx=0x7f414c011f00 comp rx=0 tx=0).stop 2023-12-17T11:55:49.682 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.328+0000 7f4157187700 1 -- 172.21.15.8:0/3030801986 shutdown_connections 2023-12-17T11:55:49.682 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.328+0000 7f4157187700 1 --2- 172.21.15.8:0/3030801986 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7f413c038820 0x7f413c03ace0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:49.682 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.328+0000 7f4157187700 1 --2- 172.21.15.8:0/3030801986 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f415007ce60 0x7f415019c740 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:49.682 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.328+0000 7f4157187700 1 -- 172.21.15.8:0/3030801986 >> 172.21.15.8:0/3030801986 conn(0x7f4150101ea0 msgr2=0x7f4150102a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:49.682 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.328+0000 7f4157187700 1 -- 172.21.15.8:0/3030801986 shutdown_connections 2023-12-17T11:55:49.682 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:49.328+0000 7f4157187700 1 -- 172.21.15.8:0/3030801986 wait complete. 2023-12-17T11:55:49.682 INFO:teuthology.orchestra.run.smithi008.stdout:mgr is available 2023-12-17T11:55:49.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:49 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/3030801986' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-12-17T11:55:50.642 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-12-17T11:55:50.643 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout [global] 2023-12-17T11:55:50.643 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout fsid = f43f508a-9cd2-11ee-95a5-87774f69a715 2023-12-17T11:55:50.643 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-12-17T11:55:50.643 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-12-17T11:55:50.643 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-12-17T11:55:50.643 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-12-17T11:55:50.643 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-12-17T11:55:50.643 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout [mgr] 2023-12-17T11:55:50.643 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-12-17T11:55:50.643 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 2023-12-17T11:55:50.643 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout [osd] 2023-12-17T11:55:50.643 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-12-17T11:55:50.643 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-12-17T11:55:50.643 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-12-17T11:55:50.644 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-12-17T11:55:50.644 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-12-17T11:55:50.644 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.067+0000 7f0f5759e700 1 Processor -- start 2023-12-17T11:55:50.644 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.067+0000 7f0f5759e700 1 -- start start 2023-12-17T11:55:50.644 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.067+0000 7f0f5759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f5807ce60 0x7f0f5807b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:50.644 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.067+0000 7f0f5759e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5807b890 con 0x7f0f5807ce60 2023-12-17T11:55:50.644 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.067+0000 7f0f5659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f5807ce60 0x7f0f5807b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:50.644 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.067+0000 7f0f5659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f5807ce60 0x7f0f5807b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50062/0 (socket says 172.21.15.8:50062) 2023-12-17T11:55:50.644 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.067+0000 7f0f5659c700 1 -- 172.21.15.8:0/476362164 learned_addr learned my addr 172.21.15.8:0/476362164 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:55:50.644 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.068+0000 7f0f5659c700 1 -- 172.21.15.8:0/476362164 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5807b9d0 con 0x7f0f5807ce60 2023-12-17T11:55:50.644 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.068+0000 7f0f5659c700 1 --2- 172.21.15.8:0/476362164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f5807ce60 0x7f0f5807b2c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0f480098a0 tx=0x7f0f48009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0808e788e143eb1 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:50.644 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.068+0000 7f0f5559a700 1 -- 172.21.15.8:0/476362164 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0f48004160 con 0x7f0f5807ce60 2023-12-17T11:55:50.644 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.068+0000 7f0f5559a700 1 -- 172.21.15.8:0/476362164 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f0f480042c0 con 0x7f0f5807ce60 2023-12-17T11:55:50.644 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.068+0000 7f0f5559a700 1 -- 172.21.15.8:0/476362164 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0f48011940 con 0x7f0f5807ce60 2023-12-17T11:55:50.644 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.069+0000 7f0f5759e700 1 -- 172.21.15.8:0/476362164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f5807ce60 msgr2=0x7f0f5807b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:50.645 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.069+0000 7f0f5759e700 1 --2- 172.21.15.8:0/476362164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f5807ce60 0x7f0f5807b2c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0f480098a0 tx=0x7f0f48009bb0 comp rx=0 tx=0).stop 2023-12-17T11:55:50.645 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.069+0000 7f0f5759e700 1 -- 172.21.15.8:0/476362164 shutdown_connections 2023-12-17T11:55:50.645 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.069+0000 7f0f5759e700 1 --2- 172.21.15.8:0/476362164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f5807ce60 0x7f0f5807b2c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:50.645 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.069+0000 7f0f5759e700 1 -- 172.21.15.8:0/476362164 >> 172.21.15.8:0/476362164 conn(0x7f0f58101ea0 msgr2=0x7f0f581042e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:50.645 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.069+0000 7f0f5759e700 1 -- 172.21.15.8:0/476362164 shutdown_connections 2023-12-17T11:55:50.645 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.069+0000 7f0f5759e700 1 -- 172.21.15.8:0/476362164 wait complete. 2023-12-17T11:55:50.645 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.070+0000 7f0f5759e700 1 Processor -- start 2023-12-17T11:55:50.645 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.070+0000 7f0f5759e700 1 -- start start 2023-12-17T11:55:50.645 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.071+0000 7f0f5759e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f5807ce60 0x7f0f5819c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:50.645 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.071+0000 7f0f5759e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f5819cc80 con 0x7f0f5807ce60 2023-12-17T11:55:50.645 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.071+0000 7f0f5659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f5807ce60 0x7f0f5819c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:50.645 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.071+0000 7f0f5659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f5807ce60 0x7f0f5819c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50064/0 (socket says 172.21.15.8:50064) 2023-12-17T11:55:50.645 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.071+0000 7f0f5659c700 1 -- 172.21.15.8:0/2312117110 learned_addr learned my addr 172.21.15.8:0/2312117110 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:55:50.645 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.071+0000 7f0f5659c700 1 -- 172.21.15.8:0/2312117110 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f48009550 con 0x7f0f5807ce60 2023-12-17T11:55:50.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.071+0000 7f0f5659c700 1 --2- 172.21.15.8:0/2312117110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f5807ce60 0x7f0f5819c740 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0f48003f20 tx=0x7f0f48011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:50.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.072+0000 7f0f477fe700 1 -- 172.21.15.8:0/2312117110 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0f480037d0 con 0x7f0f5807ce60 2023-12-17T11:55:50.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.072+0000 7f0f477fe700 1 -- 172.21.15.8:0/2312117110 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f0f4801b440 con 0x7f0f5807ce60 2023-12-17T11:55:50.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.072+0000 7f0f477fe700 1 -- 172.21.15.8:0/2312117110 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0f48023590 con 0x7f0f5807ce60 2023-12-17T11:55:50.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.072+0000 7f0f5759e700 1 -- 172.21.15.8:0/2312117110 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f5819ce80 con 0x7f0f5807ce60 2023-12-17T11:55:50.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.072+0000 7f0f5759e700 1 -- 172.21.15.8:0/2312117110 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f5819d320 con 0x7f0f5807ce60 2023-12-17T11:55:50.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.073+0000 7f0f477fe700 1 -- 172.21.15.8:0/2312117110 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 45569+0+0 (secure 0 0 0) 0x7f0f4801b5b0 con 0x7f0f5807ce60 2023-12-17T11:55:50.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.073+0000 7f0f5759e700 1 -- 172.21.15.8:0/2312117110 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f5810cc90 con 0x7f0f5807ce60 2023-12-17T11:55:50.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.073+0000 7f0f477fe700 1 --2- 172.21.15.8:0/2312117110 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7f0f40038820 0x7f0f4003ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:50.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.073+0000 7f0f477fe700 1 -- 172.21.15.8:0/2312117110 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0f4804c770 con 0x7f0f5807ce60 2023-12-17T11:55:50.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.074+0000 7f0f55d9b700 1 --2- 172.21.15.8:0/2312117110 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7f0f40038820 0x7f0f4003ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:50.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.074+0000 7f0f55d9b700 1 --2- 172.21.15.8:0/2312117110 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7f0f40038820 0x7f0f4003ace0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c006fd0 tx=0x7f0f4c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:50.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.078+0000 7f0f477fe700 1 -- 172.21.15.8:0/2312117110 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f0f4801b920 con 0x7f0f5807ce60 2023-12-17T11:55:50.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.289+0000 7f0f5759e700 1 -- 172.21.15.8:0/2312117110 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f0f5810ced0 con 0x7f0f5807ce60 2023-12-17T11:55:50.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.290+0000 7f0f477fe700 1 -- 172.21.15.8:0/2312117110 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f0f48016260 con 0x7f0f5807ce60 2023-12-17T11:55:50.647 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.292+0000 7f0f5759e700 1 -- 172.21.15.8:0/2312117110 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7f0f40038820 msgr2=0x7f0f4003ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:50.647 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.292+0000 7f0f5759e700 1 --2- 172.21.15.8:0/2312117110 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7f0f40038820 0x7f0f4003ace0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c006fd0 tx=0x7f0f4c006e40 comp rx=0 tx=0).stop 2023-12-17T11:55:50.647 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.292+0000 7f0f5759e700 1 -- 172.21.15.8:0/2312117110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f5807ce60 msgr2=0x7f0f5819c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:50.647 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.292+0000 7f0f5759e700 1 --2- 172.21.15.8:0/2312117110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f5807ce60 0x7f0f5819c740 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f0f48003f20 tx=0x7f0f48011f00 comp rx=0 tx=0).stop 2023-12-17T11:55:50.647 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.292+0000 7f0f5759e700 1 -- 172.21.15.8:0/2312117110 shutdown_connections 2023-12-17T11:55:50.647 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.292+0000 7f0f5759e700 1 --2- 172.21.15.8:0/2312117110 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7f0f40038820 0x7f0f4003ace0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:50.647 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.292+0000 7f0f5759e700 1 --2- 172.21.15.8:0/2312117110 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0f5807ce60 0x7f0f5819c740 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:50.647 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.292+0000 7f0f5759e700 1 -- 172.21.15.8:0/2312117110 >> 172.21.15.8:0/2312117110 conn(0x7f0f58101ea0 msgr2=0x7f0f58102a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:50.647 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.293+0000 7f0f5759e700 1 -- 172.21.15.8:0/2312117110 shutdown_connections 2023-12-17T11:55:50.647 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:50.293+0000 7f0f5759e700 1 -- 172.21.15.8:0/2312117110 wait complete. 2023-12-17T11:55:50.647 INFO:teuthology.orchestra.run.smithi008.stdout:Enabling cephadm module... 2023-12-17T11:55:50.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:50 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/2312117110' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-12-17T11:55:52.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:51 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/291411250' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-12-17T11:55:52.246 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:51 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: ignoring --setuser ceph since I am not root 2023-12-17T11:55:52.246 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:51 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: ignoring --setgroup ceph since I am not root 2023-12-17T11:55:52.337 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.033+0000 7fc9c2d1e700 1 Processor -- start 2023-12-17T11:55:52.343 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.034+0000 7fc9c2d1e700 1 -- start start 2023-12-17T11:55:52.343 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.034+0000 7fc9c2d1e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9bc07ce60 0x7fc9bc07b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:52.343 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.034+0000 7fc9c2d1e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc07b890 con 0x7fc9bc07ce60 2023-12-17T11:55:52.343 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.034+0000 7fc9c0aba700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9bc07ce60 0x7fc9bc07b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:52.343 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.034+0000 7fc9c0aba700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9bc07ce60 0x7fc9bc07b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54760/0 (socket says 172.21.15.8:54760) 2023-12-17T11:55:52.343 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.034+0000 7fc9c0aba700 1 -- 172.21.15.8:0/3596039090 learned_addr learned my addr 172.21.15.8:0/3596039090 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:55:52.343 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.035+0000 7fc9c0aba700 1 -- 172.21.15.8:0/3596039090 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9bc07b9d0 con 0x7fc9bc07ce60 2023-12-17T11:55:52.343 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.035+0000 7fc9c0aba700 1 --2- 172.21.15.8:0/3596039090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9bc07ce60 0x7fc9bc07b2c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc9b00098a0 tx=0x7fc9b0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5000e9a397d38c6c server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:52.343 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.035+0000 7fc9bb7fe700 1 -- 172.21.15.8:0/3596039090 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc9b0004160 con 0x7fc9bc07ce60 2023-12-17T11:55:52.343 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.035+0000 7fc9bb7fe700 1 -- 172.21.15.8:0/3596039090 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fc9b00042c0 con 0x7fc9bc07ce60 2023-12-17T11:55:52.343 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.035+0000 7fc9bb7fe700 1 -- 172.21.15.8:0/3596039090 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc9b0011940 con 0x7fc9bc07ce60 2023-12-17T11:55:52.344 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.036+0000 7fc9c2d1e700 1 -- 172.21.15.8:0/3596039090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9bc07ce60 msgr2=0x7fc9bc07b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:52.344 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.036+0000 7fc9c2d1e700 1 --2- 172.21.15.8:0/3596039090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9bc07ce60 0x7fc9bc07b2c0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc9b00098a0 tx=0x7fc9b0009bb0 comp rx=0 tx=0).stop 2023-12-17T11:55:52.344 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.036+0000 7fc9c2d1e700 1 -- 172.21.15.8:0/3596039090 shutdown_connections 2023-12-17T11:55:52.344 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.036+0000 7fc9c2d1e700 1 --2- 172.21.15.8:0/3596039090 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9bc07ce60 0x7fc9bc07b2c0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:52.344 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.036+0000 7fc9c2d1e700 1 -- 172.21.15.8:0/3596039090 >> 172.21.15.8:0/3596039090 conn(0x7fc9bc102030 msgr2=0x7fc9bc1044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:52.344 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.036+0000 7fc9c2d1e700 1 -- 172.21.15.8:0/3596039090 shutdown_connections 2023-12-17T11:55:52.344 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.036+0000 7fc9c2d1e700 1 -- 172.21.15.8:0/3596039090 wait complete. 2023-12-17T11:55:52.344 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.037+0000 7fc9c2d1e700 1 Processor -- start 2023-12-17T11:55:52.344 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.038+0000 7fc9c2d1e700 1 -- start start 2023-12-17T11:55:52.344 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.038+0000 7fc9c2d1e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9bc07ce60 0x7fc9bc19c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:52.344 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.038+0000 7fc9c2d1e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9bc19cef0 con 0x7fc9bc07ce60 2023-12-17T11:55:52.344 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.038+0000 7fc9c0aba700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9bc07ce60 0x7fc9bc19c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:52.344 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.038+0000 7fc9c0aba700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9bc07ce60 0x7fc9bc19c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54770/0 (socket says 172.21.15.8:54770) 2023-12-17T11:55:52.344 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.038+0000 7fc9c0aba700 1 -- 172.21.15.8:0/291411250 learned_addr learned my addr 172.21.15.8:0/291411250 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:55:52.344 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.039+0000 7fc9c0aba700 1 -- 172.21.15.8:0/291411250 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b0009550 con 0x7fc9bc07ce60 2023-12-17T11:55:52.345 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.039+0000 7fc9c0aba700 1 --2- 172.21.15.8:0/291411250 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9bc07ce60 0x7fc9bc19c9b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0003f20 tx=0x7fc9b0011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:52.345 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.039+0000 7fc9b9ffb700 1 -- 172.21.15.8:0/291411250 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc9b00037d0 con 0x7fc9bc07ce60 2023-12-17T11:55:52.345 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.039+0000 7fc9b9ffb700 1 -- 172.21.15.8:0/291411250 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fc9b001b440 con 0x7fc9bc07ce60 2023-12-17T11:55:52.345 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.039+0000 7fc9c2d1e700 1 -- 172.21.15.8:0/291411250 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9bc19d0f0 con 0x7fc9bc07ce60 2023-12-17T11:55:52.345 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.039+0000 7fc9b9ffb700 1 -- 172.21.15.8:0/291411250 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc9b0023590 con 0x7fc9bc07ce60 2023-12-17T11:55:52.345 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.039+0000 7fc9c2d1e700 1 -- 172.21.15.8:0/291411250 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9bc19d590 con 0x7fc9bc07ce60 2023-12-17T11:55:52.345 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.040+0000 7fc9b9ffb700 1 -- 172.21.15.8:0/291411250 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 4) v1 ==== 45569+0+0 (secure 0 0 0) 0x7fc9b0003930 con 0x7fc9bc07ce60 2023-12-17T11:55:52.345 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.040+0000 7fc9c2d1e700 1 -- 172.21.15.8:0/291411250 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9bc10ce60 con 0x7fc9bc07ce60 2023-12-17T11:55:52.345 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.041+0000 7fc9b9ffb700 1 --2- 172.21.15.8:0/291411250 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7fc9ac038820 0x7fc9ac03ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:52.345 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.041+0000 7fc9b9ffb700 1 -- 172.21.15.8:0/291411250 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fc9b004c700 con 0x7fc9bc07ce60 2023-12-17T11:55:52.345 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.041+0000 7fc9bbfff700 1 --2- 172.21.15.8:0/291411250 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7fc9ac038820 0x7fc9ac03ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:52.345 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.042+0000 7fc9bbfff700 1 --2- 172.21.15.8:0/291411250 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7fc9ac038820 0x7fc9ac03ace0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8006fd0 tx=0x7fc9a8006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:52.345 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.046+0000 7fc9b9ffb700 1 -- 172.21.15.8:0/291411250 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fc9b000bbd0 con 0x7fc9bc07ce60 2023-12-17T11:55:52.345 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.312+0000 7fc9c2d1e700 1 -- 172.21.15.8:0/291411250 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fc9bc10d0a0 con 0x7fc9bc07ce60 2023-12-17T11:55:52.345 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.869+0000 7fc9b9ffb700 1 -- 172.21.15.8:0/291411250 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fc9b0016260 con 0x7fc9bc07ce60 2023-12-17T11:55:52.346 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.870+0000 7fc9b9ffb700 1 -- 172.21.15.8:0/291411250 <== mon.0 v2:172.21.15.8:3300/0 8 ==== mgrmap(e 5) v1 ==== 45580+0+0 (secure 0 0 0) 0x7fc9b000fdb0 con 0x7fc9bc07ce60 2023-12-17T11:55:52.346 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.873+0000 7fc9c2d1e700 1 -- 172.21.15.8:0/291411250 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7fc9ac038820 msgr2=0x7fc9ac03ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:52.346 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.873+0000 7fc9c2d1e700 1 --2- 172.21.15.8:0/291411250 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7fc9ac038820 0x7fc9ac03ace0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fc9a8006fd0 tx=0x7fc9a8006e40 comp rx=0 tx=0).stop 2023-12-17T11:55:52.346 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.873+0000 7fc9c2d1e700 1 -- 172.21.15.8:0/291411250 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9bc07ce60 msgr2=0x7fc9bc19c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:52.346 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.873+0000 7fc9c2d1e700 1 --2- 172.21.15.8:0/291411250 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9bc07ce60 0x7fc9bc19c9b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc9b0003f20 tx=0x7fc9b0011f00 comp rx=0 tx=0).stop 2023-12-17T11:55:52.346 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.873+0000 7fc9c2d1e700 1 -- 172.21.15.8:0/291411250 shutdown_connections 2023-12-17T11:55:52.346 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.873+0000 7fc9c2d1e700 1 --2- 172.21.15.8:0/291411250 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7fc9ac038820 0x7fc9ac03ace0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:52.346 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.873+0000 7fc9c2d1e700 1 --2- 172.21.15.8:0/291411250 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc9bc07ce60 0x7fc9bc19c9b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:52.346 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.873+0000 7fc9c2d1e700 1 -- 172.21.15.8:0/291411250 >> 172.21.15.8:0/291411250 conn(0x7fc9bc102030 msgr2=0x7fc9bc102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:52.346 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.873+0000 7fc9c2d1e700 1 -- 172.21.15.8:0/291411250 shutdown_connections 2023-12-17T11:55:52.346 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:51.873+0000 7fc9c2d1e700 1 -- 172.21.15.8:0/291411250 wait complete. 2023-12-17T11:55:52.612 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:52 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:52.480+0000 7f6db8cdf200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-17T11:55:52.871 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:52 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:52.610+0000 7f6db8cdf200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-17T11:55:52.871 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:52 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:52.730+0000 7f6db8cdf200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-17T11:55:52.871 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:52 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:52.849+0000 7f6db8cdf200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-17T11:55:53.242 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:52 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/291411250' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-12-17T11:55:53.242 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:52 smithi008 ceph-mon[36830]: mgrmap e5: x(active, since 6s) 2023-12-17T11:55:53.394 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout { 2023-12-17T11:55:53.394 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-12-17T11:55:53.394 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-17T11:55:53.394 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-12-17T11:55:53.395 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-12-17T11:55:53.395 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout } 2023-12-17T11:55:53.395 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.778+0000 7f9b9f151700 1 Processor -- start 2023-12-17T11:55:53.395 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.778+0000 7f9b9f151700 1 -- start start 2023-12-17T11:55:53.395 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.778+0000 7f9b9f151700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b98106ae0 0x7f9b98106f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:53.395 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.778+0000 7f9b9f151700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b981074d0 con 0x7f9b98106ae0 2023-12-17T11:55:53.395 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.779+0000 7f9b9ceed700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b98106ae0 0x7f9b98106f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:53.395 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.779+0000 7f9b9ceed700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b98106ae0 0x7f9b98106f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54796/0 (socket says 172.21.15.8:54796) 2023-12-17T11:55:53.395 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.779+0000 7f9b9ceed700 1 -- 172.21.15.8:0/882082563 learned_addr learned my addr 172.21.15.8:0/882082563 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:55:53.395 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.779+0000 7f9b9ceed700 1 -- 172.21.15.8:0/882082563 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b98107ce0 con 0x7f9b98106ae0 2023-12-17T11:55:53.395 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.779+0000 7f9b9ceed700 1 --2- 172.21.15.8:0/882082563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b98106ae0 0x7f9b98106f00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0098a0 tx=0x7f9b8c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba8572a4b4405f36 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:53.395 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.780+0000 7f9b977fe700 1 -- 172.21.15.8:0/882082563 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9b8c004160 con 0x7f9b98106ae0 2023-12-17T11:55:53.395 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.780+0000 7f9b977fe700 1 -- 172.21.15.8:0/882082563 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f9b8c0042c0 con 0x7f9b98106ae0 2023-12-17T11:55:53.395 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.780+0000 7f9b977fe700 1 -- 172.21.15.8:0/882082563 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9b8c011940 con 0x7f9b98106ae0 2023-12-17T11:55:53.395 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.780+0000 7f9b9f151700 1 -- 172.21.15.8:0/882082563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b98106ae0 msgr2=0x7f9b98106f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:53.396 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.780+0000 7f9b9f151700 1 --2- 172.21.15.8:0/882082563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b98106ae0 0x7f9b98106f00 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0098a0 tx=0x7f9b8c009bb0 comp rx=0 tx=0).stop 2023-12-17T11:55:53.396 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.780+0000 7f9b9f151700 1 -- 172.21.15.8:0/882082563 shutdown_connections 2023-12-17T11:55:53.396 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.780+0000 7f9b9f151700 1 --2- 172.21.15.8:0/882082563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b98106ae0 0x7f9b98106f00 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:53.396 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.780+0000 7f9b9f151700 1 -- 172.21.15.8:0/882082563 >> 172.21.15.8:0/882082563 conn(0x7f9b98102080 msgr2=0x7f9b981044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:53.396 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.781+0000 7f9b9f151700 1 -- 172.21.15.8:0/882082563 shutdown_connections 2023-12-17T11:55:53.396 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.781+0000 7f9b9f151700 1 -- 172.21.15.8:0/882082563 wait complete. 2023-12-17T11:55:53.396 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.782+0000 7f9b9f151700 1 Processor -- start 2023-12-17T11:55:53.397 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.782+0000 7f9b9f151700 1 -- start start 2023-12-17T11:55:53.397 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.782+0000 7f9b9f151700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b98106ae0 0x7f9b9819c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:53.397 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.782+0000 7f9b9f151700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b9819cec0 con 0x7f9b98106ae0 2023-12-17T11:55:53.397 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.782+0000 7f9b9ceed700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b98106ae0 0x7f9b9819c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:55:53.397 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.782+0000 7f9b9ceed700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b98106ae0 0x7f9b9819c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54798/0 (socket says 172.21.15.8:54798) 2023-12-17T11:55:53.397 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.782+0000 7f9b9ceed700 1 -- 172.21.15.8:0/993491167 learned_addr learned my addr 172.21.15.8:0/993491167 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:55:53.397 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.783+0000 7f9b9ceed700 1 -- 172.21.15.8:0/993491167 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8c009550 con 0x7f9b98106ae0 2023-12-17T11:55:53.397 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.783+0000 7f9b9ceed700 1 --2- 172.21.15.8:0/993491167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b98106ae0 0x7f9b9819c980 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c003f20 tx=0x7f9b8c011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:55:53.397 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.783+0000 7f9b95ffb700 1 -- 172.21.15.8:0/993491167 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9b8c0036a0 con 0x7f9b98106ae0 2023-12-17T11:55:53.397 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.783+0000 7f9b95ffb700 1 -- 172.21.15.8:0/993491167 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f9b8c003c70 con 0x7f9b98106ae0 2023-12-17T11:55:53.397 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.783+0000 7f9b95ffb700 1 -- 172.21.15.8:0/993491167 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9b8c01be80 con 0x7f9b98106ae0 2023-12-17T11:55:53.397 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.783+0000 7f9b9f151700 1 -- 172.21.15.8:0/993491167 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b9819d0c0 con 0x7f9b98106ae0 2023-12-17T11:55:53.398 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.783+0000 7f9b9f151700 1 -- 172.21.15.8:0/993491167 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b9819d560 con 0x7f9b98106ae0 2023-12-17T11:55:53.398 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.784+0000 7f9b95ffb700 1 -- 172.21.15.8:0/993491167 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 45580+0+0 (secure 0 0 0) 0x7f9b8c003800 con 0x7f9b98106ae0 2023-12-17T11:55:53.398 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.784+0000 7f9b9f151700 1 -- 172.21.15.8:0/993491167 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b9810af10 con 0x7f9b98106ae0 2023-12-17T11:55:53.398 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.785+0000 7f9b95ffb700 1 --2- 172.21.15.8:0/993491167 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7f9b880388c0 0x7f9b8803ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:55:53.398 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.785+0000 7f9b95ffb700 1 -- 172.21.15.8:0/993491167 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9b8c04c710 con 0x7f9b98106ae0 2023-12-17T11:55:53.398 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.785+0000 7f9b97fff700 1 -- 172.21.15.8:0/993491167 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7f9b880388c0 msgr2=0x7f9b8803ad80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/4187398661 2023-12-17T11:55:53.398 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.785+0000 7f9b97fff700 1 --2- 172.21.15.8:0/993491167 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7f9b880388c0 0x7f9b8803ad80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-17T11:55:53.398 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.790+0000 7f9b95ffb700 1 -- 172.21.15.8:0/993491167 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f9b8c00b5c0 con 0x7f9b98106ae0 2023-12-17T11:55:53.398 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.986+0000 7f9b97fff700 1 -- 172.21.15.8:0/993491167 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7f9b880388c0 msgr2=0x7f9b8803ad80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/4187398661 2023-12-17T11:55:53.398 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:52.986+0000 7f9b97fff700 1 --2- 172.21.15.8:0/993491167 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7f9b880388c0 0x7f9b8803ad80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-17T11:55:53.398 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.058+0000 7f9b9f151700 1 -- 172.21.15.8:0/993491167 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f9b9819fdf0 con 0x7f9b98106ae0 2023-12-17T11:55:53.398 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.058+0000 7f9b95ffb700 1 -- 172.21.15.8:0/993491167 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7f9b8c00b3e0 con 0x7f9b98106ae0 2023-12-17T11:55:53.398 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.061+0000 7f9b9f151700 1 -- 172.21.15.8:0/993491167 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7f9b880388c0 msgr2=0x7f9b8803ad80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-17T11:55:53.399 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.061+0000 7f9b9f151700 1 --2- 172.21.15.8:0/993491167 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7f9b880388c0 0x7f9b8803ad80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:53.399 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.061+0000 7f9b9f151700 1 -- 172.21.15.8:0/993491167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b98106ae0 msgr2=0x7f9b9819c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:55:53.399 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.061+0000 7f9b9f151700 1 --2- 172.21.15.8:0/993491167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b98106ae0 0x7f9b9819c980 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c003f20 tx=0x7f9b8c011f00 comp rx=0 tx=0).stop 2023-12-17T11:55:53.399 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.061+0000 7f9b9f151700 1 -- 172.21.15.8:0/993491167 shutdown_connections 2023-12-17T11:55:53.399 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.061+0000 7f9b9f151700 1 --2- 172.21.15.8:0/993491167 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7f9b880388c0 0x7f9b8803ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:53.399 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.061+0000 7f9b9f151700 1 --2- 172.21.15.8:0/993491167 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9b98106ae0 0x7f9b9819c980 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:55:53.399 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.061+0000 7f9b9f151700 1 -- 172.21.15.8:0/993491167 >> 172.21.15.8:0/993491167 conn(0x7f9b98102080 msgr2=0x7f9b98102ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:55:53.399 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.061+0000 7f9b9f151700 1 -- 172.21.15.8:0/993491167 shutdown_connections 2023-12-17T11:55:53.399 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.061+0000 7f9b9f151700 1 -- 172.21.15.8:0/993491167 wait complete. 2023-12-17T11:55:53.399 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for the mgr to restart... 2023-12-17T11:55:53.400 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for mgr epoch 5... 2023-12-17T11:55:53.872 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:53 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:53.716+0000 7f6db8cdf200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-17T11:55:54.147 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:55:53 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/993491167' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-12-17T11:55:54.147 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:54 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:54.030+0000 7f6db8cdf200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-17T11:55:54.491 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:54 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:54.145+0000 7f6db8cdf200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-17T11:55:54.491 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:54 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:54.289+0000 7f6db8cdf200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-17T11:55:54.745 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:54 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:54.489+0000 7f6db8cdf200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-17T11:55:54.745 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:54 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:54.665+0000 7f6db8cdf200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-17T11:55:55.245 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:54 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:54.782+0000 7f6db8cdf200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-17T11:55:55.631 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:55 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:55.269+0000 7f6db8cdf200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-17T11:55:55.995 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:55 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:55.629+0000 7f6db8cdf200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-17T11:55:56.495 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:55 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:55.996+0000 7f6db8cdf200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-17T11:55:56.495 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:56 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:56.123+0000 7f6db8cdf200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-17T11:55:57.444 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:57 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:57.113+0000 7f6db8cdf200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-17T11:55:57.444 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:57 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:57.241+0000 7f6db8cdf200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-17T11:55:57.745 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:57 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:57.442+0000 7f6db8cdf200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-17T11:55:58.745 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:58 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:58.290+0000 7f6db8cdf200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-17T11:55:58.745 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:58 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:58.536+0000 7f6db8cdf200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-17T11:55:59.245 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:58 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:58.799+0000 7f6db8cdf200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-17T11:56:00.245 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:55:59 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:55:59.976+0000 7f6db8cdf200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-17T11:56:00.731 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:00 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:56:00.345+0000 7f6db8cdf200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-17T11:56:00.731 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:00 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:56:00.466+0000 7f6db8cdf200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-17T11:56:00.995 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:00 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:56:00.729+0000 7f6db8cdf200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-17T11:56:00.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:00 smithi008 ceph-mon[36830]: Active manager daemon x restarted 2023-12-17T11:56:00.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:00 smithi008 ceph-mon[36830]: Activating manager daemon x 2023-12-17T11:56:00.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:00 smithi008 ceph-mon[36830]: osdmap e2: 0 total, 0 up, 0 in 2023-12-17T11:56:00.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:00 smithi008 ceph-mon[36830]: mgrmap e6: x(active, starting, since 0.00370164s) 2023-12-17T11:56:00.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:00 smithi008 ceph-mon[36830]: from='mgr.14122 172.21.15.8:0/1995514219' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-17T11:56:00.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:00 smithi008 ceph-mon[36830]: from='mgr.14122 172.21.15.8:0/1995514219' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-12-17T11:56:00.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:00 smithi008 ceph-mon[36830]: from='mgr.14122 172.21.15.8:0/1995514219' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-17T11:56:00.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:00 smithi008 ceph-mon[36830]: from='mgr.14122 172.21.15.8:0/1995514219' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-17T11:56:00.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:00 smithi008 ceph-mon[36830]: from='mgr.14122 172.21.15.8:0/1995514219' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-17T11:56:00.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:00 smithi008 ceph-mon[36830]: Manager daemon x is now available 2023-12-17T11:56:00.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:00 smithi008 ceph-mon[36830]: from='mgr.14122 172.21.15.8:0/1995514219' entity='mgr.x' 2023-12-17T11:56:00.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:00 smithi008 ceph-mon[36830]: from='mgr.14122 172.21.15.8:0/1995514219' entity='mgr.x' 2023-12-17T11:56:00.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:00 smithi008 ceph-mon[36830]: from='mgr.14122 172.21.15.8:0/1995514219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:56:00.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:00 smithi008 ceph-mon[36830]: from='mgr.14122 172.21.15.8:0/1995514219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:56:00.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:00 smithi008 ceph-mon[36830]: from='mgr.14122 172.21.15.8:0/1995514219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:56:00.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:00 smithi008 ceph-mon[36830]: from='mgr.14122 172.21.15.8:0/1995514219' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-12-17T11:56:00.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:00 smithi008 ceph-mon[36830]: from='mgr.14122 172.21.15.8:0/1995514219' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-12-17T11:56:02.116 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout { 2023-12-17T11:56:02.116 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-12-17T11:56:02.116 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "initialized": true 2023-12-17T11:56:02.116 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout } 2023-12-17T11:56:02.116 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.826+0000 7feac5225700 1 Processor -- start 2023-12-17T11:56:02.116 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.826+0000 7feac5225700 1 -- start start 2023-12-17T11:56:02.117 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:01 smithi008 ceph-mon[36830]: Found migration_current of "None". Setting to last migration. 2023-12-17T11:56:02.117 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:01 smithi008 ceph-mon[36830]: from='mgr.14122 172.21.15.8:0/1995514219' entity='mgr.x' 2023-12-17T11:56:02.117 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:01 smithi008 ceph-mon[36830]: from='mgr.14122 172.21.15.8:0/1995514219' entity='mgr.x' 2023-12-17T11:56:02.117 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:01 smithi008 ceph-mon[36830]: mgrmap e7: x(active, since 1.00698s) 2023-12-17T11:56:02.125 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.827+0000 7feac5225700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feac007ce60 0x7feac007b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:02.125 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.827+0000 7feac5225700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac007b890 con 0x7feac007ce60 2023-12-17T11:56:02.125 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.827+0000 7feabed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feac007ce60 0x7feac007b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:02.125 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.827+0000 7feabed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feac007ce60 0x7feac007b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54804/0 (socket says 172.21.15.8:54804) 2023-12-17T11:56:02.125 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.827+0000 7feabed9d700 1 -- 172.21.15.8:0/154869590 learned_addr learned my addr 172.21.15.8:0/154869590 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:02.125 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.828+0000 7feabed9d700 1 -- 172.21.15.8:0/154869590 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac007b9d0 con 0x7feac007ce60 2023-12-17T11:56:02.125 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.828+0000 7feabed9d700 1 --2- 172.21.15.8:0/154869590 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feac007ce60 0x7feac007b2c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7feab00098a0 tx=0x7feab0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c2b0374c735545f server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:02.125 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.828+0000 7feabdd9b700 1 -- 172.21.15.8:0/154869590 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feab0004160 con 0x7feac007ce60 2023-12-17T11:56:02.125 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.828+0000 7feabdd9b700 1 -- 172.21.15.8:0/154869590 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7feab00042c0 con 0x7feac007ce60 2023-12-17T11:56:02.125 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.828+0000 7feabdd9b700 1 -- 172.21.15.8:0/154869590 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feab0011940 con 0x7feac007ce60 2023-12-17T11:56:02.125 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.829+0000 7feac5225700 1 -- 172.21.15.8:0/154869590 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feac007ce60 msgr2=0x7feac007b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:02.125 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.829+0000 7feac5225700 1 --2- 172.21.15.8:0/154869590 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feac007ce60 0x7feac007b2c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7feab00098a0 tx=0x7feab0009bb0 comp rx=0 tx=0).stop 2023-12-17T11:56:02.126 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.829+0000 7feac5225700 1 -- 172.21.15.8:0/154869590 shutdown_connections 2023-12-17T11:56:02.126 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.829+0000 7feac5225700 1 --2- 172.21.15.8:0/154869590 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feac007ce60 0x7feac007b2c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:02.126 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.829+0000 7feac5225700 1 -- 172.21.15.8:0/154869590 >> 172.21.15.8:0/154869590 conn(0x7feac0102030 msgr2=0x7feac01044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:02.126 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.829+0000 7feac5225700 1 -- 172.21.15.8:0/154869590 shutdown_connections 2023-12-17T11:56:02.126 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.829+0000 7feac5225700 1 -- 172.21.15.8:0/154869590 wait complete. 2023-12-17T11:56:02.126 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.830+0000 7feac5225700 1 Processor -- start 2023-12-17T11:56:02.126 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.830+0000 7feac5225700 1 -- start start 2023-12-17T11:56:02.126 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.830+0000 7feac5225700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feac007ce60 0x7feac019c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:02.126 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.830+0000 7feac5225700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feac019cef0 con 0x7feac007ce60 2023-12-17T11:56:02.126 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.831+0000 7feabed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feac007ce60 0x7feac019c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:02.126 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.831+0000 7feabed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feac007ce60 0x7feac019c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:54812/0 (socket says 172.21.15.8:54812) 2023-12-17T11:56:02.126 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.831+0000 7feabed9d700 1 -- 172.21.15.8:0/1395251901 learned_addr learned my addr 172.21.15.8:0/1395251901 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:02.126 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.831+0000 7feabed9d700 1 -- 172.21.15.8:0/1395251901 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab0009550 con 0x7feac007ce60 2023-12-17T11:56:02.126 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.831+0000 7feabed9d700 1 --2- 172.21.15.8:0/1395251901 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feac007ce60 0x7feac019c9b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7feab0003f20 tx=0x7feab0011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:02.127 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.832+0000 7feaa7fff700 1 -- 172.21.15.8:0/1395251901 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feab00037d0 con 0x7feac007ce60 2023-12-17T11:56:02.127 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.832+0000 7feaa7fff700 1 -- 172.21.15.8:0/1395251901 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7feab001b440 con 0x7feac007ce60 2023-12-17T11:56:02.127 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.832+0000 7feac5225700 1 -- 172.21.15.8:0/1395251901 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feac019d0f0 con 0x7feac007ce60 2023-12-17T11:56:02.127 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.832+0000 7feaa7fff700 1 -- 172.21.15.8:0/1395251901 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7feab0023590 con 0x7feac007ce60 2023-12-17T11:56:02.127 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.832+0000 7feac5225700 1 -- 172.21.15.8:0/1395251901 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feac019d590 con 0x7feac007ce60 2023-12-17T11:56:02.127 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.833+0000 7feaa7fff700 1 -- 172.21.15.8:0/1395251901 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 5) v1 ==== 45580+0+0 (secure 0 0 0) 0x7feab0003930 con 0x7feac007ce60 2023-12-17T11:56:02.127 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.833+0000 7feaa7fff700 1 --2- 172.21.15.8:0/1395251901 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7feaa8038870 0x7feaa803ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:02.127 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.833+0000 7feaa7fff700 1 -- 172.21.15.8:0/1395251901 --> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7feaa803b440 con 0x7feaa8038870 2023-12-17T11:56:02.127 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.833+0000 7feaa7fff700 1 -- 172.21.15.8:0/1395251901 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7feab004c740 con 0x7feac007ce60 2023-12-17T11:56:02.127 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.834+0000 7feabe59c700 1 -- 172.21.15.8:0/1395251901 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7feaa8038870 msgr2=0x7feaa803ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/4187398661 2023-12-17T11:56:02.127 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:53.834+0000 7feabe59c700 1 --2- 172.21.15.8:0/1395251901 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7feaa8038870 0x7feaa803ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-17T11:56:02.127 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:54.035+0000 7feabe59c700 1 -- 172.21.15.8:0/1395251901 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7feaa8038870 msgr2=0x7feaa803ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/4187398661 2023-12-17T11:56:02.127 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:54.035+0000 7feabe59c700 1 --2- 172.21.15.8:0/1395251901 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7feaa8038870 0x7feaa803ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-17T11:56:02.128 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:54.436+0000 7feabe59c700 1 -- 172.21.15.8:0/1395251901 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7feaa8038870 msgr2=0x7feaa803ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/4187398661 2023-12-17T11:56:02.128 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:54.436+0000 7feabe59c700 1 --2- 172.21.15.8:0/1395251901 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7feaa8038870 0x7feaa803ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-17T11:56:02.128 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:55.237+0000 7feabe59c700 1 -- 172.21.15.8:0/1395251901 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7feaa8038870 msgr2=0x7feaa803ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/4187398661 2023-12-17T11:56:02.128 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:55.237+0000 7feabe59c700 1 --2- 172.21.15.8:0/1395251901 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7feaa8038870 0x7feaa803ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-17T11:56:02.128 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:56.838+0000 7feabe59c700 1 -- 172.21.15.8:0/1395251901 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7feaa8038870 msgr2=0x7feaa803ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/4187398661 2023-12-17T11:56:02.128 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:55:56.839+0000 7feabe59c700 1 --2- 172.21.15.8:0/1395251901 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7feaa8038870 0x7feaa803ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-17T11:56:02.128 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:00.042+0000 7feabe59c700 1 -- 172.21.15.8:0/1395251901 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7feaa8038870 msgr2=0x7feaa803ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/4187398661 2023-12-17T11:56:02.128 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:00.042+0000 7feabe59c700 1 --2- 172.21.15.8:0/1395251901 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7feaa8038870 0x7feaa803ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2023-12-17T11:56:02.128 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:00.733+0000 7feaa7fff700 1 -- 172.21.15.8:0/1395251901 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mgrmap(e 6) v1 ==== 45347+0+0 (secure 0 0 0) 0x7feab000fdb0 con 0x7feac007ce60 2023-12-17T11:56:02.128 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:00.733+0000 7feaa7fff700 1 -- 172.21.15.8:0/1395251901 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7feaa8038870 msgr2=0x7feaa803ad30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-17T11:56:02.128 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:00.733+0000 7feaa7fff700 1 --2- 172.21.15.8:0/1395251901 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7feaa8038870 0x7feaa803ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:02.128 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:01.735+0000 7feaa7fff700 1 -- 172.21.15.8:0/1395251901 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mgrmap(e 7) v1 ==== 45474+0+0 (secure 0 0 0) 0x7feab004ddd0 con 0x7feac007ce60 2023-12-17T11:56:02.128 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:01.736+0000 7feaa7fff700 1 --2- 172.21.15.8:0/1395251901 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7feaa803bfd0 0x7feaa803e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:02.128 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:01.736+0000 7feaa7fff700 1 -- 172.21.15.8:0/1395251901 --> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7feaa803b440 con 0x7feaa803bfd0 2023-12-17T11:56:02.129 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:01.736+0000 7feabe59c700 1 --2- 172.21.15.8:0/1395251901 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7feaa803bfd0 0x7feaa803e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:02.129 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:01.737+0000 7feabe59c700 1 --2- 172.21.15.8:0/1395251901 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7feaa803bfd0 0x7feaa803e3c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7feab4003a10 tx=0x7feab40092b0 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:02.129 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:01.738+0000 7feaa7fff700 1 -- 172.21.15.8:0/1395251901 <== mgr.14122 v2:172.21.15.8:6800/222068650 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7feaa803b440 con 0x7feaa803bfd0 2023-12-17T11:56:02.129 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:01.745+0000 7feac5225700 1 -- 172.21.15.8:0/1395251901 --> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7feac010ce60 con 0x7feaa803bfd0 2023-12-17T11:56:02.129 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:01.746+0000 7feaa7fff700 1 -- 172.21.15.8:0/1395251901 <== mgr.14122 v2:172.21.15.8:6800/222068650 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7feac010ce60 con 0x7feaa803bfd0 2023-12-17T11:56:02.129 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:01.746+0000 7feac5225700 1 -- 172.21.15.8:0/1395251901 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7feaa803bfd0 msgr2=0x7feaa803e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:02.129 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:01.746+0000 7feac5225700 1 --2- 172.21.15.8:0/1395251901 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7feaa803bfd0 0x7feaa803e3c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7feab4003a10 tx=0x7feab40092b0 comp rx=0 tx=0).stop 2023-12-17T11:56:02.129 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:01.746+0000 7feac5225700 1 -- 172.21.15.8:0/1395251901 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feac007ce60 msgr2=0x7feac019c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:02.129 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:01.746+0000 7feac5225700 1 --2- 172.21.15.8:0/1395251901 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feac007ce60 0x7feac019c9b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7feab0003f20 tx=0x7feab0011f00 comp rx=0 tx=0).stop 2023-12-17T11:56:02.129 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:01.746+0000 7feac5225700 1 -- 172.21.15.8:0/1395251901 shutdown_connections 2023-12-17T11:56:02.129 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:01.746+0000 7feac5225700 1 --2- 172.21.15.8:0/1395251901 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7feaa803bfd0 0x7feaa803e3c0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:02.129 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:01.746+0000 7feac5225700 1 --2- 172.21.15.8:0/1395251901 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feac007ce60 0x7feac019c9b0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:02.129 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:01.746+0000 7feac5225700 1 --2- 172.21.15.8:0/1395251901 >> [v2:172.21.15.8:6800/4187398661,v1:172.21.15.8:6801/4187398661] conn(0x7feaa8038870 0x7feaa803ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:02.129 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:01.746+0000 7feac5225700 1 -- 172.21.15.8:0/1395251901 >> 172.21.15.8:0/1395251901 conn(0x7feac0102030 msgr2=0x7feac0102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:02.130 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:01.746+0000 7feac5225700 1 -- 172.21.15.8:0/1395251901 shutdown_connections 2023-12-17T11:56:02.130 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:01.746+0000 7feac5225700 1 -- 172.21.15.8:0/1395251901 wait complete. 2023-12-17T11:56:02.130 INFO:teuthology.orchestra.run.smithi008.stdout:mgr epoch 5 is available 2023-12-17T11:56:02.130 INFO:teuthology.orchestra.run.smithi008.stdout:Setting orchestrator backend to cephadm... 2023-12-17T11:56:03.141 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.542+0000 7effd9969700 1 Processor -- start 2023-12-17T11:56:03.141 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.542+0000 7effd9969700 1 -- start start 2023-12-17T11:56:03.141 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.542+0000 7effd9969700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd407cea0 0x7effd407b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:03.141 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.542+0000 7effd9969700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd407b8d0 con 0x7effd407cea0 2023-12-17T11:56:03.142 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:02 smithi008 ceph-mon[36830]: from='client.14126 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-12-17T11:56:03.142 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:02 smithi008 ceph-mon[36830]: from='client.14126 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-12-17T11:56:03.142 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:02 smithi008 ceph-mon[36830]: [17/Dec/2023:11:56:01] ENGINE Bus STARTING 2023-12-17T11:56:03.142 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:02 smithi008 ceph-mon[36830]: from='mgr.14122 172.21.15.8:0/1995514219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:56:03.142 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:02 smithi008 ceph-mon[36830]: from='mgr.14122 172.21.15.8:0/1995514219' entity='mgr.x' 2023-12-17T11:56:03.142 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:02 smithi008 ceph-mon[36830]: from='mgr.14122 172.21.15.8:0/1995514219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:56:03.147 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.543+0000 7effd8967700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd407cea0 0x7effd407b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:03.147 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.543+0000 7effd8967700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd407cea0 0x7effd407b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51768/0 (socket says 172.21.15.8:51768) 2023-12-17T11:56:03.147 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.543+0000 7effd8967700 1 -- 172.21.15.8:0/1267981371 learned_addr learned my addr 172.21.15.8:0/1267981371 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:03.147 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.543+0000 7effd8967700 1 -- 172.21.15.8:0/1267981371 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effd407ba10 con 0x7effd407cea0 2023-12-17T11:56:03.147 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.543+0000 7effd8967700 1 --2- 172.21.15.8:0/1267981371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd407cea0 0x7effd407b300 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7effc80098a0 tx=0x7effc8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c463bb33cf36b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:03.147 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.544+0000 7effd37fe700 1 -- 172.21.15.8:0/1267981371 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7effc8004160 con 0x7effd407cea0 2023-12-17T11:56:03.147 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.544+0000 7effd37fe700 1 -- 172.21.15.8:0/1267981371 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7effc80042c0 con 0x7effd407cea0 2023-12-17T11:56:03.148 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.544+0000 7effd37fe700 1 -- 172.21.15.8:0/1267981371 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7effc8011940 con 0x7effd407cea0 2023-12-17T11:56:03.148 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.544+0000 7effd9969700 1 -- 172.21.15.8:0/1267981371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd407cea0 msgr2=0x7effd407b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:03.148 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.544+0000 7effd9969700 1 --2- 172.21.15.8:0/1267981371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd407cea0 0x7effd407b300 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7effc80098a0 tx=0x7effc8009bb0 comp rx=0 tx=0).stop 2023-12-17T11:56:03.148 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.544+0000 7effd9969700 1 -- 172.21.15.8:0/1267981371 shutdown_connections 2023-12-17T11:56:03.148 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.544+0000 7effd9969700 1 --2- 172.21.15.8:0/1267981371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd407cea0 0x7effd407b300 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:03.148 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.544+0000 7effd9969700 1 -- 172.21.15.8:0/1267981371 >> 172.21.15.8:0/1267981371 conn(0x7effd4101ea0 msgr2=0x7effd41042e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:03.148 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.544+0000 7effd9969700 1 -- 172.21.15.8:0/1267981371 shutdown_connections 2023-12-17T11:56:03.148 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.544+0000 7effd9969700 1 -- 172.21.15.8:0/1267981371 wait complete. 2023-12-17T11:56:03.148 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.546+0000 7effd9969700 1 Processor -- start 2023-12-17T11:56:03.148 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.546+0000 7effd9969700 1 -- start start 2023-12-17T11:56:03.148 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.546+0000 7effd9969700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd407cea0 0x7effd419c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:03.148 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.546+0000 7effd9969700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effd419cc90 con 0x7effd407cea0 2023-12-17T11:56:03.148 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.547+0000 7effd8967700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd407cea0 0x7effd419c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:03.148 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.547+0000 7effd8967700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd407cea0 0x7effd419c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51778/0 (socket says 172.21.15.8:51778) 2023-12-17T11:56:03.148 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.547+0000 7effd8967700 1 -- 172.21.15.8:0/1751706160 learned_addr learned my addr 172.21.15.8:0/1751706160 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:03.149 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.547+0000 7effd8967700 1 -- 172.21.15.8:0/1751706160 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc8009550 con 0x7effd407cea0 2023-12-17T11:56:03.149 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.547+0000 7effd8967700 1 --2- 172.21.15.8:0/1751706160 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd407cea0 0x7effd419c750 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7effc8006af0 tx=0x7effc8011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:03.149 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.547+0000 7effd1ffb700 1 -- 172.21.15.8:0/1751706160 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7effc8003bf0 con 0x7effd407cea0 2023-12-17T11:56:03.149 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.548+0000 7effd1ffb700 1 -- 172.21.15.8:0/1751706160 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7effc801b8b0 con 0x7effd407cea0 2023-12-17T11:56:03.149 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.548+0000 7effd9969700 1 -- 172.21.15.8:0/1751706160 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effd419ce90 con 0x7effd407cea0 2023-12-17T11:56:03.149 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.548+0000 7effd1ffb700 1 -- 172.21.15.8:0/1751706160 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7effc80237f0 con 0x7effd407cea0 2023-12-17T11:56:03.149 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.548+0000 7effd9969700 1 -- 172.21.15.8:0/1751706160 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effd419d330 con 0x7effd407cea0 2023-12-17T11:56:03.149 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.549+0000 7effd1ffb700 1 -- 172.21.15.8:0/1751706160 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 7) v1 ==== 45474+0+0 (secure 0 0 0) 0x7effc801ba20 con 0x7effd407cea0 2023-12-17T11:56:03.149 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.549+0000 7effd9969700 1 -- 172.21.15.8:0/1751706160 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effd410cc50 con 0x7effd407cea0 2023-12-17T11:56:03.149 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.549+0000 7effd1ffb700 1 --2- 172.21.15.8:0/1751706160 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7effc40386b0 0x7effc403ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:03.149 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.549+0000 7effd1ffb700 1 -- 172.21.15.8:0/1751706160 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7effc804cbf0 con 0x7effd407cea0 2023-12-17T11:56:03.149 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.549+0000 7effd3fff700 1 --2- 172.21.15.8:0/1751706160 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7effc40386b0 0x7effc403ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:03.149 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.550+0000 7effd3fff700 1 --2- 172.21.15.8:0/1751706160 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7effc40386b0 0x7effc403ab70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7effc0006fd0 tx=0x7effc0006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:03.149 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.555+0000 7effd1ffb700 1 -- 172.21.15.8:0/1751706160 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7effc802b530 con 0x7effd407cea0 2023-12-17T11:56:03.150 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.780+0000 7effd9969700 1 -- 172.21.15.8:0/1751706160 --> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7effd4103130 con 0x7effc40386b0 2023-12-17T11:56:03.150 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.787+0000 7effd1ffb700 1 -- 172.21.15.8:0/1751706160 <== mgr.14122 v2:172.21.15.8:6800/222068650 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7effd4103130 con 0x7effc40386b0 2023-12-17T11:56:03.150 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.789+0000 7effd9969700 1 -- 172.21.15.8:0/1751706160 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7effc40386b0 msgr2=0x7effc403ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:03.150 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.789+0000 7effd9969700 1 --2- 172.21.15.8:0/1751706160 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7effc40386b0 0x7effc403ab70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7effc0006fd0 tx=0x7effc0006e40 comp rx=0 tx=0).stop 2023-12-17T11:56:03.150 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.789+0000 7effd9969700 1 -- 172.21.15.8:0/1751706160 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd407cea0 msgr2=0x7effd419c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:03.150 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.789+0000 7effd9969700 1 --2- 172.21.15.8:0/1751706160 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd407cea0 0x7effd419c750 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7effc8006af0 tx=0x7effc8011a50 comp rx=0 tx=0).stop 2023-12-17T11:56:03.150 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.789+0000 7effd9969700 1 -- 172.21.15.8:0/1751706160 shutdown_connections 2023-12-17T11:56:03.150 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.789+0000 7effd9969700 1 --2- 172.21.15.8:0/1751706160 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7effc40386b0 0x7effc403ab70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:03.150 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.789+0000 7effd9969700 1 --2- 172.21.15.8:0/1751706160 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7effd407cea0 0x7effd419c750 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:03.150 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.789+0000 7effd9969700 1 -- 172.21.15.8:0/1751706160 >> 172.21.15.8:0/1751706160 conn(0x7effd4101ea0 msgr2=0x7effd4102a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:03.150 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.790+0000 7effd9969700 1 -- 172.21.15.8:0/1751706160 shutdown_connections 2023-12-17T11:56:03.150 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:02.790+0000 7effd9969700 1 -- 172.21.15.8:0/1751706160 wait complete. 2023-12-17T11:56:04.110 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:03 smithi008 ceph-mon[36830]: [17/Dec/2023:11:56:02] ENGINE Serving on http://172.21.15.8:8765 2023-12-17T11:56:04.110 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:03 smithi008 ceph-mon[36830]: [17/Dec/2023:11:56:02] ENGINE Serving on https://172.21.15.8:7150 2023-12-17T11:56:04.111 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:03 smithi008 ceph-mon[36830]: [17/Dec/2023:11:56:02] ENGINE Bus STARTED 2023-12-17T11:56:04.111 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:03 smithi008 ceph-mon[36830]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:56:04.111 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:03 smithi008 ceph-mon[36830]: mgrmap e8: x(active, since 2s) 2023-12-17T11:56:04.116 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout value unchanged 2023-12-17T11:56:04.116 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.548+0000 7f4aa8a25700 1 Processor -- start 2023-12-17T11:56:04.116 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.548+0000 7f4aa8a25700 1 -- start start 2023-12-17T11:56:04.116 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.548+0000 7f4aa8a25700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aa4106ad0 0x7f4aa4106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:04.116 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.548+0000 7f4aa8a25700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa41074c0 con 0x7f4aa4106ad0 2023-12-17T11:56:04.116 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.549+0000 7f4aa259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aa4106ad0 0x7f4aa4106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:04.116 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.549+0000 7f4aa259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aa4106ad0 0x7f4aa4106ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51786/0 (socket says 172.21.15.8:51786) 2023-12-17T11:56:04.116 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.549+0000 7f4aa259c700 1 -- 172.21.15.8:0/1997344704 learned_addr learned my addr 172.21.15.8:0/1997344704 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:04.116 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.549+0000 7f4aa259c700 1 -- 172.21.15.8:0/1997344704 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa4107cd0 con 0x7f4aa4106ad0 2023-12-17T11:56:04.117 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.549+0000 7f4aa259c700 1 --2- 172.21.15.8:0/1997344704 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aa4106ad0 0x7f4aa4106ef0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4a940098a0 tx=0x7f4a94009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb27c7f3f500d2e server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:04.117 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.550+0000 7f4aa159a700 1 -- 172.21.15.8:0/1997344704 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a94004160 con 0x7f4aa4106ad0 2023-12-17T11:56:04.117 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.550+0000 7f4aa159a700 1 -- 172.21.15.8:0/1997344704 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f4a940042c0 con 0x7f4aa4106ad0 2023-12-17T11:56:04.117 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.550+0000 7f4aa159a700 1 -- 172.21.15.8:0/1997344704 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a94011940 con 0x7f4aa4106ad0 2023-12-17T11:56:04.117 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.550+0000 7f4aa8a25700 1 -- 172.21.15.8:0/1997344704 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aa4106ad0 msgr2=0x7f4aa4106ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:04.117 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.550+0000 7f4aa8a25700 1 --2- 172.21.15.8:0/1997344704 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aa4106ad0 0x7f4aa4106ef0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4a940098a0 tx=0x7f4a94009bb0 comp rx=0 tx=0).stop 2023-12-17T11:56:04.117 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.550+0000 7f4aa8a25700 1 -- 172.21.15.8:0/1997344704 shutdown_connections 2023-12-17T11:56:04.117 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.550+0000 7f4aa8a25700 1 --2- 172.21.15.8:0/1997344704 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aa4106ad0 0x7f4aa4106ef0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:04.117 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.550+0000 7f4aa8a25700 1 -- 172.21.15.8:0/1997344704 >> 172.21.15.8:0/1997344704 conn(0x7f4aa4102030 msgr2=0x7f4aa41044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:04.117 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.550+0000 7f4aa8a25700 1 -- 172.21.15.8:0/1997344704 shutdown_connections 2023-12-17T11:56:04.117 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.550+0000 7f4aa8a25700 1 -- 172.21.15.8:0/1997344704 wait complete. 2023-12-17T11:56:04.117 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.551+0000 7f4aa8a25700 1 Processor -- start 2023-12-17T11:56:04.117 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.552+0000 7f4aa8a25700 1 -- start start 2023-12-17T11:56:04.118 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.552+0000 7f4aa8a25700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aa4106ad0 0x7f4aa419a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:04.118 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.552+0000 7f4aa8a25700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa419acc0 con 0x7f4aa4106ad0 2023-12-17T11:56:04.118 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.552+0000 7f4aa259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aa4106ad0 0x7f4aa419a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:04.118 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.552+0000 7f4aa259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aa4106ad0 0x7f4aa419a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51802/0 (socket says 172.21.15.8:51802) 2023-12-17T11:56:04.118 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.552+0000 7f4aa259c700 1 -- 172.21.15.8:0/572054091 learned_addr learned my addr 172.21.15.8:0/572054091 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:04.118 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.552+0000 7f4aa259c700 1 -- 172.21.15.8:0/572054091 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a94009550 con 0x7f4aa4106ad0 2023-12-17T11:56:04.118 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.553+0000 7f4aa259c700 1 --2- 172.21.15.8:0/572054091 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aa4106ad0 0x7f4aa419a780 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4a94003f20 tx=0x7f4a94011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:04.118 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.553+0000 7f4a937fe700 1 -- 172.21.15.8:0/572054091 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a940036a0 con 0x7f4aa4106ad0 2023-12-17T11:56:04.118 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.553+0000 7f4a937fe700 1 -- 172.21.15.8:0/572054091 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f4a94003c70 con 0x7f4aa4106ad0 2023-12-17T11:56:04.118 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.553+0000 7f4a937fe700 1 -- 172.21.15.8:0/572054091 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4a9401be80 con 0x7f4aa4106ad0 2023-12-17T11:56:04.118 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.553+0000 7f4aa8a25700 1 -- 172.21.15.8:0/572054091 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aa419aec0 con 0x7f4aa4106ad0 2023-12-17T11:56:04.118 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.553+0000 7f4aa8a25700 1 -- 172.21.15.8:0/572054091 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa419b360 con 0x7f4aa4106ad0 2023-12-17T11:56:04.118 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.554+0000 7f4a937fe700 1 -- 172.21.15.8:0/572054091 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 45580+0+0 (secure 0 0 0) 0x7f4a9401b440 con 0x7f4aa4106ad0 2023-12-17T11:56:04.118 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.554+0000 7f4aa8a25700 1 -- 172.21.15.8:0/572054091 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aa410af00 con 0x7f4aa4106ad0 2023-12-17T11:56:04.118 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.555+0000 7f4a937fe700 1 --2- 172.21.15.8:0/572054091 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f4a8c038870 0x7f4a8c03ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:04.119 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.555+0000 7f4a937fe700 1 -- 172.21.15.8:0/572054091 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f4a9404c7d0 con 0x7f4aa4106ad0 2023-12-17T11:56:04.119 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.555+0000 7f4aa1d9b700 1 --2- 172.21.15.8:0/572054091 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f4a8c038870 0x7f4a8c03ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:04.119 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.555+0000 7f4aa1d9b700 1 --2- 172.21.15.8:0/572054091 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f4a8c038870 0x7f4a8c03ad30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4a98006fd0 tx=0x7f4a98006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:04.119 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.560+0000 7f4a937fe700 1 -- 172.21.15.8:0/572054091 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4a9401b720 con 0x7f4aa4106ad0 2023-12-17T11:56:04.119 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.773+0000 7f4aa8a25700 1 -- 172.21.15.8:0/572054091 --> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f4aa419dbf0 con 0x7f4a8c038870 2023-12-17T11:56:04.119 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.774+0000 7f4a937fe700 1 -- 172.21.15.8:0/572054091 <== mgr.14122 v2:172.21.15.8:6800/222068650 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f4aa419dbf0 con 0x7f4a8c038870 2023-12-17T11:56:04.119 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.776+0000 7f4aa8a25700 1 -- 172.21.15.8:0/572054091 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f4a8c038870 msgr2=0x7f4a8c03ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:04.119 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.776+0000 7f4aa8a25700 1 --2- 172.21.15.8:0/572054091 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f4a8c038870 0x7f4a8c03ad30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4a98006fd0 tx=0x7f4a98006e40 comp rx=0 tx=0).stop 2023-12-17T11:56:04.119 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.776+0000 7f4aa8a25700 1 -- 172.21.15.8:0/572054091 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aa4106ad0 msgr2=0x7f4aa419a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:04.119 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.776+0000 7f4aa8a25700 1 --2- 172.21.15.8:0/572054091 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aa4106ad0 0x7f4aa419a780 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4a94003f20 tx=0x7f4a94011f00 comp rx=0 tx=0).stop 2023-12-17T11:56:04.119 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.776+0000 7f4aa8a25700 1 -- 172.21.15.8:0/572054091 shutdown_connections 2023-12-17T11:56:04.119 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.776+0000 7f4aa8a25700 1 --2- 172.21.15.8:0/572054091 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f4a8c038870 0x7f4a8c03ad30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:04.119 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.776+0000 7f4aa8a25700 1 --2- 172.21.15.8:0/572054091 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4aa4106ad0 0x7f4aa419a780 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:04.119 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.776+0000 7f4aa8a25700 1 -- 172.21.15.8:0/572054091 >> 172.21.15.8:0/572054091 conn(0x7f4aa4102030 msgr2=0x7f4aa4102c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:04.120 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.776+0000 7f4aa8a25700 1 -- 172.21.15.8:0/572054091 shutdown_connections 2023-12-17T11:56:04.120 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:03.776+0000 7f4aa8a25700 1 -- 172.21.15.8:0/572054091 wait complete. 2023-12-17T11:56:04.120 INFO:teuthology.orchestra.run.smithi008.stdout:Generating ssh key... 2023-12-17T11:56:05.208 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:04 smithi008 ceph-mon[36830]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:56:05.208 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:04 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: Generating public/private rsa key pair. 2023-12-17T11:56:05.208 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:04 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: Your identification has been saved in /tmp/tmpho_3_b78/key. 2023-12-17T11:56:05.208 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:04 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: Your public key has been saved in /tmp/tmpho_3_b78/key.pub. 2023-12-17T11:56:05.208 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:04 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: The key fingerprint is: 2023-12-17T11:56:05.208 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:04 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: SHA256:U9Nt7/QLUyxMjhz6EQTDTguHpRwigcuG549+ImT8oCA ceph-f43f508a-9cd2-11ee-95a5-87774f69a715 2023-12-17T11:56:05.209 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:04 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: The key's randomart image is: 2023-12-17T11:56:05.209 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:04 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: +---[RSA 3072]----+ 2023-12-17T11:56:05.209 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:04 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: | .o.. .++.. | 2023-12-17T11:56:05.209 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:04 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: | . . ooo+o. . | 2023-12-17T11:56:05.209 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:04 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: |o . o= +o..o | 2023-12-17T11:56:05.209 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:04 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: |.+. +o.B... | 2023-12-17T11:56:05.209 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:04 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: |oo S. + + oo| 2023-12-17T11:56:05.209 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:04 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: |E=. .. . oo.| 2023-12-17T11:56:05.209 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:04 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: |* oo . o o| 2023-12-17T11:56:05.209 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:04 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: |o o.o o .| 2023-12-17T11:56:05.209 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:04 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: | o.o . | 2023-12-17T11:56:05.209 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:04 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: +----[SHA256]-----+ 2023-12-17T11:56:05.235 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.530+0000 7f01655fc700 1 Processor -- start 2023-12-17T11:56:05.235 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.530+0000 7f01655fc700 1 -- start start 2023-12-17T11:56:05.235 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.530+0000 7f01655fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f016007cea0 0x7f016007b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:05.235 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.530+0000 7f01655fc700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016007b8d0 con 0x7f016007cea0 2023-12-17T11:56:05.235 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.530+0000 7f015effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f016007cea0 0x7f016007b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:05.236 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.531+0000 7f015effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f016007cea0 0x7f016007b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51814/0 (socket says 172.21.15.8:51814) 2023-12-17T11:56:05.236 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.531+0000 7f015effd700 1 -- 172.21.15.8:0/2007538798 learned_addr learned my addr 172.21.15.8:0/2007538798 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:05.236 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.531+0000 7f015effd700 1 -- 172.21.15.8:0/2007538798 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f016007ba10 con 0x7f016007cea0 2023-12-17T11:56:05.236 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.531+0000 7f015effd700 1 --2- 172.21.15.8:0/2007538798 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f016007cea0 0x7f016007b300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f01500098a0 tx=0x7f0150009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ebc65d4ea932867 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:05.236 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.531+0000 7f015dffb700 1 -- 172.21.15.8:0/2007538798 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0150004160 con 0x7f016007cea0 2023-12-17T11:56:05.236 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.531+0000 7f015dffb700 1 -- 172.21.15.8:0/2007538798 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f01500042c0 con 0x7f016007cea0 2023-12-17T11:56:05.236 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.531+0000 7f015dffb700 1 -- 172.21.15.8:0/2007538798 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0150011940 con 0x7f016007cea0 2023-12-17T11:56:05.236 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.532+0000 7f01655fc700 1 -- 172.21.15.8:0/2007538798 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f016007cea0 msgr2=0x7f016007b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:05.236 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.532+0000 7f01655fc700 1 --2- 172.21.15.8:0/2007538798 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f016007cea0 0x7f016007b300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f01500098a0 tx=0x7f0150009bb0 comp rx=0 tx=0).stop 2023-12-17T11:56:05.236 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.532+0000 7f01655fc700 1 -- 172.21.15.8:0/2007538798 shutdown_connections 2023-12-17T11:56:05.236 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.532+0000 7f01655fc700 1 --2- 172.21.15.8:0/2007538798 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f016007cea0 0x7f016007b300 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:05.236 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.532+0000 7f01655fc700 1 -- 172.21.15.8:0/2007538798 >> 172.21.15.8:0/2007538798 conn(0x7f0160102030 msgr2=0x7f01601044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:05.236 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.532+0000 7f01655fc700 1 -- 172.21.15.8:0/2007538798 shutdown_connections 2023-12-17T11:56:05.236 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.532+0000 7f01655fc700 1 -- 172.21.15.8:0/2007538798 wait complete. 2023-12-17T11:56:05.237 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.534+0000 7f01655fc700 1 Processor -- start 2023-12-17T11:56:05.237 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.534+0000 7f01655fc700 1 -- start start 2023-12-17T11:56:05.237 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.534+0000 7f01655fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f016007cea0 0x7f016019c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:05.237 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.534+0000 7f01655fc700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016019cea0 con 0x7f016007cea0 2023-12-17T11:56:05.237 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.534+0000 7f015effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f016007cea0 0x7f016019c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:05.237 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.535+0000 7f015effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f016007cea0 0x7f016019c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51830/0 (socket says 172.21.15.8:51830) 2023-12-17T11:56:05.237 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.535+0000 7f015effd700 1 -- 172.21.15.8:0/3657906012 learned_addr learned my addr 172.21.15.8:0/3657906012 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:05.237 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.535+0000 7f015effd700 1 -- 172.21.15.8:0/3657906012 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0150009550 con 0x7f016007cea0 2023-12-17T11:56:05.237 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.535+0000 7f015effd700 1 --2- 172.21.15.8:0/3657906012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f016007cea0 0x7f016019c960 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0150003f20 tx=0x7f0150011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:05.237 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.535+0000 7f0147fff700 1 -- 172.21.15.8:0/3657906012 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01500036a0 con 0x7f016007cea0 2023-12-17T11:56:05.237 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.535+0000 7f0147fff700 1 -- 172.21.15.8:0/3657906012 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f0150003c70 con 0x7f016007cea0 2023-12-17T11:56:05.237 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.535+0000 7f01655fc700 1 -- 172.21.15.8:0/3657906012 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f016019d0a0 con 0x7f016007cea0 2023-12-17T11:56:05.237 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.535+0000 7f0147fff700 1 -- 172.21.15.8:0/3657906012 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f015001be80 con 0x7f016007cea0 2023-12-17T11:56:05.238 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.536+0000 7f01655fc700 1 -- 172.21.15.8:0/3657906012 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f016019d540 con 0x7f016007cea0 2023-12-17T11:56:05.238 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.536+0000 7f01655fc700 1 -- 172.21.15.8:0/3657906012 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f016010ce20 con 0x7f016007cea0 2023-12-17T11:56:05.238 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.537+0000 7f0147fff700 1 -- 172.21.15.8:0/3657906012 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 45580+0+0 (secure 0 0 0) 0x7f015001b440 con 0x7f016007cea0 2023-12-17T11:56:05.238 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.537+0000 7f0147fff700 1 --2- 172.21.15.8:0/3657906012 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f0148038870 0x7f014803ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:05.238 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.537+0000 7f0147fff700 1 -- 172.21.15.8:0/3657906012 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f015004c810 con 0x7f016007cea0 2023-12-17T11:56:05.238 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.537+0000 7f015e7fc700 1 --2- 172.21.15.8:0/3657906012 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f0148038870 0x7f014803ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:05.238 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.538+0000 7f015e7fc700 1 --2- 172.21.15.8:0/3657906012 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f0148038870 0x7f014803ad30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0154006fd0 tx=0x7f0154006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:05.238 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.542+0000 7f0147fff700 1 -- 172.21.15.8:0/3657906012 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f015001b720 con 0x7f016007cea0 2023-12-17T11:56:05.239 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.751+0000 7f01655fc700 1 -- 172.21.15.8:0/3657906012 --> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f0160103300 con 0x7f0148038870 2023-12-17T11:56:05.239 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.876+0000 7f0147fff700 1 -- 172.21.15.8:0/3657906012 <== mgr.14122 v2:172.21.15.8:6800/222068650 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f0160103300 con 0x7f0148038870 2023-12-17T11:56:05.239 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.878+0000 7f01655fc700 1 -- 172.21.15.8:0/3657906012 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f0148038870 msgr2=0x7f014803ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:05.239 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.878+0000 7f01655fc700 1 --2- 172.21.15.8:0/3657906012 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f0148038870 0x7f014803ad30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0154006fd0 tx=0x7f0154006e40 comp rx=0 tx=0).stop 2023-12-17T11:56:05.239 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.878+0000 7f01655fc700 1 -- 172.21.15.8:0/3657906012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f016007cea0 msgr2=0x7f016019c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:05.239 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.878+0000 7f01655fc700 1 --2- 172.21.15.8:0/3657906012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f016007cea0 0x7f016019c960 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0150003f20 tx=0x7f0150011f00 comp rx=0 tx=0).stop 2023-12-17T11:56:05.239 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.878+0000 7f01655fc700 1 -- 172.21.15.8:0/3657906012 shutdown_connections 2023-12-17T11:56:05.239 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.878+0000 7f01655fc700 1 --2- 172.21.15.8:0/3657906012 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f0148038870 0x7f014803ad30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:05.239 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.878+0000 7f01655fc700 1 --2- 172.21.15.8:0/3657906012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f016007cea0 0x7f016019c960 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:05.239 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.878+0000 7f01655fc700 1 -- 172.21.15.8:0/3657906012 >> 172.21.15.8:0/3657906012 conn(0x7f0160102030 msgr2=0x7f0160102bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:05.239 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.878+0000 7f01655fc700 1 -- 172.21.15.8:0/3657906012 shutdown_connections 2023-12-17T11:56:05.239 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:04.878+0000 7f01655fc700 1 -- 172.21.15.8:0/3657906012 wait complete. 2023-12-17T11:56:06.215 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAtcXpXy+4BiXD7v+QmsPyHOs+V35V2dd8+N6/m0CeJAqp/MbSA9kPQculTZebw4GZNUiow3PEzzYZiPZG7kqYRpocnBT7kc7D6MhtiNjuEzyzAirZ30/SlDccEovCyR58E7KLW9D8lZI0HSW+UJKz0RnHdsLw7Ecn/GwOlZX/ceyZu4+HyilDErnWV0rc6fPzD8U1q4GCmOVrjfqyqTRV0t3H4KnlMVbg1naW1PAoKkAeS6/wTq9iU2SJ4o4MdTML9abzlBfcFeQal0MIp9A6lRDbc2hYWmVnUn6Zdr05R81VpzwtpdKkZ5TQ5AxQ/C4x8H41fT//JmG6sFmCFBw+iRkv6FTxPPUp23HHURfEMr2cpBkrYDjw7nU3EFFEHy9LXQ53sFVkimctVU4elX1w9zv1gA0/mvnOW/ABSIImCUxCwL50SRbO+UO3SQxNn1KvN8fTTxCtPl6kv8STQVbQ7bg7/kCwUQB/0pPB7SsXWzPrX3NfWHLkvbauyGwhiCk= ceph-f43f508a-9cd2-11ee-95a5-87774f69a715 2023-12-17T11:56:06.216 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.655+0000 7fc7c38c7700 1 Processor -- start 2023-12-17T11:56:06.216 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.656+0000 7fc7c38c7700 1 -- start start 2023-12-17T11:56:06.216 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.656+0000 7fc7c38c7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7bc07ce60 0x7fc7bc07b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:06.216 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.656+0000 7fc7c38c7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc07b890 con 0x7fc7bc07ce60 2023-12-17T11:56:06.216 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:05 smithi008 ceph-mon[36830]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:56:06.217 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:05 smithi008 ceph-mon[36830]: Generating ssh key... 2023-12-17T11:56:06.217 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:05 smithi008 ceph-mon[36830]: from='mgr.14122 172.21.15.8:0/1995514219' entity='mgr.x' 2023-12-17T11:56:06.217 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:05 smithi008 ceph-mon[36830]: from='mgr.14122 172.21.15.8:0/1995514219' entity='mgr.x' 2023-12-17T11:56:06.221 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.656+0000 7fc7c1663700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7bc07ce60 0x7fc7bc07b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:06.221 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.656+0000 7fc7c1663700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7bc07ce60 0x7fc7bc07b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51842/0 (socket says 172.21.15.8:51842) 2023-12-17T11:56:06.221 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.656+0000 7fc7c1663700 1 -- 172.21.15.8:0/3563369082 learned_addr learned my addr 172.21.15.8:0/3563369082 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:06.222 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.657+0000 7fc7c1663700 1 -- 172.21.15.8:0/3563369082 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7bc07b9d0 con 0x7fc7bc07ce60 2023-12-17T11:56:06.222 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.657+0000 7fc7c1663700 1 --2- 172.21.15.8:0/3563369082 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7bc07ce60 0x7fc7bc07b2c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc7b80098a0 tx=0x7fc7b8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f361c593e261a491 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:06.222 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.657+0000 7fc7b3fff700 1 -- 172.21.15.8:0/3563369082 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc7b8004160 con 0x7fc7bc07ce60 2023-12-17T11:56:06.222 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.657+0000 7fc7b3fff700 1 -- 172.21.15.8:0/3563369082 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fc7b80042c0 con 0x7fc7bc07ce60 2023-12-17T11:56:06.222 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.657+0000 7fc7b3fff700 1 -- 172.21.15.8:0/3563369082 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc7b8011940 con 0x7fc7bc07ce60 2023-12-17T11:56:06.222 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.658+0000 7fc7c38c7700 1 -- 172.21.15.8:0/3563369082 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7bc07ce60 msgr2=0x7fc7bc07b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:06.222 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.658+0000 7fc7c38c7700 1 --2- 172.21.15.8:0/3563369082 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7bc07ce60 0x7fc7bc07b2c0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc7b80098a0 tx=0x7fc7b8009bb0 comp rx=0 tx=0).stop 2023-12-17T11:56:06.222 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.658+0000 7fc7c38c7700 1 -- 172.21.15.8:0/3563369082 shutdown_connections 2023-12-17T11:56:06.222 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.658+0000 7fc7c38c7700 1 --2- 172.21.15.8:0/3563369082 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7bc07ce60 0x7fc7bc07b2c0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:06.222 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.658+0000 7fc7c38c7700 1 -- 172.21.15.8:0/3563369082 >> 172.21.15.8:0/3563369082 conn(0x7fc7bc102030 msgr2=0x7fc7bc1044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:06.222 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.658+0000 7fc7c38c7700 1 -- 172.21.15.8:0/3563369082 shutdown_connections 2023-12-17T11:56:06.222 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.658+0000 7fc7c38c7700 1 -- 172.21.15.8:0/3563369082 wait complete. 2023-12-17T11:56:06.222 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.659+0000 7fc7c38c7700 1 Processor -- start 2023-12-17T11:56:06.222 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.659+0000 7fc7c38c7700 1 -- start start 2023-12-17T11:56:06.222 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.659+0000 7fc7c38c7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7bc07ce60 0x7fc7bc19c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:06.223 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.659+0000 7fc7c38c7700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7bc19cef0 con 0x7fc7bc07ce60 2023-12-17T11:56:06.223 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.660+0000 7fc7c1663700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7bc07ce60 0x7fc7bc19c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:06.223 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.660+0000 7fc7c1663700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7bc07ce60 0x7fc7bc19c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51846/0 (socket says 172.21.15.8:51846) 2023-12-17T11:56:06.223 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.660+0000 7fc7c1663700 1 -- 172.21.15.8:0/2131959999 learned_addr learned my addr 172.21.15.8:0/2131959999 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:06.223 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.660+0000 7fc7c1663700 1 -- 172.21.15.8:0/2131959999 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b8009550 con 0x7fc7bc07ce60 2023-12-17T11:56:06.223 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.660+0000 7fc7c1663700 1 --2- 172.21.15.8:0/2131959999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7bc07ce60 0x7fc7bc19c9b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8003f20 tx=0x7fc7b8011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:06.223 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.660+0000 7fc7b27fc700 1 -- 172.21.15.8:0/2131959999 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc7b80037d0 con 0x7fc7bc07ce60 2023-12-17T11:56:06.223 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.660+0000 7fc7b27fc700 1 -- 172.21.15.8:0/2131959999 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fc7b801b440 con 0x7fc7bc07ce60 2023-12-17T11:56:06.223 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.660+0000 7fc7c38c7700 1 -- 172.21.15.8:0/2131959999 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7bc19d0f0 con 0x7fc7bc07ce60 2023-12-17T11:56:06.223 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.660+0000 7fc7b27fc700 1 -- 172.21.15.8:0/2131959999 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc7b8023590 con 0x7fc7bc07ce60 2023-12-17T11:56:06.223 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.661+0000 7fc7c38c7700 1 -- 172.21.15.8:0/2131959999 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7bc19d590 con 0x7fc7bc07ce60 2023-12-17T11:56:06.223 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.662+0000 7fc7b27fc700 1 -- 172.21.15.8:0/2131959999 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 45580+0+0 (secure 0 0 0) 0x7fc7b801b5b0 con 0x7fc7bc07ce60 2023-12-17T11:56:06.223 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.662+0000 7fc7c38c7700 1 -- 172.21.15.8:0/2131959999 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7bc10ce60 con 0x7fc7bc07ce60 2023-12-17T11:56:06.223 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.662+0000 7fc7b27fc700 1 --2- 172.21.15.8:0/2131959999 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7fc7a8038820 0x7fc7a803ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:06.223 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.662+0000 7fc7b27fc700 1 -- 172.21.15.8:0/2131959999 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc7b804c870 con 0x7fc7bc07ce60 2023-12-17T11:56:06.224 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.663+0000 7fc7c0e62700 1 --2- 172.21.15.8:0/2131959999 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7fc7a8038820 0x7fc7a803ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:06.224 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.663+0000 7fc7c0e62700 1 --2- 172.21.15.8:0/2131959999 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7fc7a8038820 0x7fc7a803ace0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac006fd0 tx=0x7fc7ac006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:06.224 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.668+0000 7fc7b27fc700 1 -- 172.21.15.8:0/2131959999 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fc7b801b920 con 0x7fc7bc07ce60 2023-12-17T11:56:06.224 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.880+0000 7fc7c38c7700 1 -- 172.21.15.8:0/2131959999 --> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7fc7bc103340 con 0x7fc7a8038820 2023-12-17T11:56:06.224 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.881+0000 7fc7b27fc700 1 -- 172.21.15.8:0/2131959999 <== mgr.14122 v2:172.21.15.8:6800/222068650 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7fc7bc103340 con 0x7fc7a8038820 2023-12-17T11:56:06.224 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.883+0000 7fc7c38c7700 1 -- 172.21.15.8:0/2131959999 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7fc7a8038820 msgr2=0x7fc7a803ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:06.224 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.883+0000 7fc7c38c7700 1 --2- 172.21.15.8:0/2131959999 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7fc7a8038820 0x7fc7a803ace0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac006fd0 tx=0x7fc7ac006e40 comp rx=0 tx=0).stop 2023-12-17T11:56:06.224 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.883+0000 7fc7c38c7700 1 -- 172.21.15.8:0/2131959999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7bc07ce60 msgr2=0x7fc7bc19c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:06.224 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.883+0000 7fc7c38c7700 1 --2- 172.21.15.8:0/2131959999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7bc07ce60 0x7fc7bc19c9b0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8003f20 tx=0x7fc7b8011f00 comp rx=0 tx=0).stop 2023-12-17T11:56:06.224 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.883+0000 7fc7c38c7700 1 -- 172.21.15.8:0/2131959999 shutdown_connections 2023-12-17T11:56:06.224 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.883+0000 7fc7c38c7700 1 --2- 172.21.15.8:0/2131959999 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7fc7a8038820 0x7fc7a803ace0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:06.224 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.883+0000 7fc7c38c7700 1 --2- 172.21.15.8:0/2131959999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc7bc07ce60 0x7fc7bc19c9b0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:06.224 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.883+0000 7fc7c38c7700 1 -- 172.21.15.8:0/2131959999 >> 172.21.15.8:0/2131959999 conn(0x7fc7bc102030 msgr2=0x7fc7bc102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:06.224 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.884+0000 7fc7c38c7700 1 -- 172.21.15.8:0/2131959999 shutdown_connections 2023-12-17T11:56:06.225 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:05.884+0000 7fc7c38c7700 1 -- 172.21.15.8:0/2131959999 wait complete. 2023-12-17T11:56:06.225 INFO:teuthology.orchestra.run.smithi008.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-12-17T11:56:06.225 INFO:teuthology.orchestra.run.smithi008.stdout:Adding key to root@localhost authorized_keys... 2023-12-17T11:56:06.225 INFO:teuthology.orchestra.run.smithi008.stdout:Adding host smithi008... 2023-12-17T11:56:07.137 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:06 smithi008 ceph-mon[36830]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:56:08.163 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:07 smithi008 ceph-mon[36830]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi008", "addr": "172.21.15.8", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:56:09.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:08 smithi008 ceph-mon[36830]: Deploying cephadm binary to smithi008 2023-12-17T11:56:12.010 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout Added host 'smithi008' with addr '172.21.15.8' 2023-12-17T11:56:12.010 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.666+0000 7f7fff749700 1 Processor -- start 2023-12-17T11:56:12.010 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.666+0000 7f7fff749700 1 -- start start 2023-12-17T11:56:12.010 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.666+0000 7f7fff749700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ff807ce60 0x7f7ff807b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:12.010 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.666+0000 7f7fff749700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff807b890 con 0x7f7ff807ce60 2023-12-17T11:56:12.010 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.667+0000 7f7ffd4e5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ff807ce60 0x7f7ff807b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:12.011 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.667+0000 7f7ffd4e5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ff807ce60 0x7f7ff807b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51860/0 (socket says 172.21.15.8:51860) 2023-12-17T11:56:12.011 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.667+0000 7f7ffd4e5700 1 -- 172.21.15.8:0/59647721 learned_addr learned my addr 172.21.15.8:0/59647721 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:12.011 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.667+0000 7f7ffd4e5700 1 -- 172.21.15.8:0/59647721 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff807b9d0 con 0x7f7ff807ce60 2023-12-17T11:56:12.011 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.667+0000 7f7ffd4e5700 1 --2- 172.21.15.8:0/59647721 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ff807ce60 0x7f7ff807b2c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7ff40098a0 tx=0x7f7ff4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81fe6e3745f451c8 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:12.011 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.667+0000 7f7feffff700 1 -- 172.21.15.8:0/59647721 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ff4004160 con 0x7f7ff807ce60 2023-12-17T11:56:12.011 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.668+0000 7f7feffff700 1 -- 172.21.15.8:0/59647721 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f7ff40042c0 con 0x7f7ff807ce60 2023-12-17T11:56:12.011 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.668+0000 7f7feffff700 1 -- 172.21.15.8:0/59647721 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ff4011940 con 0x7f7ff807ce60 2023-12-17T11:56:12.011 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.668+0000 7f7fff749700 1 -- 172.21.15.8:0/59647721 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ff807ce60 msgr2=0x7f7ff807b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:12.011 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.668+0000 7f7fff749700 1 --2- 172.21.15.8:0/59647721 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ff807ce60 0x7f7ff807b2c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7ff40098a0 tx=0x7f7ff4009bb0 comp rx=0 tx=0).stop 2023-12-17T11:56:12.011 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.668+0000 7f7fff749700 1 -- 172.21.15.8:0/59647721 shutdown_connections 2023-12-17T11:56:12.011 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.668+0000 7f7fff749700 1 --2- 172.21.15.8:0/59647721 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ff807ce60 0x7f7ff807b2c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:12.011 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.668+0000 7f7fff749700 1 -- 172.21.15.8:0/59647721 >> 172.21.15.8:0/59647721 conn(0x7f7ff8102030 msgr2=0x7f7ff81044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:12.011 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.668+0000 7f7fff749700 1 -- 172.21.15.8:0/59647721 shutdown_connections 2023-12-17T11:56:12.011 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.668+0000 7f7fff749700 1 -- 172.21.15.8:0/59647721 wait complete. 2023-12-17T11:56:12.012 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.669+0000 7f7fff749700 1 Processor -- start 2023-12-17T11:56:12.012 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.669+0000 7f7fff749700 1 -- start start 2023-12-17T11:56:12.012 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.670+0000 7f7fff749700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ff807ce60 0x7f7ff819c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:12.012 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.670+0000 7f7fff749700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff819cef0 con 0x7f7ff807ce60 2023-12-17T11:56:12.012 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.670+0000 7f7ffd4e5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ff807ce60 0x7f7ff819c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:12.012 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.670+0000 7f7ffd4e5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ff807ce60 0x7f7ff819c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51864/0 (socket says 172.21.15.8:51864) 2023-12-17T11:56:12.012 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.670+0000 7f7ffd4e5700 1 -- 172.21.15.8:0/2004018451 learned_addr learned my addr 172.21.15.8:0/2004018451 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:12.012 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.670+0000 7f7ffd4e5700 1 -- 172.21.15.8:0/2004018451 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff4009550 con 0x7f7ff807ce60 2023-12-17T11:56:12.012 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.671+0000 7f7ffd4e5700 1 --2- 172.21.15.8:0/2004018451 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ff807ce60 0x7f7ff819c9b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7ff4006af0 tx=0x7f7ff4011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:12.012 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.671+0000 7f7fee7fc700 1 -- 172.21.15.8:0/2004018451 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ff4003bf0 con 0x7f7ff807ce60 2023-12-17T11:56:12.012 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.671+0000 7f7fee7fc700 1 -- 172.21.15.8:0/2004018451 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f7ff401b8b0 con 0x7f7ff807ce60 2023-12-17T11:56:12.012 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.671+0000 7f7fee7fc700 1 -- 172.21.15.8:0/2004018451 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ff4023800 con 0x7f7ff807ce60 2023-12-17T11:56:12.012 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.671+0000 7f7fff749700 1 -- 172.21.15.8:0/2004018451 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ff819d0f0 con 0x7f7ff807ce60 2023-12-17T11:56:12.012 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.671+0000 7f7fff749700 1 -- 172.21.15.8:0/2004018451 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ff819d590 con 0x7f7ff807ce60 2023-12-17T11:56:12.012 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.672+0000 7f7fee7fc700 1 -- 172.21.15.8:0/2004018451 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 45580+0+0 (secure 0 0 0) 0x7f7ff401ba20 con 0x7f7ff807ce60 2023-12-17T11:56:12.013 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.672+0000 7f7fff749700 1 -- 172.21.15.8:0/2004018451 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ff810ce60 con 0x7f7ff807ce60 2023-12-17T11:56:12.013 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.672+0000 7f7fee7fc700 1 --2- 172.21.15.8:0/2004018451 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f7fe40387d0 0x7f7fe403ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:12.013 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.673+0000 7f7fee7fc700 1 -- 172.21.15.8:0/2004018451 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f7ff404cdb0 con 0x7f7ff807ce60 2023-12-17T11:56:12.013 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.673+0000 7f7ffcce4700 1 --2- 172.21.15.8:0/2004018451 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f7fe40387d0 0x7f7fe403ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:12.013 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.673+0000 7f7ffcce4700 1 --2- 172.21.15.8:0/2004018451 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f7fe40387d0 0x7f7fe403ac90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7fe8006fd0 tx=0x7f7fe8006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:12.013 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.678+0000 7f7fee7fc700 1 -- 172.21.15.8:0/2004018451 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f7ff402b940 con 0x7f7ff807ce60 2023-12-17T11:56:12.013 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:06.893+0000 7f7fff749700 1 -- 172.21.15.8:0/2004018451 --> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi008", "addr": "172.21.15.8", "target": ["mon-mgr", ""]}) v1 -- 0x7f7ff8103340 con 0x7f7fe40387d0 2023-12-17T11:56:12.013 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:11.659+0000 7f7fee7fc700 1 -- 172.21.15.8:0/2004018451 <== mgr.14122 v2:172.21.15.8:6800/222068650 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f7ff8103340 con 0x7f7fe40387d0 2023-12-17T11:56:12.013 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:11.662+0000 7f7fff749700 1 -- 172.21.15.8:0/2004018451 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f7fe40387d0 msgr2=0x7f7fe403ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:12.013 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:11.662+0000 7f7fff749700 1 --2- 172.21.15.8:0/2004018451 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f7fe40387d0 0x7f7fe403ac90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7fe8006fd0 tx=0x7f7fe8006e40 comp rx=0 tx=0).stop 2023-12-17T11:56:12.013 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:11.662+0000 7f7fff749700 1 -- 172.21.15.8:0/2004018451 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ff807ce60 msgr2=0x7f7ff819c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:12.013 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:11.662+0000 7f7fff749700 1 --2- 172.21.15.8:0/2004018451 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ff807ce60 0x7f7ff819c9b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7ff4006af0 tx=0x7f7ff4011a50 comp rx=0 tx=0).stop 2023-12-17T11:56:12.013 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:11.662+0000 7f7fff749700 1 -- 172.21.15.8:0/2004018451 shutdown_connections 2023-12-17T11:56:12.013 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:11.662+0000 7f7fff749700 1 --2- 172.21.15.8:0/2004018451 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f7fe40387d0 0x7f7fe403ac90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:12.014 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:11.662+0000 7f7fff749700 1 --2- 172.21.15.8:0/2004018451 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ff807ce60 0x7f7ff819c9b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:12.014 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:11.662+0000 7f7fff749700 1 -- 172.21.15.8:0/2004018451 >> 172.21.15.8:0/2004018451 conn(0x7f7ff8102030 msgr2=0x7f7ff8102c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:12.014 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:11.662+0000 7f7fff749700 1 -- 172.21.15.8:0/2004018451 shutdown_connections 2023-12-17T11:56:12.014 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:11.662+0000 7f7fff749700 1 -- 172.21.15.8:0/2004018451 wait complete. 2023-12-17T11:56:12.014 INFO:teuthology.orchestra.run.smithi008.stdout:Deploying unmanaged mon service... 2023-12-17T11:56:12.949 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:12 smithi008 ceph-mon[36830]: from='mgr.14122 172.21.15.8:0/1995514219' entity='mgr.x' 2023-12-17T11:56:12.949 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:12 smithi008 ceph-mon[36830]: Added host smithi008 2023-12-17T11:56:12.949 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:12 smithi008 ceph-mon[36830]: from='mgr.14122 172.21.15.8:0/1995514219' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:56:13.249 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-12-17T11:56:13.249 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.438+0000 7f384570a700 1 Processor -- start 2023-12-17T11:56:13.249 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.438+0000 7f384570a700 1 -- start start 2023-12-17T11:56:13.249 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.438+0000 7f384570a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f384007ce40 0x7f384007b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:13.249 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.438+0000 7f384570a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384007b870 con 0x7f384007ce40 2023-12-17T11:56:13.249 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.439+0000 7f383effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f384007ce40 0x7f384007b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:13.249 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.439+0000 7f383effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f384007ce40 0x7f384007b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58352/0 (socket says 172.21.15.8:58352) 2023-12-17T11:56:13.250 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.439+0000 7f383effd700 1 -- 172.21.15.8:0/278754495 learned_addr learned my addr 172.21.15.8:0/278754495 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:13.250 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.439+0000 7f383effd700 1 -- 172.21.15.8:0/278754495 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384007b9b0 con 0x7f384007ce40 2023-12-17T11:56:13.250 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.440+0000 7f383effd700 1 --2- 172.21.15.8:0/278754495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f384007ce40 0x7f384007b2a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f38300098a0 tx=0x7f3830009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d590935a37355337 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:13.250 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.440+0000 7f383dffb700 1 -- 172.21.15.8:0/278754495 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3830004160 con 0x7f384007ce40 2023-12-17T11:56:13.250 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.440+0000 7f383dffb700 1 -- 172.21.15.8:0/278754495 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f38300042c0 con 0x7f384007ce40 2023-12-17T11:56:13.250 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.440+0000 7f383dffb700 1 -- 172.21.15.8:0/278754495 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3830011940 con 0x7f384007ce40 2023-12-17T11:56:13.250 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.440+0000 7f384570a700 1 -- 172.21.15.8:0/278754495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f384007ce40 msgr2=0x7f384007b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:13.250 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.440+0000 7f384570a700 1 --2- 172.21.15.8:0/278754495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f384007ce40 0x7f384007b2a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f38300098a0 tx=0x7f3830009bb0 comp rx=0 tx=0).stop 2023-12-17T11:56:13.250 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.441+0000 7f384570a700 1 -- 172.21.15.8:0/278754495 shutdown_connections 2023-12-17T11:56:13.250 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.441+0000 7f384570a700 1 --2- 172.21.15.8:0/278754495 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f384007ce40 0x7f384007b2a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:13.250 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.441+0000 7f384570a700 1 -- 172.21.15.8:0/278754495 >> 172.21.15.8:0/278754495 conn(0x7f3840102030 msgr2=0x7f38401044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:13.250 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.441+0000 7f384570a700 1 -- 172.21.15.8:0/278754495 shutdown_connections 2023-12-17T11:56:13.250 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.441+0000 7f384570a700 1 -- 172.21.15.8:0/278754495 wait complete. 2023-12-17T11:56:13.250 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.442+0000 7f384570a700 1 Processor -- start 2023-12-17T11:56:13.250 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.442+0000 7f384570a700 1 -- start start 2023-12-17T11:56:13.251 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.442+0000 7f384570a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f384007ce40 0x7f384019c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:13.251 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.442+0000 7f384570a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384019ce80 con 0x7f384007ce40 2023-12-17T11:56:13.251 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.442+0000 7f383effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f384007ce40 0x7f384019c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:13.251 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.442+0000 7f383effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f384007ce40 0x7f384019c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58354/0 (socket says 172.21.15.8:58354) 2023-12-17T11:56:13.251 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.442+0000 7f383effd700 1 -- 172.21.15.8:0/2592744805 learned_addr learned my addr 172.21.15.8:0/2592744805 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:13.251 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.443+0000 7f383effd700 1 -- 172.21.15.8:0/2592744805 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3830009550 con 0x7f384007ce40 2023-12-17T11:56:13.251 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.443+0000 7f383effd700 1 --2- 172.21.15.8:0/2592744805 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f384007ce40 0x7f384019c940 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3830003f20 tx=0x7f3830011f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:13.251 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.443+0000 7f3827fff700 1 -- 172.21.15.8:0/2592744805 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f38300037d0 con 0x7f384007ce40 2023-12-17T11:56:13.251 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.443+0000 7f3827fff700 1 -- 172.21.15.8:0/2592744805 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f383001b440 con 0x7f384007ce40 2023-12-17T11:56:13.251 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.443+0000 7f3827fff700 1 -- 172.21.15.8:0/2592744805 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f3830023590 con 0x7f384007ce40 2023-12-17T11:56:13.251 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.443+0000 7f384570a700 1 -- 172.21.15.8:0/2592744805 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f384019d080 con 0x7f384007ce40 2023-12-17T11:56:13.251 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.443+0000 7f384570a700 1 -- 172.21.15.8:0/2592744805 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f384019d520 con 0x7f384007ce40 2023-12-17T11:56:13.251 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.444+0000 7f3827fff700 1 -- 172.21.15.8:0/2592744805 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 45580+0+0 (secure 0 0 0) 0x7f383001b5b0 con 0x7f384007ce40 2023-12-17T11:56:13.251 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.444+0000 7f384570a700 1 -- 172.21.15.8:0/2592744805 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f384010ce20 con 0x7f384007ce40 2023-12-17T11:56:13.251 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.445+0000 7f3827fff700 1 --2- 172.21.15.8:0/2592744805 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f3828038870 0x7f382803ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:13.252 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.445+0000 7f3827fff700 1 -- 172.21.15.8:0/2592744805 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f383004c840 con 0x7f384007ce40 2023-12-17T11:56:13.252 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.445+0000 7f383e7fc700 1 --2- 172.21.15.8:0/2592744805 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f3828038870 0x7f382803ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:13.252 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.446+0000 7f383e7fc700 1 --2- 172.21.15.8:0/2592744805 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f3828038870 0x7f382803ad30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3834006fd0 tx=0x7f3834006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:13.252 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.450+0000 7f3827fff700 1 -- 172.21.15.8:0/2592744805 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f383001b920 con 0x7f384007ce40 2023-12-17T11:56:13.252 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.697+0000 7f384570a700 1 -- 172.21.15.8:0/2592744805 --> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f3840103320 con 0x7f3828038870 2023-12-17T11:56:13.252 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.702+0000 7f3827fff700 1 -- 172.21.15.8:0/2592744805 <== mgr.14122 v2:172.21.15.8:6800/222068650 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f3840103320 con 0x7f3828038870 2023-12-17T11:56:13.252 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.704+0000 7f384570a700 1 -- 172.21.15.8:0/2592744805 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f3828038870 msgr2=0x7f382803ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:13.252 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.704+0000 7f384570a700 1 --2- 172.21.15.8:0/2592744805 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f3828038870 0x7f382803ad30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f3834006fd0 tx=0x7f3834006e40 comp rx=0 tx=0).stop 2023-12-17T11:56:13.252 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.705+0000 7f384570a700 1 -- 172.21.15.8:0/2592744805 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f384007ce40 msgr2=0x7f384019c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:13.252 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.705+0000 7f384570a700 1 --2- 172.21.15.8:0/2592744805 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f384007ce40 0x7f384019c940 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3830003f20 tx=0x7f3830011f00 comp rx=0 tx=0).stop 2023-12-17T11:56:13.252 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.705+0000 7f384570a700 1 -- 172.21.15.8:0/2592744805 shutdown_connections 2023-12-17T11:56:13.252 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.705+0000 7f384570a700 1 --2- 172.21.15.8:0/2592744805 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f3828038870 0x7f382803ad30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:13.252 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.705+0000 7f384570a700 1 --2- 172.21.15.8:0/2592744805 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f384007ce40 0x7f384019c940 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:13.252 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.705+0000 7f384570a700 1 -- 172.21.15.8:0/2592744805 >> 172.21.15.8:0/2592744805 conn(0x7f3840102030 msgr2=0x7f3840102c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:13.253 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.705+0000 7f384570a700 1 -- 172.21.15.8:0/2592744805 shutdown_connections 2023-12-17T11:56:13.253 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:12.705+0000 7f384570a700 1 -- 172.21.15.8:0/2592744805 wait complete. 2023-12-17T11:56:13.253 INFO:teuthology.orchestra.run.smithi008.stdout:Deploying unmanaged mgr service... 2023-12-17T11:56:13.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:13 smithi008 ceph-mon[36830]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:56:13.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:13 smithi008 ceph-mon[36830]: Saving service mon spec with placement count:5 2023-12-17T11:56:13.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:13 smithi008 ceph-mon[36830]: from='mgr.14122 172.21.15.8:0/1995514219' entity='mgr.x' 2023-12-17T11:56:13.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:13 smithi008 ceph-mon[36830]: from='mgr.14122 172.21.15.8:0/1995514219' entity='mgr.x' 2023-12-17T11:56:14.451 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-12-17T11:56:14.451 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.817+0000 7fbc4584f700 1 Processor -- start 2023-12-17T11:56:14.451 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.817+0000 7fbc4584f700 1 -- start start 2023-12-17T11:56:14.452 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.818+0000 7fbc4584f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc40106ad0 0x7fbc40106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:14.452 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.818+0000 7fbc4584f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc401074c0 con 0x7fbc40106ad0 2023-12-17T11:56:14.452 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.818+0000 7fbc3effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc40106ad0 0x7fbc40106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:14.452 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.818+0000 7fbc3effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc40106ad0 0x7fbc40106ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58370/0 (socket says 172.21.15.8:58370) 2023-12-17T11:56:14.452 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.818+0000 7fbc3effd700 1 -- 172.21.15.8:0/2947395699 learned_addr learned my addr 172.21.15.8:0/2947395699 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:14.452 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.819+0000 7fbc3effd700 1 -- 172.21.15.8:0/2947395699 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc40107cd0 con 0x7fbc40106ad0 2023-12-17T11:56:14.452 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.819+0000 7fbc3effd700 1 --2- 172.21.15.8:0/2947395699 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc40106ad0 0x7fbc40106ef0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbc300098a0 tx=0x7fbc30009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53cfe8439df652e server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:14.452 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.819+0000 7fbc3dffb700 1 -- 172.21.15.8:0/2947395699 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbc30004160 con 0x7fbc40106ad0 2023-12-17T11:56:14.452 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.819+0000 7fbc3dffb700 1 -- 172.21.15.8:0/2947395699 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbc300042c0 con 0x7fbc40106ad0 2023-12-17T11:56:14.452 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.819+0000 7fbc3dffb700 1 -- 172.21.15.8:0/2947395699 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbc300118e0 con 0x7fbc40106ad0 2023-12-17T11:56:14.452 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.820+0000 7fbc4584f700 1 -- 172.21.15.8:0/2947395699 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc40106ad0 msgr2=0x7fbc40106ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:14.452 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.820+0000 7fbc4584f700 1 --2- 172.21.15.8:0/2947395699 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc40106ad0 0x7fbc40106ef0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fbc300098a0 tx=0x7fbc30009bb0 comp rx=0 tx=0).stop 2023-12-17T11:56:14.452 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.820+0000 7fbc4584f700 1 -- 172.21.15.8:0/2947395699 shutdown_connections 2023-12-17T11:56:14.453 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.820+0000 7fbc4584f700 1 --2- 172.21.15.8:0/2947395699 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc40106ad0 0x7fbc40106ef0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:14.453 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.820+0000 7fbc4584f700 1 -- 172.21.15.8:0/2947395699 >> 172.21.15.8:0/2947395699 conn(0x7fbc40102030 msgr2=0x7fbc401044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:14.453 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.820+0000 7fbc4584f700 1 -- 172.21.15.8:0/2947395699 shutdown_connections 2023-12-17T11:56:14.453 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.820+0000 7fbc4584f700 1 -- 172.21.15.8:0/2947395699 wait complete. 2023-12-17T11:56:14.453 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.821+0000 7fbc4584f700 1 Processor -- start 2023-12-17T11:56:14.453 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.821+0000 7fbc4584f700 1 -- start start 2023-12-17T11:56:14.453 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.822+0000 7fbc4584f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc40106ad0 0x7fbc4019ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:14.453 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.822+0000 7fbc4584f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4019cf80 con 0x7fbc40106ad0 2023-12-17T11:56:14.453 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.822+0000 7fbc3effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc40106ad0 0x7fbc4019ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:14.453 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.822+0000 7fbc3effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc40106ad0 0x7fbc4019ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58386/0 (socket says 172.21.15.8:58386) 2023-12-17T11:56:14.453 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.822+0000 7fbc3effd700 1 -- 172.21.15.8:0/2722879409 learned_addr learned my addr 172.21.15.8:0/2722879409 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:14.453 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.822+0000 7fbc3effd700 1 -- 172.21.15.8:0/2722879409 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc30009550 con 0x7fbc40106ad0 2023-12-17T11:56:14.453 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.822+0000 7fbc3effd700 1 --2- 172.21.15.8:0/2722879409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc40106ad0 0x7fbc4019ca40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbc30003e30 tx=0x7fbc30011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:14.454 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.823+0000 7fbc4484d700 1 -- 172.21.15.8:0/2722879409 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbc300036a0 con 0x7fbc40106ad0 2023-12-17T11:56:14.454 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.823+0000 7fbc4484d700 1 -- 172.21.15.8:0/2722879409 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbc3001b440 con 0x7fbc40106ad0 2023-12-17T11:56:14.454 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.823+0000 7fbc4484d700 1 -- 172.21.15.8:0/2722879409 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbc300193d0 con 0x7fbc40106ad0 2023-12-17T11:56:14.454 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.823+0000 7fbc4584f700 1 -- 172.21.15.8:0/2722879409 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc4019d180 con 0x7fbc40106ad0 2023-12-17T11:56:14.454 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.823+0000 7fbc4584f700 1 -- 172.21.15.8:0/2722879409 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc4019d620 con 0x7fbc40106ad0 2023-12-17T11:56:14.454 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.824+0000 7fbc4584f700 1 -- 172.21.15.8:0/2722879409 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc4010af00 con 0x7fbc40106ad0 2023-12-17T11:56:14.454 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.824+0000 7fbc4484d700 1 -- 172.21.15.8:0/2722879409 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 45580+0+0 (secure 0 0 0) 0x7fbc30003800 con 0x7fbc40106ad0 2023-12-17T11:56:14.454 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.825+0000 7fbc4484d700 1 --2- 172.21.15.8:0/2722879409 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7fbc28038820 0x7fbc2803ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:14.454 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.825+0000 7fbc4484d700 1 -- 172.21.15.8:0/2722879409 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fbc3004c660 con 0x7fbc40106ad0 2023-12-17T11:56:14.454 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.825+0000 7fbc3e7fc700 1 --2- 172.21.15.8:0/2722879409 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7fbc28038820 0x7fbc2803ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:14.454 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.826+0000 7fbc3e7fc700 1 --2- 172.21.15.8:0/2722879409 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7fbc28038820 0x7fbc2803ace0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbc34006fd0 tx=0x7fbc34006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:14.454 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:13.830+0000 7fbc4484d700 1 -- 172.21.15.8:0/2722879409 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fbc3002b7c0 con 0x7fbc40106ad0 2023-12-17T11:56:14.454 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.061+0000 7fbc4584f700 1 -- 172.21.15.8:0/2722879409 --> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fbc4019feb0 con 0x7fbc28038820 2023-12-17T11:56:14.454 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.066+0000 7fbc4484d700 1 -- 172.21.15.8:0/2722879409 <== mgr.14122 v2:172.21.15.8:6800/222068650 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fbc4019feb0 con 0x7fbc28038820 2023-12-17T11:56:14.454 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.069+0000 7fbc4584f700 1 -- 172.21.15.8:0/2722879409 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7fbc28038820 msgr2=0x7fbc2803ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:14.455 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.069+0000 7fbc4584f700 1 --2- 172.21.15.8:0/2722879409 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7fbc28038820 0x7fbc2803ace0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fbc34006fd0 tx=0x7fbc34006e40 comp rx=0 tx=0).stop 2023-12-17T11:56:14.455 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.069+0000 7fbc4584f700 1 -- 172.21.15.8:0/2722879409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc40106ad0 msgr2=0x7fbc4019ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:14.455 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.070+0000 7fbc4584f700 1 --2- 172.21.15.8:0/2722879409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc40106ad0 0x7fbc4019ca40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fbc30003e30 tx=0x7fbc30011e80 comp rx=0 tx=0).stop 2023-12-17T11:56:14.455 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.070+0000 7fbc4584f700 1 -- 172.21.15.8:0/2722879409 shutdown_connections 2023-12-17T11:56:14.455 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.070+0000 7fbc4584f700 1 --2- 172.21.15.8:0/2722879409 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7fbc28038820 0x7fbc2803ace0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:14.455 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.070+0000 7fbc4584f700 1 --2- 172.21.15.8:0/2722879409 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbc40106ad0 0x7fbc4019ca40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:14.455 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.070+0000 7fbc4584f700 1 -- 172.21.15.8:0/2722879409 >> 172.21.15.8:0/2722879409 conn(0x7fbc40102030 msgr2=0x7fbc40102bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:14.455 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.070+0000 7fbc4584f700 1 -- 172.21.15.8:0/2722879409 shutdown_connections 2023-12-17T11:56:14.455 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.070+0000 7fbc4584f700 1 -- 172.21.15.8:0/2722879409 wait complete. 2023-12-17T11:56:15.489 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:15 smithi008 ceph-mon[36830]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:56:15.489 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:15 smithi008 ceph-mon[36830]: Saving service mgr spec with placement count:2 2023-12-17T11:56:15.489 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:15 smithi008 ceph-mon[36830]: from='mgr.14122 172.21.15.8:0/1995514219' entity='mgr.x' 2023-12-17T11:56:15.490 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:15 smithi008 ceph-mon[36830]: from='mgr.14122 172.21.15.8:0/1995514219' entity='mgr.x' 2023-12-17T11:56:15.639 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.863+0000 7fc430986700 1 Processor -- start 2023-12-17T11:56:15.639 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.863+0000 7fc430986700 1 -- start start 2023-12-17T11:56:15.639 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.863+0000 7fc430986700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc42c107560 0x7fc42c109950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:15.640 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.863+0000 7fc430986700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42c07ae70 con 0x7fc42c107560 2023-12-17T11:56:15.640 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.864+0000 7fc42a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc42c107560 0x7fc42c109950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:15.640 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.864+0000 7fc42a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc42c107560 0x7fc42c109950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58396/0 (socket says 172.21.15.8:58396) 2023-12-17T11:56:15.640 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.864+0000 7fc42a59c700 1 -- 172.21.15.8:0/2899994416 learned_addr learned my addr 172.21.15.8:0/2899994416 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:15.640 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.864+0000 7fc42a59c700 1 -- 172.21.15.8:0/2899994416 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc42c109e90 con 0x7fc42c107560 2023-12-17T11:56:15.640 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.865+0000 7fc42a59c700 1 --2- 172.21.15.8:0/2899994416 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc42c107560 0x7fc42c109950 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc41c0098a0 tx=0x7fc41c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c907e2b32572737 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:15.640 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.866+0000 7fc42959a700 1 -- 172.21.15.8:0/2899994416 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc41c004160 con 0x7fc42c107560 2023-12-17T11:56:15.640 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.867+0000 7fc42959a700 1 -- 172.21.15.8:0/2899994416 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc41c0042c0 con 0x7fc42c107560 2023-12-17T11:56:15.640 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.867+0000 7fc42959a700 1 -- 172.21.15.8:0/2899994416 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc41c0118e0 con 0x7fc42c107560 2023-12-17T11:56:15.640 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.867+0000 7fc430986700 1 -- 172.21.15.8:0/2899994416 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc42c107560 msgr2=0x7fc42c109950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:15.640 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.867+0000 7fc430986700 1 --2- 172.21.15.8:0/2899994416 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc42c107560 0x7fc42c109950 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc41c0098a0 tx=0x7fc41c009bb0 comp rx=0 tx=0).stop 2023-12-17T11:56:15.640 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.867+0000 7fc430986700 1 -- 172.21.15.8:0/2899994416 shutdown_connections 2023-12-17T11:56:15.640 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.867+0000 7fc430986700 1 --2- 172.21.15.8:0/2899994416 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc42c107560 0x7fc42c109950 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:15.640 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.867+0000 7fc430986700 1 -- 172.21.15.8:0/2899994416 >> 172.21.15.8:0/2899994416 conn(0x7fc42c100f70 msgr2=0x7fc42c1033b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:15.641 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.868+0000 7fc430986700 1 -- 172.21.15.8:0/2899994416 shutdown_connections 2023-12-17T11:56:15.641 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.868+0000 7fc430986700 1 -- 172.21.15.8:0/2899994416 wait complete. 2023-12-17T11:56:15.641 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.869+0000 7fc430986700 1 Processor -- start 2023-12-17T11:56:15.641 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.869+0000 7fc430986700 1 -- start start 2023-12-17T11:56:15.641 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.869+0000 7fc430986700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc42c107560 0x7fc42c19ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:15.641 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.869+0000 7fc430986700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc42c19cf40 con 0x7fc42c107560 2023-12-17T11:56:15.641 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.870+0000 7fc42a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc42c107560 0x7fc42c19ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:15.641 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.870+0000 7fc42a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc42c107560 0x7fc42c19ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58402/0 (socket says 172.21.15.8:58402) 2023-12-17T11:56:15.641 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.870+0000 7fc42a59c700 1 -- 172.21.15.8:0/3193314012 learned_addr learned my addr 172.21.15.8:0/3193314012 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:15.641 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.870+0000 7fc42a59c700 1 -- 172.21.15.8:0/3193314012 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc41c009550 con 0x7fc42c107560 2023-12-17T11:56:15.641 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.870+0000 7fc42a59c700 1 --2- 172.21.15.8:0/3193314012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc42c107560 0x7fc42c19ca00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc41c0046e0 tx=0x7fc41c0119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:15.641 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.871+0000 7fc41b7fe700 1 -- 172.21.15.8:0/3193314012 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc41c0037d0 con 0x7fc42c107560 2023-12-17T11:56:15.641 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.871+0000 7fc41b7fe700 1 -- 172.21.15.8:0/3193314012 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc41c01b440 con 0x7fc42c107560 2023-12-17T11:56:15.642 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.871+0000 7fc430986700 1 -- 172.21.15.8:0/3193314012 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc42c19d140 con 0x7fc42c107560 2023-12-17T11:56:15.642 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.871+0000 7fc41b7fe700 1 -- 172.21.15.8:0/3193314012 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc41c023400 con 0x7fc42c107560 2023-12-17T11:56:15.642 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.871+0000 7fc430986700 1 -- 172.21.15.8:0/3193314012 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc42c19d5e0 con 0x7fc42c107560 2023-12-17T11:56:15.642 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.872+0000 7fc41b7fe700 1 -- 172.21.15.8:0/3193314012 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 45580+0+0 (secure 0 0 0) 0x7fc41c023680 con 0x7fc42c107560 2023-12-17T11:56:15.642 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.872+0000 7fc430986700 1 -- 172.21.15.8:0/3193314012 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc42c10ac20 con 0x7fc42c107560 2023-12-17T11:56:15.642 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.873+0000 7fc41b7fe700 1 --2- 172.21.15.8:0/3193314012 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7fc414038820 0x7fc41403ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:15.642 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.873+0000 7fc41b7fe700 1 -- 172.21.15.8:0/3193314012 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc41c04c770 con 0x7fc42c107560 2023-12-17T11:56:15.642 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.873+0000 7fc429d9b700 1 --2- 172.21.15.8:0/3193314012 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7fc414038820 0x7fc41403ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:15.642 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.874+0000 7fc429d9b700 1 --2- 172.21.15.8:0/3193314012 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7fc414038820 0x7fc41403ace0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc420006fd0 tx=0x7fc420006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:15.642 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:14.879+0000 7fc41b7fe700 1 -- 172.21.15.8:0/3193314012 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fc41c018350 con 0x7fc42c107560 2023-12-17T11:56:15.642 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:15.124+0000 7fc430986700 1 -- 172.21.15.8:0/3193314012 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fc42c10ae90 con 0x7fc42c107560 2023-12-17T11:56:15.642 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:15.127+0000 7fc41b7fe700 1 -- 172.21.15.8:0/3193314012 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fc41c02bb40 con 0x7fc42c107560 2023-12-17T11:56:15.642 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:15.129+0000 7fc430986700 1 -- 172.21.15.8:0/3193314012 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7fc414038820 msgr2=0x7fc41403ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:15.643 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:15.129+0000 7fc430986700 1 --2- 172.21.15.8:0/3193314012 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7fc414038820 0x7fc41403ace0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fc420006fd0 tx=0x7fc420006e40 comp rx=0 tx=0).stop 2023-12-17T11:56:15.643 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:15.129+0000 7fc430986700 1 -- 172.21.15.8:0/3193314012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc42c107560 msgr2=0x7fc42c19ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:15.643 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:15.129+0000 7fc430986700 1 --2- 172.21.15.8:0/3193314012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc42c107560 0x7fc42c19ca00 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc41c0046e0 tx=0x7fc41c0119a0 comp rx=0 tx=0).stop 2023-12-17T11:56:15.643 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:15.130+0000 7fc430986700 1 -- 172.21.15.8:0/3193314012 shutdown_connections 2023-12-17T11:56:15.643 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:15.130+0000 7fc430986700 1 --2- 172.21.15.8:0/3193314012 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7fc414038820 0x7fc41403ace0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:15.643 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:15.130+0000 7fc430986700 1 --2- 172.21.15.8:0/3193314012 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc42c107560 0x7fc42c19ca00 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:15.643 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:15.130+0000 7fc430986700 1 -- 172.21.15.8:0/3193314012 >> 172.21.15.8:0/3193314012 conn(0x7fc42c100f70 msgr2=0x7fc42c101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:15.643 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:15.130+0000 7fc430986700 1 -- 172.21.15.8:0/3193314012 shutdown_connections 2023-12-17T11:56:15.643 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:15.130+0000 7fc430986700 1 -- 172.21.15.8:0/3193314012 wait complete. 2023-12-17T11:56:16.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:16 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/3193314012' entity='client.admin' 2023-12-17T11:56:16.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:16 smithi008 ceph-mon[36830]: from='mgr.14122 172.21.15.8:0/1995514219' entity='mgr.x' 2023-12-17T11:56:16.698 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.093+0000 7f4e7941e700 1 Processor -- start 2023-12-17T11:56:16.698 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.094+0000 7f4e7941e700 1 -- start start 2023-12-17T11:56:16.698 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.094+0000 7f4e7941e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e74106ac0 0x7f4e74106ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:16.698 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.094+0000 7f4e7941e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e741074b0 con 0x7f4e74106ac0 2023-12-17T11:56:16.698 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.094+0000 7f4e72ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e74106ac0 0x7f4e74106ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:16.698 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.094+0000 7f4e72ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e74106ac0 0x7f4e74106ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58416/0 (socket says 172.21.15.8:58416) 2023-12-17T11:56:16.698 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.094+0000 7f4e72ffd700 1 -- 172.21.15.8:0/612978607 learned_addr learned my addr 172.21.15.8:0/612978607 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:16.698 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.095+0000 7f4e72ffd700 1 -- 172.21.15.8:0/612978607 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e74107cc0 con 0x7f4e74106ac0 2023-12-17T11:56:16.699 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.095+0000 7f4e72ffd700 1 --2- 172.21.15.8:0/612978607 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e74106ac0 0x7f4e74106ee0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4e640098a0 tx=0x7f4e64009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15c870165d4c4200 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:16.699 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.095+0000 7f4e71ffb700 1 -- 172.21.15.8:0/612978607 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4e64004160 con 0x7f4e74106ac0 2023-12-17T11:56:16.699 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.095+0000 7f4e71ffb700 1 -- 172.21.15.8:0/612978607 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4e640042c0 con 0x7f4e74106ac0 2023-12-17T11:56:16.699 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.095+0000 7f4e71ffb700 1 -- 172.21.15.8:0/612978607 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4e640118e0 con 0x7f4e74106ac0 2023-12-17T11:56:16.699 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.096+0000 7f4e7941e700 1 -- 172.21.15.8:0/612978607 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e74106ac0 msgr2=0x7f4e74106ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:16.699 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.096+0000 7f4e7941e700 1 --2- 172.21.15.8:0/612978607 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e74106ac0 0x7f4e74106ee0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4e640098a0 tx=0x7f4e64009bb0 comp rx=0 tx=0).stop 2023-12-17T11:56:16.699 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.096+0000 7f4e7941e700 1 -- 172.21.15.8:0/612978607 shutdown_connections 2023-12-17T11:56:16.699 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.096+0000 7f4e7941e700 1 --2- 172.21.15.8:0/612978607 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e74106ac0 0x7f4e74106ee0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:16.699 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.096+0000 7f4e7941e700 1 -- 172.21.15.8:0/612978607 >> 172.21.15.8:0/612978607 conn(0x7f4e74102060 msgr2=0x7f4e741044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:16.699 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.096+0000 7f4e7941e700 1 -- 172.21.15.8:0/612978607 shutdown_connections 2023-12-17T11:56:16.699 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.096+0000 7f4e7941e700 1 -- 172.21.15.8:0/612978607 wait complete. 2023-12-17T11:56:16.699 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.098+0000 7f4e7941e700 1 Processor -- start 2023-12-17T11:56:16.699 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.098+0000 7f4e7941e700 1 -- start start 2023-12-17T11:56:16.699 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.098+0000 7f4e7941e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e74106ac0 0x7f4e7419ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:16.699 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.099+0000 7f4e7941e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7419cf70 con 0x7f4e74106ac0 2023-12-17T11:56:16.700 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.099+0000 7f4e72ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e74106ac0 0x7f4e7419ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:16.700 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.099+0000 7f4e72ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e74106ac0 0x7f4e7419ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58432/0 (socket says 172.21.15.8:58432) 2023-12-17T11:56:16.700 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.099+0000 7f4e72ffd700 1 -- 172.21.15.8:0/3404638724 learned_addr learned my addr 172.21.15.8:0/3404638724 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:16.700 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.099+0000 7f4e72ffd700 1 -- 172.21.15.8:0/3404638724 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e64009550 con 0x7f4e74106ac0 2023-12-17T11:56:16.700 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.099+0000 7f4e72ffd700 1 --2- 172.21.15.8:0/3404638724 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e74106ac0 0x7f4e7419ca30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4e64003f70 tx=0x7f4e640119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:16.700 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.100+0000 7f4e5bfff700 1 -- 172.21.15.8:0/3404638724 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4e640037d0 con 0x7f4e74106ac0 2023-12-17T11:56:16.700 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.100+0000 7f4e5bfff700 1 -- 172.21.15.8:0/3404638724 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4e6401b440 con 0x7f4e74106ac0 2023-12-17T11:56:16.700 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.100+0000 7f4e7941e700 1 -- 172.21.15.8:0/3404638724 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e7419d170 con 0x7f4e74106ac0 2023-12-17T11:56:16.700 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.100+0000 7f4e5bfff700 1 -- 172.21.15.8:0/3404638724 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4e640193d0 con 0x7f4e74106ac0 2023-12-17T11:56:16.700 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.100+0000 7f4e7941e700 1 -- 172.21.15.8:0/3404638724 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e7419d610 con 0x7f4e74106ac0 2023-12-17T11:56:16.700 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.101+0000 7f4e7941e700 1 -- 172.21.15.8:0/3404638724 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e7410aef0 con 0x7f4e74106ac0 2023-12-17T11:56:16.700 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.101+0000 7f4e5bfff700 1 -- 172.21.15.8:0/3404638724 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 45580+0+0 (secure 0 0 0) 0x7f4e64003930 con 0x7f4e74106ac0 2023-12-17T11:56:16.700 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.102+0000 7f4e5bfff700 1 --2- 172.21.15.8:0/3404638724 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f4e5c038870 0x7f4e5c03ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:16.700 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.102+0000 7f4e5bfff700 1 -- 172.21.15.8:0/3404638724 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f4e6404c610 con 0x7f4e74106ac0 2023-12-17T11:56:16.700 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.102+0000 7f4e727fc700 1 --2- 172.21.15.8:0/3404638724 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f4e5c038870 0x7f4e5c03ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:16.701 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.103+0000 7f4e727fc700 1 --2- 172.21.15.8:0/3404638724 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f4e5c038870 0x7f4e5c03ad30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4e68006fd0 tx=0x7f4e68006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:16.701 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.106+0000 7f4e5bfff700 1 -- 172.21.15.8:0/3404638724 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4e640186d0 con 0x7f4e74106ac0 2023-12-17T11:56:16.701 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.331+0000 7f4e7941e700 1 -- 172.21.15.8:0/3404638724 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f4e7419fea0 con 0x7f4e74106ac0 2023-12-17T11:56:16.701 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.334+0000 7f4e5bfff700 1 -- 172.21.15.8:0/3404638724 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f4e6401f0c0 con 0x7f4e74106ac0 2023-12-17T11:56:16.701 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.336+0000 7f4e7941e700 1 -- 172.21.15.8:0/3404638724 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f4e5c038870 msgr2=0x7f4e5c03ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:16.701 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.336+0000 7f4e7941e700 1 --2- 172.21.15.8:0/3404638724 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f4e5c038870 0x7f4e5c03ad30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f4e68006fd0 tx=0x7f4e68006e40 comp rx=0 tx=0).stop 2023-12-17T11:56:16.701 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.336+0000 7f4e7941e700 1 -- 172.21.15.8:0/3404638724 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e74106ac0 msgr2=0x7f4e7419ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:16.701 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.336+0000 7f4e7941e700 1 --2- 172.21.15.8:0/3404638724 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e74106ac0 0x7f4e7419ca30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4e64003f70 tx=0x7f4e640119a0 comp rx=0 tx=0).stop 2023-12-17T11:56:16.701 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.336+0000 7f4e7941e700 1 -- 172.21.15.8:0/3404638724 shutdown_connections 2023-12-17T11:56:16.701 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.336+0000 7f4e7941e700 1 --2- 172.21.15.8:0/3404638724 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f4e5c038870 0x7f4e5c03ad30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:16.701 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.336+0000 7f4e7941e700 1 --2- 172.21.15.8:0/3404638724 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e74106ac0 0x7f4e7419ca30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:16.701 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.336+0000 7f4e7941e700 1 -- 172.21.15.8:0/3404638724 >> 172.21.15.8:0/3404638724 conn(0x7f4e74102060 msgr2=0x7f4e74102ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:16.701 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.337+0000 7f4e7941e700 1 -- 172.21.15.8:0/3404638724 shutdown_connections 2023-12-17T11:56:16.701 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:16.337+0000 7f4e7941e700 1 -- 172.21.15.8:0/3404638724 wait complete. 2023-12-17T11:56:16.702 INFO:teuthology.orchestra.run.smithi008.stdout:Enabling the dashboard module... 2023-12-17T11:56:17.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:17 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/3404638724' entity='client.admin' 2023-12-17T11:56:17.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:17 smithi008 ceph-mon[36830]: from='mgr.14122 172.21.15.8:0/1995514219' entity='mgr.x' 2023-12-17T11:56:18.452 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:18 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/1637186635' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-12-17T11:56:18.709 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.159+0000 7f03a7822700 1 Processor -- start 2023-12-17T11:56:18.709 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.159+0000 7f03a7822700 1 -- start start 2023-12-17T11:56:18.709 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.160+0000 7f03a7822700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03a007ce40 0x7f03a007b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:18.709 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.160+0000 7f03a7822700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a007b870 con 0x7f03a007ce40 2023-12-17T11:56:18.709 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.160+0000 7f03a55be700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03a007ce40 0x7f03a007b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:18.709 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.160+0000 7f03a55be700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03a007ce40 0x7f03a007b2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58444/0 (socket says 172.21.15.8:58444) 2023-12-17T11:56:18.709 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.160+0000 7f03a55be700 1 -- 172.21.15.8:0/3911559334 learned_addr learned my addr 172.21.15.8:0/3911559334 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:18.709 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.161+0000 7f03a55be700 1 -- 172.21.15.8:0/3911559334 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a007b9b0 con 0x7f03a007ce40 2023-12-17T11:56:18.710 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.161+0000 7f03a55be700 1 --2- 172.21.15.8:0/3911559334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03a007ce40 0x7f03a007b2a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f039c0098a0 tx=0x7f039c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21ab38585953f745 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:18.710 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.161+0000 7f0397fff700 1 -- 172.21.15.8:0/3911559334 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f039c004160 con 0x7f03a007ce40 2023-12-17T11:56:18.710 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.161+0000 7f0397fff700 1 -- 172.21.15.8:0/3911559334 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f039c0042c0 con 0x7f03a007ce40 2023-12-17T11:56:18.710 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.161+0000 7f0397fff700 1 -- 172.21.15.8:0/3911559334 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f039c0118e0 con 0x7f03a007ce40 2023-12-17T11:56:18.710 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.162+0000 7f03a7822700 1 -- 172.21.15.8:0/3911559334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03a007ce40 msgr2=0x7f03a007b2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:18.710 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.162+0000 7f03a7822700 1 --2- 172.21.15.8:0/3911559334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03a007ce40 0x7f03a007b2a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f039c0098a0 tx=0x7f039c009bb0 comp rx=0 tx=0).stop 2023-12-17T11:56:18.710 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.162+0000 7f03a7822700 1 -- 172.21.15.8:0/3911559334 shutdown_connections 2023-12-17T11:56:18.710 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.162+0000 7f03a7822700 1 --2- 172.21.15.8:0/3911559334 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03a007ce40 0x7f03a007b2a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:18.710 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.162+0000 7f03a7822700 1 -- 172.21.15.8:0/3911559334 >> 172.21.15.8:0/3911559334 conn(0x7f03a0102030 msgr2=0x7f03a01044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:18.711 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.162+0000 7f03a7822700 1 -- 172.21.15.8:0/3911559334 shutdown_connections 2023-12-17T11:56:18.711 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.162+0000 7f03a7822700 1 -- 172.21.15.8:0/3911559334 wait complete. 2023-12-17T11:56:18.711 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.163+0000 7f03a7822700 1 Processor -- start 2023-12-17T11:56:18.711 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.164+0000 7f03a7822700 1 -- start start 2023-12-17T11:56:18.711 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.164+0000 7f03a7822700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03a007ce40 0x7f03a019ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:18.711 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.164+0000 7f03a7822700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a019cf40 con 0x7f03a007ce40 2023-12-17T11:56:18.711 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.164+0000 7f03a55be700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03a007ce40 0x7f03a019ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:18.711 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.164+0000 7f03a55be700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03a007ce40 0x7f03a019ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58458/0 (socket says 172.21.15.8:58458) 2023-12-17T11:56:18.711 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.164+0000 7f03a55be700 1 -- 172.21.15.8:0/1637186635 learned_addr learned my addr 172.21.15.8:0/1637186635 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:18.712 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.164+0000 7f03a55be700 1 -- 172.21.15.8:0/1637186635 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f039c009550 con 0x7f03a007ce40 2023-12-17T11:56:18.712 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.165+0000 7f03a55be700 1 --2- 172.21.15.8:0/1637186635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03a007ce40 0x7f03a019ca00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f039c0046e0 tx=0x7f039c0119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:18.712 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.165+0000 7f03967fc700 1 -- 172.21.15.8:0/1637186635 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f039c0037d0 con 0x7f03a007ce40 2023-12-17T11:56:18.712 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.165+0000 7f03967fc700 1 -- 172.21.15.8:0/1637186635 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f039c01b440 con 0x7f03a007ce40 2023-12-17T11:56:18.712 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.165+0000 7f03a7822700 1 -- 172.21.15.8:0/1637186635 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a019d140 con 0x7f03a007ce40 2023-12-17T11:56:18.712 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.165+0000 7f03967fc700 1 -- 172.21.15.8:0/1637186635 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f039c023400 con 0x7f03a007ce40 2023-12-17T11:56:18.712 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.165+0000 7f03a7822700 1 -- 172.21.15.8:0/1637186635 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a019d5e0 con 0x7f03a007ce40 2023-12-17T11:56:18.712 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.166+0000 7f03967fc700 1 -- 172.21.15.8:0/1637186635 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 8) v1 ==== 45580+0+0 (secure 0 0 0) 0x7f039c023630 con 0x7f03a007ce40 2023-12-17T11:56:18.712 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.166+0000 7f03a7822700 1 -- 172.21.15.8:0/1637186635 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03a010ce70 con 0x7f03a007ce40 2023-12-17T11:56:18.712 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.167+0000 7f03967fc700 1 --2- 172.21.15.8:0/1637186635 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f038c038870 0x7f038c03ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:18.712 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.167+0000 7f03967fc700 1 -- 172.21.15.8:0/1637186635 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f039c04c900 con 0x7f03a007ce40 2023-12-17T11:56:18.712 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.167+0000 7f03a4dbd700 1 --2- 172.21.15.8:0/1637186635 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f038c038870 0x7f038c03ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:18.712 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.168+0000 7f03a4dbd700 1 --2- 172.21.15.8:0/1637186635 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f038c038870 0x7f038c03ad30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0390006fd0 tx=0x7f0390006e40 comp rx=0 tx=0).ready entity=mgr.14122 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:18.712 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.172+0000 7f03967fc700 1 -- 172.21.15.8:0/1637186635 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f039c0238e0 con 0x7f03a007ce40 2023-12-17T11:56:18.712 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:17.441+0000 7f03a7822700 1 -- 172.21.15.8:0/1637186635 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f03a019fe70 con 0x7f03a007ce40 2023-12-17T11:56:18.713 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:18.338+0000 7f03967fc700 1 -- 172.21.15.8:0/1637186635 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f039c02bb40 con 0x7f03a007ce40 2023-12-17T11:56:18.713 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:18.341+0000 7f03967fc700 1 -- 172.21.15.8:0/1637186635 <== mon.0 v2:172.21.15.8:3300/0 8 ==== mgrmap(e 9) v1 ==== 45593+0+0 (secure 0 0 0) 0x7f039c02c770 con 0x7f03a007ce40 2023-12-17T11:56:18.713 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:18.342+0000 7f03a7822700 1 -- 172.21.15.8:0/1637186635 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f038c038870 msgr2=0x7f038c03ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:18.713 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:18.342+0000 7f03a7822700 1 --2- 172.21.15.8:0/1637186635 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f038c038870 0x7f038c03ad30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f0390006fd0 tx=0x7f0390006e40 comp rx=0 tx=0).stop 2023-12-17T11:56:18.713 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:18.342+0000 7f03a7822700 1 -- 172.21.15.8:0/1637186635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03a007ce40 msgr2=0x7f03a019ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:18.713 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:18.342+0000 7f03a7822700 1 --2- 172.21.15.8:0/1637186635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03a007ce40 0x7f03a019ca00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f039c0046e0 tx=0x7f039c0119a0 comp rx=0 tx=0).stop 2023-12-17T11:56:18.713 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:18.343+0000 7f03a7822700 1 -- 172.21.15.8:0/1637186635 shutdown_connections 2023-12-17T11:56:18.713 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:18.343+0000 7f03a7822700 1 --2- 172.21.15.8:0/1637186635 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f038c038870 0x7f038c03ad30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:18.713 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:18.343+0000 7f03a7822700 1 --2- 172.21.15.8:0/1637186635 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f03a007ce40 0x7f03a019ca00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:18.713 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:18.343+0000 7f03a7822700 1 -- 172.21.15.8:0/1637186635 >> 172.21.15.8:0/1637186635 conn(0x7f03a0102030 msgr2=0x7f03a0102cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:18.713 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:18.343+0000 7f03a7822700 1 -- 172.21.15.8:0/1637186635 shutdown_connections 2023-12-17T11:56:18.713 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:18.343+0000 7f03a7822700 1 -- 172.21.15.8:0/1637186635 wait complete. 2023-12-17T11:56:18.714 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:18 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: ignoring --setuser ceph since I am not root 2023-12-17T11:56:18.714 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:18 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: ignoring --setgroup ceph since I am not root 2023-12-17T11:56:19.244 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:18 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:56:18.990+0000 7f5c3fdf5200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-17T11:56:19.244 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:19 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:56:19.119+0000 7f5c3fdf5200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-17T11:56:19.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:19 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/1637186635' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-12-17T11:56:19.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:19 smithi008 ceph-mon[36830]: mgrmap e9: x(active, since 17s) 2023-12-17T11:56:19.496 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:19 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:56:19.241+0000 7f5c3fdf5200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-17T11:56:19.496 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:19 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:56:19.358+0000 7f5c3fdf5200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-17T11:56:19.745 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout { 2023-12-17T11:56:19.745 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-12-17T11:56:19.745 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "available": true, 2023-12-17T11:56:19.745 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-12-17T11:56:19.746 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-12-17T11:56:19.746 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout } 2023-12-17T11:56:19.746 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.130+0000 7f97551a0700 1 Processor -- start 2023-12-17T11:56:19.746 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.131+0000 7f97551a0700 1 -- start start 2023-12-17T11:56:19.746 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.131+0000 7f97551a0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f975007ce60 0x7f975007b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:19.746 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.131+0000 7f97551a0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975007b890 con 0x7f975007ce60 2023-12-17T11:56:19.746 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.131+0000 7f974ed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f975007ce60 0x7f975007b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:19.746 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.131+0000 7f974ed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f975007ce60 0x7f975007b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58484/0 (socket says 172.21.15.8:58484) 2023-12-17T11:56:19.746 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.131+0000 7f974ed9d700 1 -- 172.21.15.8:0/4116952675 learned_addr learned my addr 172.21.15.8:0/4116952675 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:19.746 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.132+0000 7f974ed9d700 1 -- 172.21.15.8:0/4116952675 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f975007b9d0 con 0x7f975007ce60 2023-12-17T11:56:19.746 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.132+0000 7f974ed9d700 1 --2- 172.21.15.8:0/4116952675 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f975007ce60 0x7f975007b2c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f97400098a0 tx=0x7f9740009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1d70692508855fe server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:19.746 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.132+0000 7f974dd9b700 1 -- 172.21.15.8:0/4116952675 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9740004160 con 0x7f975007ce60 2023-12-17T11:56:19.746 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.132+0000 7f974dd9b700 1 -- 172.21.15.8:0/4116952675 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f97400042c0 con 0x7f975007ce60 2023-12-17T11:56:19.747 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.132+0000 7f974dd9b700 1 -- 172.21.15.8:0/4116952675 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f97400118e0 con 0x7f975007ce60 2023-12-17T11:56:19.747 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.133+0000 7f97551a0700 1 -- 172.21.15.8:0/4116952675 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f975007ce60 msgr2=0x7f975007b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:19.747 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.133+0000 7f97551a0700 1 --2- 172.21.15.8:0/4116952675 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f975007ce60 0x7f975007b2c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f97400098a0 tx=0x7f9740009bb0 comp rx=0 tx=0).stop 2023-12-17T11:56:19.747 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.133+0000 7f97551a0700 1 -- 172.21.15.8:0/4116952675 shutdown_connections 2023-12-17T11:56:19.747 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.133+0000 7f97551a0700 1 --2- 172.21.15.8:0/4116952675 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f975007ce60 0x7f975007b2c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:19.747 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.133+0000 7f97551a0700 1 -- 172.21.15.8:0/4116952675 >> 172.21.15.8:0/4116952675 conn(0x7f9750102030 msgr2=0x7f97501044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:19.747 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.133+0000 7f97551a0700 1 -- 172.21.15.8:0/4116952675 shutdown_connections 2023-12-17T11:56:19.747 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.133+0000 7f97551a0700 1 -- 172.21.15.8:0/4116952675 wait complete. 2023-12-17T11:56:19.747 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.134+0000 7f97551a0700 1 Processor -- start 2023-12-17T11:56:19.747 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.134+0000 7f97551a0700 1 -- start start 2023-12-17T11:56:19.747 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.135+0000 7f97551a0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f975007ce60 0x7f975019c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:19.747 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.135+0000 7f97551a0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975019cf20 con 0x7f975007ce60 2023-12-17T11:56:19.747 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.135+0000 7f974ed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f975007ce60 0x7f975019c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:19.747 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.135+0000 7f974ed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f975007ce60 0x7f975019c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58494/0 (socket says 172.21.15.8:58494) 2023-12-17T11:56:19.747 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.135+0000 7f974ed9d700 1 -- 172.21.15.8:0/2980310140 learned_addr learned my addr 172.21.15.8:0/2980310140 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:19.748 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.135+0000 7f974ed9d700 1 -- 172.21.15.8:0/2980310140 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9740009550 con 0x7f975007ce60 2023-12-17T11:56:19.748 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.135+0000 7f974ed9d700 1 --2- 172.21.15.8:0/2980310140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f975007ce60 0x7f975019c9e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f97400046e0 tx=0x7f97400119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:19.748 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.136+0000 7f9737fff700 1 -- 172.21.15.8:0/2980310140 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f97400037d0 con 0x7f975007ce60 2023-12-17T11:56:19.748 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.136+0000 7f9737fff700 1 -- 172.21.15.8:0/2980310140 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f974001b440 con 0x7f975007ce60 2023-12-17T11:56:19.748 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.136+0000 7f97551a0700 1 -- 172.21.15.8:0/2980310140 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f975019d120 con 0x7f975007ce60 2023-12-17T11:56:19.748 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.136+0000 7f9737fff700 1 -- 172.21.15.8:0/2980310140 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9740023400 con 0x7f975007ce60 2023-12-17T11:56:19.748 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.136+0000 7f97551a0700 1 -- 172.21.15.8:0/2980310140 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f975019d5c0 con 0x7f975007ce60 2023-12-17T11:56:19.748 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.137+0000 7f9737fff700 1 -- 172.21.15.8:0/2980310140 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 9) v1 ==== 45593+0+0 (secure 0 0 0) 0x7f974001b840 con 0x7f975007ce60 2023-12-17T11:56:19.748 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.137+0000 7f97551a0700 1 -- 172.21.15.8:0/2980310140 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f975010ceb0 con 0x7f975007ce60 2023-12-17T11:56:19.748 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.138+0000 7f9737fff700 1 --2- 172.21.15.8:0/2980310140 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f9738038870 0x7f973803ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:19.748 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.138+0000 7f9737fff700 1 -- 172.21.15.8:0/2980310140 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f974004c770 con 0x7f975007ce60 2023-12-17T11:56:19.748 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.138+0000 7f974e59c700 1 -- 172.21.15.8:0/2980310140 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f9738038870 msgr2=0x7f973803ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/222068650 2023-12-17T11:56:19.748 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.138+0000 7f974e59c700 1 --2- 172.21.15.8:0/2980310140 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f9738038870 0x7f973803ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-17T11:56:19.748 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.142+0000 7f9737fff700 1 -- 172.21.15.8:0/2980310140 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f974002b760 con 0x7f975007ce60 2023-12-17T11:56:19.748 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.339+0000 7f974e59c700 1 -- 172.21.15.8:0/2980310140 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f9738038870 msgr2=0x7f973803ad30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/222068650 2023-12-17T11:56:19.749 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.339+0000 7f974e59c700 1 --2- 172.21.15.8:0/2980310140 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f9738038870 0x7f973803ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-17T11:56:19.749 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.411+0000 7f97551a0700 1 -- 172.21.15.8:0/2980310140 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f975019fe50 con 0x7f975007ce60 2023-12-17T11:56:19.749 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.412+0000 7f9737fff700 1 -- 172.21.15.8:0/2980310140 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7f974000b3e0 con 0x7f975007ce60 2023-12-17T11:56:19.749 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.414+0000 7f97551a0700 1 -- 172.21.15.8:0/2980310140 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f9738038870 msgr2=0x7f973803ad30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-17T11:56:19.749 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.414+0000 7f97551a0700 1 --2- 172.21.15.8:0/2980310140 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f9738038870 0x7f973803ad30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:19.749 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.414+0000 7f97551a0700 1 -- 172.21.15.8:0/2980310140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f975007ce60 msgr2=0x7f975019c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:19.749 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.414+0000 7f97551a0700 1 --2- 172.21.15.8:0/2980310140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f975007ce60 0x7f975019c9e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f97400046e0 tx=0x7f97400119a0 comp rx=0 tx=0).stop 2023-12-17T11:56:19.749 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.414+0000 7f97551a0700 1 -- 172.21.15.8:0/2980310140 shutdown_connections 2023-12-17T11:56:19.749 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.414+0000 7f97551a0700 1 --2- 172.21.15.8:0/2980310140 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f9738038870 0x7f973803ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:19.749 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.414+0000 7f97551a0700 1 --2- 172.21.15.8:0/2980310140 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f975007ce60 0x7f975019c9e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:19.749 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.414+0000 7f97551a0700 1 -- 172.21.15.8:0/2980310140 >> 172.21.15.8:0/2980310140 conn(0x7f9750102030 msgr2=0x7f9750102c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:19.749 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.414+0000 7f97551a0700 1 -- 172.21.15.8:0/2980310140 shutdown_connections 2023-12-17T11:56:19.749 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:19.414+0000 7f97551a0700 1 -- 172.21.15.8:0/2980310140 wait complete. 2023-12-17T11:56:19.750 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for the mgr to restart... 2023-12-17T11:56:19.750 INFO:teuthology.orchestra.run.smithi008.stdout:Waiting for mgr epoch 9... 2023-12-17T11:56:20.569 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:20 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/2980310140' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-12-17T11:56:20.569 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:20 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:56:20.254+0000 7f5c3fdf5200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-17T11:56:20.830 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:20 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:56:20.566+0000 7f5c3fdf5200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-17T11:56:20.831 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:20 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:56:20.682+0000 7f5c3fdf5200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-17T11:56:21.207 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:20 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:56:20.826+0000 7f5c3fdf5200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-17T11:56:21.207 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:21 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:56:21.027+0000 7f5c3fdf5200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-17T11:56:21.495 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:21 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:56:21.204+0000 7f5c3fdf5200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-17T11:56:21.495 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:21 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:56:21.322+0000 7f5c3fdf5200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-17T11:56:22.181 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:21 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:56:21.812+0000 7f5c3fdf5200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-17T11:56:22.495 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:22 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:56:22.179+0000 7f5c3fdf5200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-17T11:56:22.995 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:22 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:56:22.550+0000 7f5c3fdf5200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-17T11:56:22.995 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:22 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:56:22.682+0000 7f5c3fdf5200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-17T11:56:23.995 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:23 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:56:23.694+0000 7f5c3fdf5200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-17T11:56:23.995 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:23 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:56:23.823+0000 7f5c3fdf5200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-17T11:56:24.495 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:24 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:56:24.032+0000 7f5c3fdf5200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-17T11:56:25.147 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:24 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:56:24.894+0000 7f5c3fdf5200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-17T11:56:25.413 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:25 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:56:25.144+0000 7f5c3fdf5200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-17T11:56:25.745 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:25 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:56:25.411+0000 7f5c3fdf5200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-17T11:56:26.971 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:26 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:56:26.595+0000 7f5c3fdf5200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-17T11:56:27.245 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:26 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:56:26.968+0000 7f5c3fdf5200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-17T11:56:27.245 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:27 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:56:27.092+0000 7f5c3fdf5200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-17T11:56:27.745 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:56:27 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:56:27.359+0000 7f5c3fdf5200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-17T11:56:27.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:27 smithi008 ceph-mon[36830]: Active manager daemon x restarted 2023-12-17T11:56:27.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:27 smithi008 ceph-mon[36830]: Activating manager daemon x 2023-12-17T11:56:27.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:27 smithi008 ceph-mon[36830]: osdmap e3: 0 total, 0 up, 0 in 2023-12-17T11:56:27.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:27 smithi008 ceph-mon[36830]: mgrmap e10: x(active, starting, since 0.00381226s) 2023-12-17T11:56:27.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-17T11:56:27.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-12-17T11:56:27.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-12-17T11:56:27.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-12-17T11:56:27.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-12-17T11:56:27.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:27 smithi008 ceph-mon[36830]: Manager daemon x is now available 2023-12-17T11:56:27.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:56:27.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:56:28.688 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:28 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-12-17T11:56:28.689 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:28 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-12-17T11:56:28.689 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:28 smithi008 ceph-mon[36830]: mgrmap e11: x(active, since 1.00788s) 2023-12-17T11:56:28.833 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout { 2023-12-17T11:56:28.833 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-12-17T11:56:28.833 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout "initialized": true 2023-12-17T11:56:28.833 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout } 2023-12-17T11:56:28.833 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.214+0000 7f442c490700 1 Processor -- start 2023-12-17T11:56:28.833 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.215+0000 7f442c490700 1 -- start start 2023-12-17T11:56:28.833 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.215+0000 7f442c490700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f442407ce80 0x7f442407b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:28.833 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.215+0000 7f442c490700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442407b8b0 con 0x7f442407ce80 2023-12-17T11:56:28.833 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.215+0000 7f442a22c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f442407ce80 0x7f442407b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:28.833 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.216+0000 7f442a22c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f442407ce80 0x7f442407b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58496/0 (socket says 172.21.15.8:58496) 2023-12-17T11:56:28.833 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.216+0000 7f442a22c700 1 -- 172.21.15.8:0/4292789263 learned_addr learned my addr 172.21.15.8:0/4292789263 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:28.834 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.216+0000 7f442a22c700 1 -- 172.21.15.8:0/4292789263 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f442407b9f0 con 0x7f442407ce80 2023-12-17T11:56:28.834 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.216+0000 7f442a22c700 1 --2- 172.21.15.8:0/4292789263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f442407ce80 0x7f442407b2e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f44200098a0 tx=0x7f4420009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1180cbca7783dba4 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:28.834 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.216+0000 7f442922a700 1 -- 172.21.15.8:0/4292789263 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4420004160 con 0x7f442407ce80 2023-12-17T11:56:28.834 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.216+0000 7f442922a700 1 -- 172.21.15.8:0/4292789263 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f44200042c0 con 0x7f442407ce80 2023-12-17T11:56:28.834 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.216+0000 7f442922a700 1 -- 172.21.15.8:0/4292789263 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f44200118e0 con 0x7f442407ce80 2023-12-17T11:56:28.834 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.217+0000 7f442c490700 1 -- 172.21.15.8:0/4292789263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f442407ce80 msgr2=0x7f442407b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:28.834 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.217+0000 7f442c490700 1 --2- 172.21.15.8:0/4292789263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f442407ce80 0x7f442407b2e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f44200098a0 tx=0x7f4420009bb0 comp rx=0 tx=0).stop 2023-12-17T11:56:28.834 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.217+0000 7f442c490700 1 -- 172.21.15.8:0/4292789263 shutdown_connections 2023-12-17T11:56:28.834 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.217+0000 7f442c490700 1 --2- 172.21.15.8:0/4292789263 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f442407ce80 0x7f442407b2e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:28.834 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.217+0000 7f442c490700 1 -- 172.21.15.8:0/4292789263 >> 172.21.15.8:0/4292789263 conn(0x7f4424102030 msgr2=0x7f44241044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:28.834 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.217+0000 7f442c490700 1 -- 172.21.15.8:0/4292789263 shutdown_connections 2023-12-17T11:56:28.834 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.217+0000 7f442c490700 1 -- 172.21.15.8:0/4292789263 wait complete. 2023-12-17T11:56:28.834 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.219+0000 7f442c490700 1 Processor -- start 2023-12-17T11:56:28.834 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.219+0000 7f442c490700 1 -- start start 2023-12-17T11:56:28.835 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.219+0000 7f442c490700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f442407ce80 0x7f442419ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:28.835 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.219+0000 7f442c490700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442419cf70 con 0x7f442407ce80 2023-12-17T11:56:28.835 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.220+0000 7f442a22c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f442407ce80 0x7f442419ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:28.835 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.220+0000 7f442a22c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f442407ce80 0x7f442419ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:58504/0 (socket says 172.21.15.8:58504) 2023-12-17T11:56:28.835 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.220+0000 7f442a22c700 1 -- 172.21.15.8:0/1922549718 learned_addr learned my addr 172.21.15.8:0/1922549718 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:28.835 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.220+0000 7f442a22c700 1 -- 172.21.15.8:0/1922549718 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4420009550 con 0x7f442407ce80 2023-12-17T11:56:28.835 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.220+0000 7f442a22c700 1 --2- 172.21.15.8:0/1922549718 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f442407ce80 0x7f442419ca30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4420003e30 tx=0x7f4420011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:28.835 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.221+0000 7f441b7fe700 1 -- 172.21.15.8:0/1922549718 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f44200036a0 con 0x7f442407ce80 2023-12-17T11:56:28.835 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.221+0000 7f441b7fe700 1 -- 172.21.15.8:0/1922549718 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f442001b440 con 0x7f442407ce80 2023-12-17T11:56:28.835 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.221+0000 7f442c490700 1 -- 172.21.15.8:0/1922549718 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f442419d170 con 0x7f442407ce80 2023-12-17T11:56:28.835 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.221+0000 7f441b7fe700 1 -- 172.21.15.8:0/1922549718 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f44200193d0 con 0x7f442407ce80 2023-12-17T11:56:28.835 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.221+0000 7f442c490700 1 -- 172.21.15.8:0/1922549718 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f442419d610 con 0x7f442407ce80 2023-12-17T11:56:28.835 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.223+0000 7f441b7fe700 1 -- 172.21.15.8:0/1922549718 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 9) v1 ==== 45593+0+0 (secure 0 0 0) 0x7f4420003800 con 0x7f442407ce80 2023-12-17T11:56:28.835 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.223+0000 7f441b7fe700 1 --2- 172.21.15.8:0/1922549718 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f4410038820 0x7f441003ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:28.836 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.223+0000 7f441b7fe700 1 -- 172.21.15.8:0/1922549718 --> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f441003b3f0 con 0x7f4410038820 2023-12-17T11:56:28.836 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.223+0000 7f441b7fe700 1 -- 172.21.15.8:0/1922549718 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f442004c770 con 0x7f442407ce80 2023-12-17T11:56:28.836 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.223+0000 7f4429a2b700 1 -- 172.21.15.8:0/1922549718 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f4410038820 msgr2=0x7f441003ace0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/222068650 2023-12-17T11:56:28.836 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.223+0000 7f4429a2b700 1 --2- 172.21.15.8:0/1922549718 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f4410038820 0x7f441003ace0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-17T11:56:28.836 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.424+0000 7f4429a2b700 1 -- 172.21.15.8:0/1922549718 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f4410038820 msgr2=0x7f441003ace0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/222068650 2023-12-17T11:56:28.836 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.424+0000 7f4429a2b700 1 --2- 172.21.15.8:0/1922549718 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f4410038820 0x7f441003ace0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-17T11:56:28.836 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.825+0000 7f4429a2b700 1 -- 172.21.15.8:0/1922549718 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f4410038820 msgr2=0x7f441003ace0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/222068650 2023-12-17T11:56:28.836 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:20.825+0000 7f4429a2b700 1 --2- 172.21.15.8:0/1922549718 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f4410038820 0x7f441003ace0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-12-17T11:56:28.836 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:21.626+0000 7f4429a2b700 1 -- 172.21.15.8:0/1922549718 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f4410038820 msgr2=0x7f441003ace0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/222068650 2023-12-17T11:56:28.836 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:21.626+0000 7f4429a2b700 1 --2- 172.21.15.8:0/1922549718 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f4410038820 0x7f441003ace0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-12-17T11:56:28.836 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:23.227+0000 7f4429a2b700 1 -- 172.21.15.8:0/1922549718 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f4410038820 msgr2=0x7f441003ace0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/222068650 2023-12-17T11:56:28.836 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:23.228+0000 7f4429a2b700 1 --2- 172.21.15.8:0/1922549718 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f4410038820 0x7f441003ace0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-12-17T11:56:28.836 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:26.431+0000 7f4429a2b700 1 -- 172.21.15.8:0/1922549718 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f4410038820 msgr2=0x7f441003ace0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.8:6800/222068650 2023-12-17T11:56:28.837 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:26.431+0000 7f4429a2b700 1 --2- 172.21.15.8:0/1922549718 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f4410038820 0x7f441003ace0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2023-12-17T11:56:28.837 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:27.363+0000 7f441b7fe700 1 -- 172.21.15.8:0/1922549718 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mgrmap(e 10) v1 ==== 45360+0+0 (secure 0 0 0) 0x7f4420020d60 con 0x7f442407ce80 2023-12-17T11:56:28.837 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:27.363+0000 7f441b7fe700 1 -- 172.21.15.8:0/1922549718 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f4410038820 msgr2=0x7f441003ace0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-17T11:56:28.837 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:27.363+0000 7f441b7fe700 1 --2- 172.21.15.8:0/1922549718 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f4410038820 0x7f441003ace0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:28.837 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:28.366+0000 7f441b7fe700 1 -- 172.21.15.8:0/1922549718 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mgrmap(e 11) v1 ==== 45487+0+0 (secure 0 0 0) 0x7f442004e360 con 0x7f442407ce80 2023-12-17T11:56:28.837 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:28.366+0000 7f441b7fe700 1 --2- 172.21.15.8:0/1922549718 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f441003c290 0x7f441003e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:28.837 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:28.366+0000 7f441b7fe700 1 -- 172.21.15.8:0/1922549718 --> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f441003b3f0 con 0x7f441003c290 2023-12-17T11:56:28.837 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:28.366+0000 7f4429a2b700 1 --2- 172.21.15.8:0/1922549718 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f441003c290 0x7f441003e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:28.837 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:28.367+0000 7f4429a2b700 1 --2- 172.21.15.8:0/1922549718 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f441003c290 0x7f441003e680 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4414003a10 tx=0x7f44140092b0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:28.837 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:28.368+0000 7f441b7fe700 1 -- 172.21.15.8:0/1922549718 <== mgr.14154 v2:172.21.15.8:6800/268548699 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+7774 (secure 0 0 0) 0x7f441003b3f0 con 0x7f441003c290 2023-12-17T11:56:28.837 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:28.376+0000 7f442c490700 1 -- 172.21.15.8:0/1922549718 --> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f442410ce90 con 0x7f441003c290 2023-12-17T11:56:28.837 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:28.376+0000 7f441b7fe700 1 -- 172.21.15.8:0/1922549718 <== mgr.14154 v2:172.21.15.8:6800/268548699 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f442410ce90 con 0x7f441003c290 2023-12-17T11:56:28.837 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:28.376+0000 7f442c490700 1 -- 172.21.15.8:0/1922549718 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f441003c290 msgr2=0x7f441003e680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:28.838 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:28.376+0000 7f442c490700 1 --2- 172.21.15.8:0/1922549718 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f441003c290 0x7f441003e680 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4414003a10 tx=0x7f44140092b0 comp rx=0 tx=0).stop 2023-12-17T11:56:28.838 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:28.376+0000 7f442c490700 1 -- 172.21.15.8:0/1922549718 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f442407ce80 msgr2=0x7f442419ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:28.838 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:28.376+0000 7f442c490700 1 --2- 172.21.15.8:0/1922549718 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f442407ce80 0x7f442419ca30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f4420003e30 tx=0x7f4420011e80 comp rx=0 tx=0).stop 2023-12-17T11:56:28.838 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:28.377+0000 7f442c490700 1 -- 172.21.15.8:0/1922549718 shutdown_connections 2023-12-17T11:56:28.838 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:28.377+0000 7f442c490700 1 --2- 172.21.15.8:0/1922549718 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f441003c290 0x7f441003e680 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:28.838 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:28.377+0000 7f442c490700 1 --2- 172.21.15.8:0/1922549718 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f442407ce80 0x7f442419ca30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:28.838 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:28.377+0000 7f442c490700 1 --2- 172.21.15.8:0/1922549718 >> [v2:172.21.15.8:6800/222068650,v1:172.21.15.8:6801/222068650] conn(0x7f4410038820 0x7f441003ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:28.838 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:28.377+0000 7f442c490700 1 -- 172.21.15.8:0/1922549718 >> 172.21.15.8:0/1922549718 conn(0x7f4424102030 msgr2=0x7f4424102c80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:28.838 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:28.377+0000 7f442c490700 1 -- 172.21.15.8:0/1922549718 shutdown_connections 2023-12-17T11:56:28.838 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:28.377+0000 7f442c490700 1 -- 172.21.15.8:0/1922549718 wait complete. 2023-12-17T11:56:28.838 INFO:teuthology.orchestra.run.smithi008.stdout:mgr epoch 9 is available 2023-12-17T11:56:28.838 INFO:teuthology.orchestra.run.smithi008.stdout:Generating a dashboard self-signed certificate... 2023-12-17T11:56:29.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:29 smithi008 ceph-mon[36830]: [17/Dec/2023:11:56:28] ENGINE Bus STARTING 2023-12-17T11:56:29.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:29 smithi008 ceph-mon[36830]: from='client.14158 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-12-17T11:56:29.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:29 smithi008 ceph-mon[36830]: from='client.14158 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-12-17T11:56:29.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:29 smithi008 ceph-mon[36830]: [17/Dec/2023:11:56:28] ENGINE Serving on https://172.21.15.8:7150 2023-12-17T11:56:29.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:29 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:56:29.970 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-12-17T11:56:29.971 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.260+0000 7f579823e700 1 Processor -- start 2023-12-17T11:56:29.971 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.261+0000 7f579823e700 1 -- start start 2023-12-17T11:56:29.971 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.261+0000 7f579823e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f579007ce60 0x7f579007b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:29.971 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.261+0000 7f579823e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579007b890 con 0x7f579007ce60 2023-12-17T11:56:29.971 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.261+0000 7f5795fda700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f579007ce60 0x7f579007b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:29.971 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.261+0000 7f5795fda700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f579007ce60 0x7f579007b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50166/0 (socket says 172.21.15.8:50166) 2023-12-17T11:56:29.971 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.261+0000 7f5795fda700 1 -- 172.21.15.8:0/2694556689 learned_addr learned my addr 172.21.15.8:0/2694556689 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:29.971 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.262+0000 7f5795fda700 1 -- 172.21.15.8:0/2694556689 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579007b9d0 con 0x7f579007ce60 2023-12-17T11:56:29.971 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.262+0000 7f5795fda700 1 --2- 172.21.15.8:0/2694556689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f579007ce60 0x7f579007b2c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f578c0098a0 tx=0x7f578c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b58a627b4a68719b server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:29.971 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.262+0000 7f5794fd8700 1 -- 172.21.15.8:0/2694556689 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f578c004160 con 0x7f579007ce60 2023-12-17T11:56:29.971 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.262+0000 7f5794fd8700 1 -- 172.21.15.8:0/2694556689 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f578c0042c0 con 0x7f579007ce60 2023-12-17T11:56:29.971 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.262+0000 7f5794fd8700 1 -- 172.21.15.8:0/2694556689 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f578c0118e0 con 0x7f579007ce60 2023-12-17T11:56:29.971 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.263+0000 7f579823e700 1 -- 172.21.15.8:0/2694556689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f579007ce60 msgr2=0x7f579007b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:29.972 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.263+0000 7f579823e700 1 --2- 172.21.15.8:0/2694556689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f579007ce60 0x7f579007b2c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f578c0098a0 tx=0x7f578c009bb0 comp rx=0 tx=0).stop 2023-12-17T11:56:29.972 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.263+0000 7f579823e700 1 -- 172.21.15.8:0/2694556689 shutdown_connections 2023-12-17T11:56:29.972 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.263+0000 7f579823e700 1 --2- 172.21.15.8:0/2694556689 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f579007ce60 0x7f579007b2c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:29.972 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.263+0000 7f579823e700 1 -- 172.21.15.8:0/2694556689 >> 172.21.15.8:0/2694556689 conn(0x7f5790102030 msgr2=0x7f57901044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:29.972 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.263+0000 7f579823e700 1 -- 172.21.15.8:0/2694556689 shutdown_connections 2023-12-17T11:56:29.972 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.263+0000 7f579823e700 1 -- 172.21.15.8:0/2694556689 wait complete. 2023-12-17T11:56:29.972 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.264+0000 7f579823e700 1 Processor -- start 2023-12-17T11:56:29.972 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.265+0000 7f579823e700 1 -- start start 2023-12-17T11:56:29.972 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.265+0000 7f579823e700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f579007ce60 0x7f579019c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:29.972 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.265+0000 7f579823e700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579019cf20 con 0x7f579007ce60 2023-12-17T11:56:29.972 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.265+0000 7f5795fda700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f579007ce60 0x7f579019c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:29.972 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.265+0000 7f5795fda700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f579007ce60 0x7f579019c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50172/0 (socket says 172.21.15.8:50172) 2023-12-17T11:56:29.972 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.265+0000 7f5795fda700 1 -- 172.21.15.8:0/1403200833 learned_addr learned my addr 172.21.15.8:0/1403200833 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:29.973 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.265+0000 7f5795fda700 1 -- 172.21.15.8:0/1403200833 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f578c009550 con 0x7f579007ce60 2023-12-17T11:56:29.973 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.266+0000 7f5795fda700 1 --2- 172.21.15.8:0/1403200833 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f579007ce60 0x7f579019c9e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f578c003e30 tx=0x7f578c011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:29.973 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.266+0000 7f5786ffd700 1 -- 172.21.15.8:0/1403200833 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f578c0036a0 con 0x7f579007ce60 2023-12-17T11:56:29.973 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.266+0000 7f5786ffd700 1 -- 172.21.15.8:0/1403200833 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f578c01b440 con 0x7f579007ce60 2023-12-17T11:56:29.973 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.266+0000 7f579823e700 1 -- 172.21.15.8:0/1403200833 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f579019d120 con 0x7f579007ce60 2023-12-17T11:56:29.973 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.266+0000 7f5786ffd700 1 -- 172.21.15.8:0/1403200833 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f578c0193d0 con 0x7f579007ce60 2023-12-17T11:56:29.973 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.266+0000 7f579823e700 1 -- 172.21.15.8:0/1403200833 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f579019d5c0 con 0x7f579007ce60 2023-12-17T11:56:29.973 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.267+0000 7f579823e700 1 -- 172.21.15.8:0/1403200833 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f579010ceb0 con 0x7f579007ce60 2023-12-17T11:56:29.973 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.268+0000 7f5786ffd700 1 -- 172.21.15.8:0/1403200833 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 11) v1 ==== 45487+0+0 (secure 0 0 0) 0x7f578c003800 con 0x7f579007ce60 2023-12-17T11:56:29.973 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.268+0000 7f5786ffd700 1 --2- 172.21.15.8:0/1403200833 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f577c0386e0 0x7f577c03aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:29.973 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.268+0000 7f5786ffd700 1 -- 172.21.15.8:0/1403200833 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f578c04c5f0 con 0x7f579007ce60 2023-12-17T11:56:29.973 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.269+0000 7f57957d9700 1 --2- 172.21.15.8:0/1403200833 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f577c0386e0 0x7f577c03aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:29.973 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.269+0000 7f57957d9700 1 --2- 172.21.15.8:0/1403200833 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f577c0386e0 0x7f577c03aba0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5780006fd0 tx=0x7f5780006e40 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:29.974 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.274+0000 7f5786ffd700 1 -- 172.21.15.8:0/1403200833 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f578c02bb40 con 0x7f579007ce60 2023-12-17T11:56:29.974 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.512+0000 7f579823e700 1 -- 172.21.15.8:0/1403200833 --> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f579019fe50 con 0x7f577c0386e0 2023-12-17T11:56:29.974 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.626+0000 7f5786ffd700 1 -- 172.21.15.8:0/1403200833 <== mgr.14154 v2:172.21.15.8:6800/268548699 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f579019fe50 con 0x7f577c0386e0 2023-12-17T11:56:29.974 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.629+0000 7f579823e700 1 -- 172.21.15.8:0/1403200833 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f577c0386e0 msgr2=0x7f577c03aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:29.974 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.629+0000 7f579823e700 1 --2- 172.21.15.8:0/1403200833 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f577c0386e0 0x7f577c03aba0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f5780006fd0 tx=0x7f5780006e40 comp rx=0 tx=0).stop 2023-12-17T11:56:29.974 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.629+0000 7f579823e700 1 -- 172.21.15.8:0/1403200833 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f579007ce60 msgr2=0x7f579019c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:29.974 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.629+0000 7f579823e700 1 --2- 172.21.15.8:0/1403200833 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f579007ce60 0x7f579019c9e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f578c003e30 tx=0x7f578c011e80 comp rx=0 tx=0).stop 2023-12-17T11:56:29.974 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.629+0000 7f579823e700 1 -- 172.21.15.8:0/1403200833 shutdown_connections 2023-12-17T11:56:29.974 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.629+0000 7f579823e700 1 --2- 172.21.15.8:0/1403200833 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f577c0386e0 0x7f577c03aba0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:29.974 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.629+0000 7f579823e700 1 --2- 172.21.15.8:0/1403200833 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f579007ce60 0x7f579019c9e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:29.974 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.629+0000 7f579823e700 1 -- 172.21.15.8:0/1403200833 >> 172.21.15.8:0/1403200833 conn(0x7f5790102030 msgr2=0x7f5790102c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:29.974 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.629+0000 7f579823e700 1 -- 172.21.15.8:0/1403200833 shutdown_connections 2023-12-17T11:56:29.974 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:29.629+0000 7f579823e700 1 -- 172.21.15.8:0/1403200833 wait complete. 2023-12-17T11:56:29.974 INFO:teuthology.orchestra.run.smithi008.stdout:Creating initial admin user... 2023-12-17T11:56:30.741 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:30 smithi008 ceph-mon[36830]: [17/Dec/2023:11:56:28] ENGINE Serving on http://172.21.15.8:8765 2023-12-17T11:56:30.741 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:30 smithi008 ceph-mon[36830]: [17/Dec/2023:11:56:28] ENGINE Bus STARTED 2023-12-17T11:56:30.741 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:30 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:56:30.741 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:30 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:56:30.741 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:30 smithi008 ceph-mon[36830]: mgrmap e12: x(active, since 2s) 2023-12-17T11:56:30.741 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:30 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:56:31.563 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$Glit2MwihGGTgjE8p3joRuAlevDUX0Y0k0hJABng9spRVQfOxOkfu", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1702814190, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-12-17T11:56:31.563 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.419+0000 7efe2cf25700 1 Processor -- start 2023-12-17T11:56:31.563 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.419+0000 7efe2cf25700 1 -- start start 2023-12-17T11:56:31.563 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.419+0000 7efe2cf25700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe28106ad0 0x7efe28106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:31.563 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.419+0000 7efe2cf25700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe281074c0 con 0x7efe28106ad0 2023-12-17T11:56:31.564 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.420+0000 7efe2659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe28106ad0 0x7efe28106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:31.564 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.420+0000 7efe2659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe28106ad0 0x7efe28106ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50180/0 (socket says 172.21.15.8:50180) 2023-12-17T11:56:31.564 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.420+0000 7efe2659c700 1 -- 172.21.15.8:0/2491832806 learned_addr learned my addr 172.21.15.8:0/2491832806 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:31.564 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.420+0000 7efe2659c700 1 -- 172.21.15.8:0/2491832806 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe28107cd0 con 0x7efe28106ad0 2023-12-17T11:56:31.564 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.420+0000 7efe2659c700 1 --2- 172.21.15.8:0/2491832806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe28106ad0 0x7efe28106ef0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efe180098a0 tx=0x7efe18009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca64f6b7ab7297a3 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:31.564 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.420+0000 7efe2559a700 1 -- 172.21.15.8:0/2491832806 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efe18004160 con 0x7efe28106ad0 2023-12-17T11:56:31.564 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.421+0000 7efe2559a700 1 -- 172.21.15.8:0/2491832806 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efe180042c0 con 0x7efe28106ad0 2023-12-17T11:56:31.564 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.421+0000 7efe2559a700 1 -- 172.21.15.8:0/2491832806 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efe180118e0 con 0x7efe28106ad0 2023-12-17T11:56:31.564 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.421+0000 7efe2cf25700 1 -- 172.21.15.8:0/2491832806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe28106ad0 msgr2=0x7efe28106ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:31.564 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.421+0000 7efe2cf25700 1 --2- 172.21.15.8:0/2491832806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe28106ad0 0x7efe28106ef0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7efe180098a0 tx=0x7efe18009bb0 comp rx=0 tx=0).stop 2023-12-17T11:56:31.564 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.421+0000 7efe2cf25700 1 -- 172.21.15.8:0/2491832806 shutdown_connections 2023-12-17T11:56:31.564 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.421+0000 7efe2cf25700 1 --2- 172.21.15.8:0/2491832806 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe28106ad0 0x7efe28106ef0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:31.564 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.421+0000 7efe2cf25700 1 -- 172.21.15.8:0/2491832806 >> 172.21.15.8:0/2491832806 conn(0x7efe28102030 msgr2=0x7efe281044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:31.564 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.421+0000 7efe2cf25700 1 -- 172.21.15.8:0/2491832806 shutdown_connections 2023-12-17T11:56:31.565 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.422+0000 7efe2cf25700 1 -- 172.21.15.8:0/2491832806 wait complete. 2023-12-17T11:56:31.565 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.423+0000 7efe2cf25700 1 Processor -- start 2023-12-17T11:56:31.565 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.423+0000 7efe2cf25700 1 -- start start 2023-12-17T11:56:31.565 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.423+0000 7efe2cf25700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe28106ad0 0x7efe2819ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:31.565 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.423+0000 7efe2cf25700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2819cf80 con 0x7efe28106ad0 2023-12-17T11:56:31.565 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.423+0000 7efe2659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe28106ad0 0x7efe2819ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:31.565 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.423+0000 7efe2659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe28106ad0 0x7efe2819ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50190/0 (socket says 172.21.15.8:50190) 2023-12-17T11:56:31.565 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.423+0000 7efe2659c700 1 -- 172.21.15.8:0/2601381031 learned_addr learned my addr 172.21.15.8:0/2601381031 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:31.565 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.424+0000 7efe2659c700 1 -- 172.21.15.8:0/2601381031 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe18009550 con 0x7efe28106ad0 2023-12-17T11:56:31.565 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.424+0000 7efe2659c700 1 --2- 172.21.15.8:0/2601381031 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe28106ad0 0x7efe2819ca40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efe18003f70 tx=0x7efe180119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:31.565 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.424+0000 7efe177fe700 1 -- 172.21.15.8:0/2601381031 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efe180037d0 con 0x7efe28106ad0 2023-12-17T11:56:31.565 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.424+0000 7efe177fe700 1 -- 172.21.15.8:0/2601381031 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efe1801b440 con 0x7efe28106ad0 2023-12-17T11:56:31.565 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.424+0000 7efe2cf25700 1 -- 172.21.15.8:0/2601381031 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe2819d180 con 0x7efe28106ad0 2023-12-17T11:56:31.565 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.424+0000 7efe177fe700 1 -- 172.21.15.8:0/2601381031 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7efe180193d0 con 0x7efe28106ad0 2023-12-17T11:56:31.566 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.424+0000 7efe2cf25700 1 -- 172.21.15.8:0/2601381031 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe2819d620 con 0x7efe28106ad0 2023-12-17T11:56:31.566 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.426+0000 7efe177fe700 1 -- 172.21.15.8:0/2601381031 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 12) v1 ==== 45593+0+0 (secure 0 0 0) 0x7efe18003930 con 0x7efe28106ad0 2023-12-17T11:56:31.566 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.426+0000 7efe2cf25700 1 -- 172.21.15.8:0/2601381031 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe2810af00 con 0x7efe28106ad0 2023-12-17T11:56:31.566 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.426+0000 7efe177fe700 1 --2- 172.21.15.8:0/2601381031 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7efe10038870 0x7efe1003ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:31.566 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.426+0000 7efe177fe700 1 -- 172.21.15.8:0/2601381031 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7efe1804c830 con 0x7efe28106ad0 2023-12-17T11:56:31.566 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.426+0000 7efe25d9b700 1 --2- 172.21.15.8:0/2601381031 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7efe10038870 0x7efe1003ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:31.566 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.427+0000 7efe25d9b700 1 --2- 172.21.15.8:0/2601381031 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7efe10038870 0x7efe1003ad30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efe1c006fd0 tx=0x7efe1c006e40 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:31.566 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.432+0000 7efe177fe700 1 -- 172.21.15.8:0/2601381031 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7efe18018530 con 0x7efe28106ad0 2023-12-17T11:56:31.566 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.696+0000 7efe2cf25700 1 -- 172.21.15.8:0/2601381031 --> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7efe28062a20 con 0x7efe10038870 2023-12-17T11:56:31.566 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.945+0000 7efe177fe700 1 -- 172.21.15.8:0/2601381031 <== mgr.14154 v2:172.21.15.8:6800/268548699 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7efe28062a20 con 0x7efe10038870 2023-12-17T11:56:31.566 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.947+0000 7efe2cf25700 1 -- 172.21.15.8:0/2601381031 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7efe10038870 msgr2=0x7efe1003ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:31.566 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.947+0000 7efe2cf25700 1 --2- 172.21.15.8:0/2601381031 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7efe10038870 0x7efe1003ad30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7efe1c006fd0 tx=0x7efe1c006e40 comp rx=0 tx=0).stop 2023-12-17T11:56:31.566 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.947+0000 7efe2cf25700 1 -- 172.21.15.8:0/2601381031 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe28106ad0 msgr2=0x7efe2819ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:31.566 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.947+0000 7efe2cf25700 1 --2- 172.21.15.8:0/2601381031 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe28106ad0 0x7efe2819ca40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7efe18003f70 tx=0x7efe180119a0 comp rx=0 tx=0).stop 2023-12-17T11:56:31.567 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.948+0000 7efe2cf25700 1 -- 172.21.15.8:0/2601381031 shutdown_connections 2023-12-17T11:56:31.567 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.948+0000 7efe2cf25700 1 --2- 172.21.15.8:0/2601381031 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7efe10038870 0x7efe1003ad30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:31.567 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.948+0000 7efe2cf25700 1 --2- 172.21.15.8:0/2601381031 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efe28106ad0 0x7efe2819ca40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:31.567 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.948+0000 7efe2cf25700 1 -- 172.21.15.8:0/2601381031 >> 172.21.15.8:0/2601381031 conn(0x7efe28102030 msgr2=0x7efe28102c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:31.567 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.948+0000 7efe2cf25700 1 -- 172.21.15.8:0/2601381031 shutdown_connections 2023-12-17T11:56:31.567 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:30.948+0000 7efe2cf25700 1 -- 172.21.15.8:0/2601381031 wait complete. 2023-12-17T11:56:31.567 INFO:teuthology.orchestra.run.smithi008.stdout:Fetching dashboard port number... 2023-12-17T11:56:31.715 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:31 smithi008 ceph-mon[36830]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:56:31.715 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:31 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:56:32.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:32 smithi008 ceph-mon[36830]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:56:32.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:32 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/1835742276' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-12-17T11:56:32.533 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stdout 8443 2023-12-17T11:56:32.539 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.963+0000 7f7ee30c0700 1 Processor -- start 2023-12-17T11:56:32.540 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.963+0000 7f7ee30c0700 1 -- start start 2023-12-17T11:56:32.540 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.963+0000 7f7ee30c0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7edc07ce60 0x7f7edc07b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:32.540 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.963+0000 7f7ee30c0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc07b890 con 0x7f7edc07ce60 2023-12-17T11:56:32.540 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.963+0000 7f7ee0e5c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7edc07ce60 0x7f7edc07b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:32.541 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.964+0000 7f7ee0e5c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7edc07ce60 0x7f7edc07b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57416/0 (socket says 172.21.15.8:57416) 2023-12-17T11:56:32.541 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.964+0000 7f7ee0e5c700 1 -- 172.21.15.8:0/3588825129 learned_addr learned my addr 172.21.15.8:0/3588825129 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:32.541 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.964+0000 7f7ee0e5c700 1 -- 172.21.15.8:0/3588825129 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7edc07b9d0 con 0x7f7edc07ce60 2023-12-17T11:56:32.541 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.964+0000 7f7ee0e5c700 1 --2- 172.21.15.8:0/3588825129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7edc07ce60 0x7f7edc07b2c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7ed00098a0 tx=0x7f7ed0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7362fa8380cf731d server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:32.541 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.964+0000 7f7edb7fe700 1 -- 172.21.15.8:0/3588825129 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ed0004160 con 0x7f7edc07ce60 2023-12-17T11:56:32.541 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.964+0000 7f7edb7fe700 1 -- 172.21.15.8:0/3588825129 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7ed00042c0 con 0x7f7edc07ce60 2023-12-17T11:56:32.541 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.964+0000 7f7edb7fe700 1 -- 172.21.15.8:0/3588825129 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ed00118e0 con 0x7f7edc07ce60 2023-12-17T11:56:32.541 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.965+0000 7f7ee30c0700 1 -- 172.21.15.8:0/3588825129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7edc07ce60 msgr2=0x7f7edc07b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:32.541 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.965+0000 7f7ee30c0700 1 --2- 172.21.15.8:0/3588825129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7edc07ce60 0x7f7edc07b2c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7ed00098a0 tx=0x7f7ed0009bb0 comp rx=0 tx=0).stop 2023-12-17T11:56:32.542 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.965+0000 7f7ee30c0700 1 -- 172.21.15.8:0/3588825129 shutdown_connections 2023-12-17T11:56:32.542 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.965+0000 7f7ee30c0700 1 --2- 172.21.15.8:0/3588825129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7edc07ce60 0x7f7edc07b2c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:32.542 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.965+0000 7f7ee30c0700 1 -- 172.21.15.8:0/3588825129 >> 172.21.15.8:0/3588825129 conn(0x7f7edc102030 msgr2=0x7f7edc1044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:32.542 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.965+0000 7f7ee30c0700 1 -- 172.21.15.8:0/3588825129 shutdown_connections 2023-12-17T11:56:32.542 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.965+0000 7f7ee30c0700 1 -- 172.21.15.8:0/3588825129 wait complete. 2023-12-17T11:56:32.542 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.966+0000 7f7ee30c0700 1 Processor -- start 2023-12-17T11:56:32.542 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.966+0000 7f7ee30c0700 1 -- start start 2023-12-17T11:56:32.542 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.967+0000 7f7ee30c0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7edc07ce60 0x7f7edc19c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:32.542 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.967+0000 7f7ee30c0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7edc19cf20 con 0x7f7edc07ce60 2023-12-17T11:56:32.542 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.967+0000 7f7ee0e5c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7edc07ce60 0x7f7edc19c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:32.542 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.967+0000 7f7ee0e5c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7edc07ce60 0x7f7edc19c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57422/0 (socket says 172.21.15.8:57422) 2023-12-17T11:56:32.542 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.967+0000 7f7ee0e5c700 1 -- 172.21.15.8:0/1835742276 learned_addr learned my addr 172.21.15.8:0/1835742276 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:32.542 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.967+0000 7f7ee0e5c700 1 -- 172.21.15.8:0/1835742276 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed0009550 con 0x7f7edc07ce60 2023-12-17T11:56:32.542 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.968+0000 7f7ee0e5c700 1 --2- 172.21.15.8:0/1835742276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7edc07ce60 0x7f7edc19c9e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7ed00046e0 tx=0x7f7ed00119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:32.543 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.968+0000 7f7ed9ffb700 1 -- 172.21.15.8:0/1835742276 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ed00037d0 con 0x7f7edc07ce60 2023-12-17T11:56:32.543 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.968+0000 7f7ed9ffb700 1 -- 172.21.15.8:0/1835742276 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7ed001b440 con 0x7f7edc07ce60 2023-12-17T11:56:32.543 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.968+0000 7f7ed9ffb700 1 -- 172.21.15.8:0/1835742276 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7ed0023400 con 0x7f7edc07ce60 2023-12-17T11:56:32.543 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.968+0000 7f7ee30c0700 1 -- 172.21.15.8:0/1835742276 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7edc19d120 con 0x7f7edc07ce60 2023-12-17T11:56:32.543 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.968+0000 7f7ee30c0700 1 -- 172.21.15.8:0/1835742276 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7edc19d5c0 con 0x7f7edc07ce60 2023-12-17T11:56:32.543 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.969+0000 7f7ed9ffb700 1 -- 172.21.15.8:0/1835742276 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 12) v1 ==== 45593+0+0 (secure 0 0 0) 0x7f7ed001b840 con 0x7f7edc07ce60 2023-12-17T11:56:32.543 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.969+0000 7f7ee30c0700 1 -- 172.21.15.8:0/1835742276 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7edc10ceb0 con 0x7f7edc07ce60 2023-12-17T11:56:32.543 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.970+0000 7f7ed9ffb700 1 --2- 172.21.15.8:0/1835742276 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f7ecc038870 0x7f7ecc03ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:32.543 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.970+0000 7f7ed9ffb700 1 -- 172.21.15.8:0/1835742276 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f7ed004c910 con 0x7f7edc07ce60 2023-12-17T11:56:32.543 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.970+0000 7f7edbfff700 1 --2- 172.21.15.8:0/1835742276 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f7ecc038870 0x7f7ecc03ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:32.543 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.970+0000 7f7edbfff700 1 --2- 172.21.15.8:0/1835742276 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f7ecc038870 0x7f7ecc03ad30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8006fd0 tx=0x7f7ec8006e40 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:32.543 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:31.975+0000 7f7ed9ffb700 1 -- 172.21.15.8:0/1835742276 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f7ed002b760 con 0x7f7edc07ce60 2023-12-17T11:56:32.543 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.186+0000 7f7ee30c0700 1 -- 172.21.15.8:0/1835742276 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f7edc10d120 con 0x7f7edc07ce60 2023-12-17T11:56:32.543 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.186+0000 7f7ed9ffb700 1 -- 172.21.15.8:0/1835742276 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f7ed0016260 con 0x7f7edc07ce60 2023-12-17T11:56:32.544 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.189+0000 7f7ee30c0700 1 -- 172.21.15.8:0/1835742276 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f7ecc038870 msgr2=0x7f7ecc03ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:32.544 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.189+0000 7f7ee30c0700 1 --2- 172.21.15.8:0/1835742276 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f7ecc038870 0x7f7ecc03ad30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7ec8006fd0 tx=0x7f7ec8006e40 comp rx=0 tx=0).stop 2023-12-17T11:56:32.544 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.189+0000 7f7ee30c0700 1 -- 172.21.15.8:0/1835742276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7edc07ce60 msgr2=0x7f7edc19c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:32.544 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.189+0000 7f7ee30c0700 1 --2- 172.21.15.8:0/1835742276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7edc07ce60 0x7f7edc19c9e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7ed00046e0 tx=0x7f7ed00119a0 comp rx=0 tx=0).stop 2023-12-17T11:56:32.544 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.189+0000 7f7ee30c0700 1 -- 172.21.15.8:0/1835742276 shutdown_connections 2023-12-17T11:56:32.544 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.189+0000 7f7ee30c0700 1 --2- 172.21.15.8:0/1835742276 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f7ecc038870 0x7f7ecc03ad30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:32.544 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.189+0000 7f7ee30c0700 1 --2- 172.21.15.8:0/1835742276 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7edc07ce60 0x7f7edc19c9e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:32.544 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.189+0000 7f7ee30c0700 1 -- 172.21.15.8:0/1835742276 >> 172.21.15.8:0/1835742276 conn(0x7f7edc102030 msgr2=0x7f7edc102c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:32.544 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.189+0000 7f7ee30c0700 1 -- 172.21.15.8:0/1835742276 shutdown_connections 2023-12-17T11:56:32.544 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.189+0000 7f7ee30c0700 1 -- 172.21.15.8:0/1835742276 wait complete. 2023-12-17T11:56:32.561 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-12-17T11:56:32.561 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout disabled 2023-12-17T11:56:32.580 INFO:teuthology.orchestra.run.smithi008.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-12-17T11:56:32.580 INFO:teuthology.orchestra.run.smithi008.stdout:systemctl: stdout inactive 2023-12-17T11:56:32.580 INFO:teuthology.orchestra.run.smithi008.stdout:firewalld.service is not enabled 2023-12-17T11:56:32.580 INFO:teuthology.orchestra.run.smithi008.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-12-17T11:56:32.585 INFO:teuthology.orchestra.run.smithi008.stdout:Ceph Dashboard is now available at: 2023-12-17T11:56:32.585 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T11:56:32.585 INFO:teuthology.orchestra.run.smithi008.stdout: URL: https://smithi008.front.sepia.ceph.com:8443/ 2023-12-17T11:56:32.585 INFO:teuthology.orchestra.run.smithi008.stdout: User: admin 2023-12-17T11:56:32.585 INFO:teuthology.orchestra.run.smithi008.stdout: Password: baqkgjasdd 2023-12-17T11:56:32.585 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T11:56:32.585 INFO:teuthology.orchestra.run.smithi008.stdout:Saving cluster configuration to /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/config directory 2023-12-17T11:56:32.587 INFO:teuthology.orchestra.run.smithi008.stdout:Enabling autotune for osd_memory_target 2023-12-17T11:56:33.575 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.988+0000 7f79e8109700 1 Processor -- start 2023-12-17T11:56:33.575 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.988+0000 7f79e8109700 1 -- start start 2023-12-17T11:56:33.576 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.989+0000 7f79e8109700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79e007ce80 0x7f79e007b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:33.576 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.989+0000 7f79e8109700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e007b8b0 con 0x7f79e007ce80 2023-12-17T11:56:33.576 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.989+0000 7f79e5ea5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79e007ce80 0x7f79e007b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:33.576 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.989+0000 7f79e5ea5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79e007ce80 0x7f79e007b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57424/0 (socket says 172.21.15.8:57424) 2023-12-17T11:56:33.576 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.989+0000 7f79e5ea5700 1 -- 172.21.15.8:0/4030974055 learned_addr learned my addr 172.21.15.8:0/4030974055 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:33.576 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.989+0000 7f79e5ea5700 1 -- 172.21.15.8:0/4030974055 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e007b9f0 con 0x7f79e007ce80 2023-12-17T11:56:33.576 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.990+0000 7f79e5ea5700 1 --2- 172.21.15.8:0/4030974055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79e007ce80 0x7f79e007b2e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f79dc0098a0 tx=0x7f79dc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f19cbc450bb27ea server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:33.576 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.990+0000 7f79e4ea3700 1 -- 172.21.15.8:0/4030974055 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79dc004160 con 0x7f79e007ce80 2023-12-17T11:56:33.576 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.990+0000 7f79e4ea3700 1 -- 172.21.15.8:0/4030974055 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f79dc0042c0 con 0x7f79e007ce80 2023-12-17T11:56:33.576 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.990+0000 7f79e4ea3700 1 -- 172.21.15.8:0/4030974055 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79dc0118e0 con 0x7f79e007ce80 2023-12-17T11:56:33.576 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.991+0000 7f79e8109700 1 -- 172.21.15.8:0/4030974055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79e007ce80 msgr2=0x7f79e007b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:33.576 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.991+0000 7f79e8109700 1 --2- 172.21.15.8:0/4030974055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79e007ce80 0x7f79e007b2e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f79dc0098a0 tx=0x7f79dc009bb0 comp rx=0 tx=0).stop 2023-12-17T11:56:33.576 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.991+0000 7f79e8109700 1 -- 172.21.15.8:0/4030974055 shutdown_connections 2023-12-17T11:56:33.577 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.991+0000 7f79e8109700 1 --2- 172.21.15.8:0/4030974055 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79e007ce80 0x7f79e007b2e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:33.577 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.991+0000 7f79e8109700 1 -- 172.21.15.8:0/4030974055 >> 172.21.15.8:0/4030974055 conn(0x7f79e0102030 msgr2=0x7f79e01044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:33.577 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.991+0000 7f79e8109700 1 -- 172.21.15.8:0/4030974055 shutdown_connections 2023-12-17T11:56:33.577 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.991+0000 7f79e8109700 1 -- 172.21.15.8:0/4030974055 wait complete. 2023-12-17T11:56:33.577 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.992+0000 7f79e8109700 1 Processor -- start 2023-12-17T11:56:33.577 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.992+0000 7f79e8109700 1 -- start start 2023-12-17T11:56:33.577 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.992+0000 7f79e8109700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79e007ce80 0x7f79e019ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:33.577 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.992+0000 7f79e8109700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e019cf60 con 0x7f79e007ce80 2023-12-17T11:56:33.577 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.993+0000 7f79e5ea5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79e007ce80 0x7f79e019ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:33.578 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.993+0000 7f79e5ea5700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79e007ce80 0x7f79e019ca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57426/0 (socket says 172.21.15.8:57426) 2023-12-17T11:56:33.578 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.993+0000 7f79e5ea5700 1 -- 172.21.15.8:0/1641059248 learned_addr learned my addr 172.21.15.8:0/1641059248 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:33.578 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.993+0000 7f79e5ea5700 1 -- 172.21.15.8:0/1641059248 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79dc009550 con 0x7f79e007ce80 2023-12-17T11:56:33.578 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.993+0000 7f79e5ea5700 1 --2- 172.21.15.8:0/1641059248 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79e007ce80 0x7f79e019ca20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f79dc003f70 tx=0x7f79dc0119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:33.578 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.993+0000 7f79d6ffd700 1 -- 172.21.15.8:0/1641059248 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79dc0037d0 con 0x7f79e007ce80 2023-12-17T11:56:33.578 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.994+0000 7f79d6ffd700 1 -- 172.21.15.8:0/1641059248 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f79dc01b440 con 0x7f79e007ce80 2023-12-17T11:56:33.578 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.994+0000 7f79e8109700 1 -- 172.21.15.8:0/1641059248 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e019d160 con 0x7f79e007ce80 2023-12-17T11:56:33.578 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.994+0000 7f79d6ffd700 1 -- 172.21.15.8:0/1641059248 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79dc0193d0 con 0x7f79e007ce80 2023-12-17T11:56:33.578 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.994+0000 7f79e8109700 1 -- 172.21.15.8:0/1641059248 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e019d600 con 0x7f79e007ce80 2023-12-17T11:56:33.578 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.995+0000 7f79d6ffd700 1 -- 172.21.15.8:0/1641059248 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 12) v1 ==== 45593+0+0 (secure 0 0 0) 0x7f79dc003930 con 0x7f79e007ce80 2023-12-17T11:56:33.578 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.995+0000 7f79e8109700 1 -- 172.21.15.8:0/1641059248 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79e010ce90 con 0x7f79e007ce80 2023-12-17T11:56:33.578 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.995+0000 7f79d6ffd700 1 --2- 172.21.15.8:0/1641059248 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f79cc038870 0x7f79cc03ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:33.578 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.995+0000 7f79d6ffd700 1 -- 172.21.15.8:0/1641059248 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f79dc04c830 con 0x7f79e007ce80 2023-12-17T11:56:33.578 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.995+0000 7f79e56a4700 1 --2- 172.21.15.8:0/1641059248 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f79cc038870 0x7f79cc03ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:33.579 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:32.996+0000 7f79e56a4700 1 --2- 172.21.15.8:0/1641059248 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f79cc038870 0x7f79cc03ad30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f79d0006fd0 tx=0x7f79d0006e40 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:33.579 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.000+0000 7f79d6ffd700 1 -- 172.21.15.8:0/1641059248 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f79dc018530 con 0x7f79e007ce80 2023-12-17T11:56:33.579 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.209+0000 7f79e8109700 1 -- 172.21.15.8:0/1641059248 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f79e010d0d0 con 0x7f79e007ce80 2023-12-17T11:56:33.579 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.210+0000 7f79d6ffd700 1 -- 172.21.15.8:0/1641059248 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f79dc01f0c0 con 0x7f79e007ce80 2023-12-17T11:56:33.579 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.212+0000 7f79e8109700 1 -- 172.21.15.8:0/1641059248 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f79cc038870 msgr2=0x7f79cc03ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:33.579 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.212+0000 7f79e8109700 1 --2- 172.21.15.8:0/1641059248 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f79cc038870 0x7f79cc03ad30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f79d0006fd0 tx=0x7f79d0006e40 comp rx=0 tx=0).stop 2023-12-17T11:56:33.579 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.212+0000 7f79e8109700 1 -- 172.21.15.8:0/1641059248 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79e007ce80 msgr2=0x7f79e019ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:33.579 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.212+0000 7f79e8109700 1 --2- 172.21.15.8:0/1641059248 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79e007ce80 0x7f79e019ca20 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f79dc003f70 tx=0x7f79dc0119a0 comp rx=0 tx=0).stop 2023-12-17T11:56:33.579 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.212+0000 7f79e8109700 1 -- 172.21.15.8:0/1641059248 shutdown_connections 2023-12-17T11:56:33.579 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.212+0000 7f79e8109700 1 --2- 172.21.15.8:0/1641059248 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f79cc038870 0x7f79cc03ad30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:33.579 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.212+0000 7f79e8109700 1 --2- 172.21.15.8:0/1641059248 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79e007ce80 0x7f79e019ca20 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:33.579 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.212+0000 7f79e8109700 1 -- 172.21.15.8:0/1641059248 >> 172.21.15.8:0/1641059248 conn(0x7f79e0102030 msgr2=0x7f79e0102c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:33.579 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.213+0000 7f79e8109700 1 -- 172.21.15.8:0/1641059248 shutdown_connections 2023-12-17T11:56:33.579 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.213+0000 7f79e8109700 1 -- 172.21.15.8:0/1641059248 wait complete. 2023-12-17T11:56:34.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.971+0000 7f0064750700 1 Processor -- start 2023-12-17T11:56:34.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.971+0000 7f0064750700 1 -- start start 2023-12-17T11:56:34.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.971+0000 7f0064750700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f005c07ce60 0x7f005c07b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:34.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.971+0000 7f0064750700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005c07b890 con 0x7f005c07ce60 2023-12-17T11:56:34.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.971+0000 7f00624ec700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f005c07ce60 0x7f005c07b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:34.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.971+0000 7f00624ec700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f005c07ce60 0x7f005c07b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57432/0 (socket says 172.21.15.8:57432) 2023-12-17T11:56:34.646 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.971+0000 7f00624ec700 1 -- 172.21.15.8:0/4028687724 learned_addr learned my addr 172.21.15.8:0/4028687724 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:34.647 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.972+0000 7f00624ec700 1 -- 172.21.15.8:0/4028687724 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f005c07b9d0 con 0x7f005c07ce60 2023-12-17T11:56:34.647 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.972+0000 7f00624ec700 1 --2- 172.21.15.8:0/4028687724 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f005c07ce60 0x7f005c07b2c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f00580098a0 tx=0x7f0058009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9013e041d182f869 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:34.647 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.972+0000 7f00614ea700 1 -- 172.21.15.8:0/4028687724 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0058004160 con 0x7f005c07ce60 2023-12-17T11:56:34.647 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.972+0000 7f00614ea700 1 -- 172.21.15.8:0/4028687724 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f00580042c0 con 0x7f005c07ce60 2023-12-17T11:56:34.647 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.972+0000 7f00614ea700 1 -- 172.21.15.8:0/4028687724 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f00580118e0 con 0x7f005c07ce60 2023-12-17T11:56:34.647 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.973+0000 7f0064750700 1 -- 172.21.15.8:0/4028687724 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f005c07ce60 msgr2=0x7f005c07b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:34.647 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.973+0000 7f0064750700 1 --2- 172.21.15.8:0/4028687724 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f005c07ce60 0x7f005c07b2c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f00580098a0 tx=0x7f0058009bb0 comp rx=0 tx=0).stop 2023-12-17T11:56:34.647 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.973+0000 7f0064750700 1 -- 172.21.15.8:0/4028687724 shutdown_connections 2023-12-17T11:56:34.647 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.973+0000 7f0064750700 1 --2- 172.21.15.8:0/4028687724 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f005c07ce60 0x7f005c07b2c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:34.647 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.973+0000 7f0064750700 1 -- 172.21.15.8:0/4028687724 >> 172.21.15.8:0/4028687724 conn(0x7f005c102030 msgr2=0x7f005c1044b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:34.647 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:34 smithi008 ceph-mon[36830]: mgrmap e13: x(active, since 6s) 2023-12-17T11:56:34.648 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:34 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/820586289' entity='client.admin' 2023-12-17T11:56:34.651 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.973+0000 7f0064750700 1 -- 172.21.15.8:0/4028687724 shutdown_connections 2023-12-17T11:56:34.651 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.973+0000 7f0064750700 1 -- 172.21.15.8:0/4028687724 wait complete. 2023-12-17T11:56:34.652 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.974+0000 7f0064750700 1 Processor -- start 2023-12-17T11:56:34.652 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.974+0000 7f0064750700 1 -- start start 2023-12-17T11:56:34.652 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.974+0000 7f0064750700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f005c07ce60 0x7f005c19c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:34.652 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.974+0000 7f0064750700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005c19cf20 con 0x7f005c07ce60 2023-12-17T11:56:34.652 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.975+0000 7f00624ec700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f005c07ce60 0x7f005c19c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:34.652 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.975+0000 7f00624ec700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f005c07ce60 0x7f005c19c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57446/0 (socket says 172.21.15.8:57446) 2023-12-17T11:56:34.652 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.975+0000 7f00624ec700 1 -- 172.21.15.8:0/820586289 learned_addr learned my addr 172.21.15.8:0/820586289 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:34.652 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.975+0000 7f00624ec700 1 -- 172.21.15.8:0/820586289 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0058009550 con 0x7f005c07ce60 2023-12-17T11:56:34.652 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.975+0000 7f00624ec700 1 --2- 172.21.15.8:0/820586289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f005c07ce60 0x7f005c19c9e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f00580046e0 tx=0x7f00580119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:34.652 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.975+0000 7f00537fe700 1 -- 172.21.15.8:0/820586289 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f00580037d0 con 0x7f005c07ce60 2023-12-17T11:56:34.652 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.975+0000 7f00537fe700 1 -- 172.21.15.8:0/820586289 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f005801b440 con 0x7f005c07ce60 2023-12-17T11:56:34.652 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.976+0000 7f0064750700 1 -- 172.21.15.8:0/820586289 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f005c19d120 con 0x7f005c07ce60 2023-12-17T11:56:34.652 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.976+0000 7f00537fe700 1 -- 172.21.15.8:0/820586289 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0058023400 con 0x7f005c07ce60 2023-12-17T11:56:34.652 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.976+0000 7f0064750700 1 -- 172.21.15.8:0/820586289 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f005c19d5c0 con 0x7f005c07ce60 2023-12-17T11:56:34.653 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.977+0000 7f00537fe700 1 -- 172.21.15.8:0/820586289 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7f0058003930 con 0x7f005c07ce60 2023-12-17T11:56:34.653 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.977+0000 7f00517fa700 1 -- 172.21.15.8:0/820586289 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f005c10ceb0 con 0x7f005c07ce60 2023-12-17T11:56:34.653 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.977+0000 7f00537fe700 1 --2- 172.21.15.8:0/820586289 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f0048038960 0x7f004803ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:34.653 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.977+0000 7f00537fe700 1 -- 172.21.15.8:0/820586289 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f005804ca30 con 0x7f005c07ce60 2023-12-17T11:56:34.653 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.977+0000 7f0061ceb700 1 --2- 172.21.15.8:0/820586289 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f0048038960 0x7f004803ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:34.653 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.978+0000 7f0061ceb700 1 --2- 172.21.15.8:0/820586289 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f0048038960 0x7f004803ae20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f004c006fd0 tx=0x7f004c006e40 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:34.653 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:33.982+0000 7f00537fe700 1 -- 172.21.15.8:0/820586289 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f005802b740 con 0x7f005c07ce60 2023-12-17T11:56:34.653 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:34.306+0000 7f00517fa700 1 -- 172.21.15.8:0/820586289 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f005c10d120 con 0x7f005c07ce60 2023-12-17T11:56:34.653 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:34.309+0000 7f00537fe700 1 -- 172.21.15.8:0/820586289 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7f005802b350 con 0x7f005c07ce60 2023-12-17T11:56:34.653 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:34.311+0000 7f00517fa700 1 -- 172.21.15.8:0/820586289 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f0048038960 msgr2=0x7f004803ae20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:34.653 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:34.311+0000 7f00517fa700 1 --2- 172.21.15.8:0/820586289 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f0048038960 0x7f004803ae20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f004c006fd0 tx=0x7f004c006e40 comp rx=0 tx=0).stop 2023-12-17T11:56:34.653 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:34.311+0000 7f00517fa700 1 -- 172.21.15.8:0/820586289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f005c07ce60 msgr2=0x7f005c19c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:34.653 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:34.311+0000 7f00517fa700 1 --2- 172.21.15.8:0/820586289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f005c07ce60 0x7f005c19c9e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f00580046e0 tx=0x7f00580119a0 comp rx=0 tx=0).stop 2023-12-17T11:56:34.653 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:34.311+0000 7f00517fa700 1 -- 172.21.15.8:0/820586289 shutdown_connections 2023-12-17T11:56:34.654 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:34.311+0000 7f00517fa700 1 --2- 172.21.15.8:0/820586289 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f0048038960 0x7f004803ae20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:34.654 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:34.311+0000 7f00517fa700 1 --2- 172.21.15.8:0/820586289 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f005c07ce60 0x7f005c19c9e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:34.654 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:34.311+0000 7f00517fa700 1 -- 172.21.15.8:0/820586289 >> 172.21.15.8:0/820586289 conn(0x7f005c102030 msgr2=0x7f005c102c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:34.654 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:34.311+0000 7f00517fa700 1 -- 172.21.15.8:0/820586289 shutdown_connections 2023-12-17T11:56:34.654 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr 2023-12-17T11:56:34.311+0000 7f00517fa700 1 -- 172.21.15.8:0/820586289 wait complete. 2023-12-17T11:56:34.654 INFO:teuthology.orchestra.run.smithi008.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-12-17T11:56:34.654 INFO:teuthology.orchestra.run.smithi008.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-12-17T11:56:34.654 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T11:56:34.654 INFO:teuthology.orchestra.run.smithi008.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-12-17T11:56:34.654 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T11:56:34.654 INFO:teuthology.orchestra.run.smithi008.stdout:Or, if you are only running a single cluster on this host: 2023-12-17T11:56:34.654 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T11:56:34.654 INFO:teuthology.orchestra.run.smithi008.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-12-17T11:56:34.654 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T11:56:34.654 INFO:teuthology.orchestra.run.smithi008.stdout:Please consider enabling telemetry to help improve Ceph: 2023-12-17T11:56:34.655 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T11:56:34.655 INFO:teuthology.orchestra.run.smithi008.stdout: ceph telemetry on 2023-12-17T11:56:34.655 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T11:56:34.655 INFO:teuthology.orchestra.run.smithi008.stdout:For more information see: 2023-12-17T11:56:34.655 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T11:56:34.655 INFO:teuthology.orchestra.run.smithi008.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2023-12-17T11:56:34.655 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T11:56:34.655 INFO:teuthology.orchestra.run.smithi008.stdout:Bootstrap complete. 2023-12-17T11:56:34.714 INFO:tasks.cephadm:Fetching config... 2023-12-17T11:56:34.715 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-12-17T11:56:34.715 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-12-17T11:56:34.801 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-12-17T11:56:34.801 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-12-17T11:56:34.801 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-12-17T11:56:34.886 INFO:tasks.cephadm:Fetching mon keyring... 2023-12-17T11:56:34.886 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-12-17T11:56:34.886 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/keyring of=/dev/stdout 2023-12-17T11:56:35.004 INFO:tasks.cephadm:Fetching pub ssh key... 2023-12-17T11:56:35.004 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-12-17T11:56:35.004 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-12-17T11:56:35.089 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-12-17T11:56:35.089 DEBUG:teuthology.orchestra.run.smithi008:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAtcXpXy+4BiXD7v+QmsPyHOs+V35V2dd8+N6/m0CeJAqp/MbSA9kPQculTZebw4GZNUiow3PEzzYZiPZG7kqYRpocnBT7kc7D6MhtiNjuEzyzAirZ30/SlDccEovCyR58E7KLW9D8lZI0HSW+UJKz0RnHdsLw7Ecn/GwOlZX/ceyZu4+HyilDErnWV0rc6fPzD8U1q4GCmOVrjfqyqTRV0t3H4KnlMVbg1naW1PAoKkAeS6/wTq9iU2SJ4o4MdTML9abzlBfcFeQal0MIp9A6lRDbc2hYWmVnUn6Zdr05R81VpzwtpdKkZ5TQ5AxQ/C4x8H41fT//JmG6sFmCFBw+iRkv6FTxPPUp23HHURfEMr2cpBkrYDjw7nU3EFFEHy9LXQ53sFVkimctVU4elX1w9zv1gA0/mvnOW/ABSIImCUxCwL50SRbO+UO3SQxNn1KvN8fTTxCtPl6kv8STQVbQ7bg7/kCwUQB/0pPB7SsXWzPrX3NfWHLkvbauyGwhiCk= ceph-f43f508a-9cd2-11ee-95a5-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-17T11:56:35.233 INFO:teuthology.orchestra.run.smithi008.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAtcXpXy+4BiXD7v+QmsPyHOs+V35V2dd8+N6/m0CeJAqp/MbSA9kPQculTZebw4GZNUiow3PEzzYZiPZG7kqYRpocnBT7kc7D6MhtiNjuEzyzAirZ30/SlDccEovCyR58E7KLW9D8lZI0HSW+UJKz0RnHdsLw7Ecn/GwOlZX/ceyZu4+HyilDErnWV0rc6fPzD8U1q4GCmOVrjfqyqTRV0t3H4KnlMVbg1naW1PAoKkAeS6/wTq9iU2SJ4o4MdTML9abzlBfcFeQal0MIp9A6lRDbc2hYWmVnUn6Zdr05R81VpzwtpdKkZ5TQ5AxQ/C4x8H41fT//JmG6sFmCFBw+iRkv6FTxPPUp23HHURfEMr2cpBkrYDjw7nU3EFFEHy9LXQ53sFVkimctVU4elX1w9zv1gA0/mvnOW/ABSIImCUxCwL50SRbO+UO3SQxNn1KvN8fTTxCtPl6kv8STQVbQ7bg7/kCwUQB/0pPB7SsXWzPrX3NfWHLkvbauyGwhiCk= ceph-f43f508a-9cd2-11ee-95a5-87774f69a715 2023-12-17T11:56:35.265 DEBUG:teuthology.orchestra.run.smithi100:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAtcXpXy+4BiXD7v+QmsPyHOs+V35V2dd8+N6/m0CeJAqp/MbSA9kPQculTZebw4GZNUiow3PEzzYZiPZG7kqYRpocnBT7kc7D6MhtiNjuEzyzAirZ30/SlDccEovCyR58E7KLW9D8lZI0HSW+UJKz0RnHdsLw7Ecn/GwOlZX/ceyZu4+HyilDErnWV0rc6fPzD8U1q4GCmOVrjfqyqTRV0t3H4KnlMVbg1naW1PAoKkAeS6/wTq9iU2SJ4o4MdTML9abzlBfcFeQal0MIp9A6lRDbc2hYWmVnUn6Zdr05R81VpzwtpdKkZ5TQ5AxQ/C4x8H41fT//JmG6sFmCFBw+iRkv6FTxPPUp23HHURfEMr2cpBkrYDjw7nU3EFFEHy9LXQ53sFVkimctVU4elX1w9zv1gA0/mvnOW/ABSIImCUxCwL50SRbO+UO3SQxNn1KvN8fTTxCtPl6kv8STQVbQ7bg7/kCwUQB/0pPB7SsXWzPrX3NfWHLkvbauyGwhiCk= ceph-f43f508a-9cd2-11ee-95a5-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-17T11:56:35.368 INFO:teuthology.orchestra.run.smithi100.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAtcXpXy+4BiXD7v+QmsPyHOs+V35V2dd8+N6/m0CeJAqp/MbSA9kPQculTZebw4GZNUiow3PEzzYZiPZG7kqYRpocnBT7kc7D6MhtiNjuEzyzAirZ30/SlDccEovCyR58E7KLW9D8lZI0HSW+UJKz0RnHdsLw7Ecn/GwOlZX/ceyZu4+HyilDErnWV0rc6fPzD8U1q4GCmOVrjfqyqTRV0t3H4KnlMVbg1naW1PAoKkAeS6/wTq9iU2SJ4o4MdTML9abzlBfcFeQal0MIp9A6lRDbc2hYWmVnUn6Zdr05R81VpzwtpdKkZ5TQ5AxQ/C4x8H41fT//JmG6sFmCFBw+iRkv6FTxPPUp23HHURfEMr2cpBkrYDjw7nU3EFFEHy9LXQ53sFVkimctVU4elX1w9zv1gA0/mvnOW/ABSIImCUxCwL50SRbO+UO3SQxNn1KvN8fTTxCtPl6kv8STQVbQ7bg7/kCwUQB/0pPB7SsXWzPrX3NfWHLkvbauyGwhiCk= ceph-f43f508a-9cd2-11ee-95a5-87774f69a715 2023-12-17T11:56:35.397 DEBUG:teuthology.orchestra.run.smithi186:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAtcXpXy+4BiXD7v+QmsPyHOs+V35V2dd8+N6/m0CeJAqp/MbSA9kPQculTZebw4GZNUiow3PEzzYZiPZG7kqYRpocnBT7kc7D6MhtiNjuEzyzAirZ30/SlDccEovCyR58E7KLW9D8lZI0HSW+UJKz0RnHdsLw7Ecn/GwOlZX/ceyZu4+HyilDErnWV0rc6fPzD8U1q4GCmOVrjfqyqTRV0t3H4KnlMVbg1naW1PAoKkAeS6/wTq9iU2SJ4o4MdTML9abzlBfcFeQal0MIp9A6lRDbc2hYWmVnUn6Zdr05R81VpzwtpdKkZ5TQ5AxQ/C4x8H41fT//JmG6sFmCFBw+iRkv6FTxPPUp23HHURfEMr2cpBkrYDjw7nU3EFFEHy9LXQ53sFVkimctVU4elX1w9zv1gA0/mvnOW/ABSIImCUxCwL50SRbO+UO3SQxNn1KvN8fTTxCtPl6kv8STQVbQ7bg7/kCwUQB/0pPB7SsXWzPrX3NfWHLkvbauyGwhiCk= ceph-f43f508a-9cd2-11ee-95a5-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-12-17T11:56:35.502 INFO:teuthology.orchestra.run.smithi186.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAtcXpXy+4BiXD7v+QmsPyHOs+V35V2dd8+N6/m0CeJAqp/MbSA9kPQculTZebw4GZNUiow3PEzzYZiPZG7kqYRpocnBT7kc7D6MhtiNjuEzyzAirZ30/SlDccEovCyR58E7KLW9D8lZI0HSW+UJKz0RnHdsLw7Ecn/GwOlZX/ceyZu4+HyilDErnWV0rc6fPzD8U1q4GCmOVrjfqyqTRV0t3H4KnlMVbg1naW1PAoKkAeS6/wTq9iU2SJ4o4MdTML9abzlBfcFeQal0MIp9A6lRDbc2hYWmVnUn6Zdr05R81VpzwtpdKkZ5TQ5AxQ/C4x8H41fT//JmG6sFmCFBw+iRkv6FTxPPUp23HHURfEMr2cpBkrYDjw7nU3EFFEHy9LXQ53sFVkimctVU4elX1w9zv1gA0/mvnOW/ABSIImCUxCwL50SRbO+UO3SQxNn1KvN8fTTxCtPl6kv8STQVbQ7bg7/kCwUQB/0pPB7SsXWzPrX3NfWHLkvbauyGwhiCk= ceph-f43f508a-9cd2-11ee-95a5-87774f69a715 2023-12-17T11:56:35.533 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-12-17T11:56:35.964 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T11:56:37.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.416+0000 7f81a6d17700 1 -- 172.21.15.8:0/3688435115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81a0075600 msgr2=0x7f81a0073a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:37.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.416+0000 7f81a6d17700 1 --2- 172.21.15.8:0/3688435115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81a0075600 0x7f81a0073a60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8194009910 tx=0x7f8194009c20 comp rx=0 tx=0).stop 2023-12-17T11:56:37.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.416+0000 7f81a6d17700 1 -- 172.21.15.8:0/3688435115 shutdown_connections 2023-12-17T11:56:37.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.416+0000 7f81a6d17700 1 --2- 172.21.15.8:0/3688435115 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81a0075600 0x7f81a0073a60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:37.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.416+0000 7f81a6d17700 1 -- 172.21.15.8:0/3688435115 >> 172.21.15.8:0/3688435115 conn(0x7f81a00fc4f0 msgr2=0x7f81a00fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:37.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.416+0000 7f81a6d17700 1 -- 172.21.15.8:0/3688435115 shutdown_connections 2023-12-17T11:56:37.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.416+0000 7f81a6d17700 1 -- 172.21.15.8:0/3688435115 wait complete. 2023-12-17T11:56:37.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.417+0000 7f81a6d17700 1 Processor -- start 2023-12-17T11:56:37.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.418+0000 7f81a6d17700 1 -- start start 2023-12-17T11:56:37.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.418+0000 7f81a6d17700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81a0075600 0x7f81a019c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:37.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.418+0000 7f81a6d17700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a019ce40 con 0x7f81a0075600 2023-12-17T11:56:37.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.418+0000 7f81a4ab3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81a0075600 0x7f81a019c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:37.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.418+0000 7f81a4ab3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81a0075600 0x7f81a019c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57464/0 (socket says 172.21.15.8:57464) 2023-12-17T11:56:37.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.418+0000 7f81a4ab3700 1 -- 172.21.15.8:0/377553791 learned_addr learned my addr 172.21.15.8:0/377553791 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:37.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.419+0000 7f81a4ab3700 1 -- 172.21.15.8:0/377553791 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81940095f0 con 0x7f81a0075600 2023-12-17T11:56:37.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.419+0000 7f81a4ab3700 1 --2- 172.21.15.8:0/377553791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81a0075600 0x7f81a019c900 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8194005790 tx=0x7f81940047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:37.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.419+0000 7f819dffb700 1 -- 172.21.15.8:0/377553791 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f819400b960 con 0x7f81a0075600 2023-12-17T11:56:37.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.419+0000 7f819dffb700 1 -- 172.21.15.8:0/377553791 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f819400f460 con 0x7f81a0075600 2023-12-17T11:56:37.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.419+0000 7f819dffb700 1 -- 172.21.15.8:0/377553791 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f81940175d0 con 0x7f81a0075600 2023-12-17T11:56:37.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.419+0000 7f81a6d17700 1 -- 172.21.15.8:0/377553791 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a019d040 con 0x7f81a0075600 2023-12-17T11:56:37.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.420+0000 7f81a6d17700 1 -- 172.21.15.8:0/377553791 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a019d4e0 con 0x7f81a0075600 2023-12-17T11:56:37.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.421+0000 7f81a6d17700 1 -- 172.21.15.8:0/377553791 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a0196130 con 0x7f81a0075600 2023-12-17T11:56:37.423 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.421+0000 7f819dffb700 1 -- 172.21.15.8:0/377553791 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7f819400f5d0 con 0x7f81a0075600 2023-12-17T11:56:37.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.421+0000 7f819dffb700 1 --2- 172.21.15.8:0/377553791 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f81900388c0 0x7f819003ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:37.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.421+0000 7f819dffb700 1 -- 172.21.15.8:0/377553791 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f819404ca10 con 0x7f81a0075600 2023-12-17T11:56:37.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.421+0000 7f819ffff700 1 --2- 172.21.15.8:0/377553791 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f81900388c0 0x7f819003ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:37.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.422+0000 7f819ffff700 1 --2- 172.21.15.8:0/377553791 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f81900388c0 0x7f819003ad80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f818c006fd0 tx=0x7f818c006e40 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:37.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.427+0000 7f819dffb700 1 -- 172.21.15.8:0/377553791 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f819402ab50 con 0x7f81a0075600 2023-12-17T11:56:37.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.639+0000 7f81a6d17700 1 -- 172.21.15.8:0/377553791 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f81a0062c00 con 0x7f81a0075600 2023-12-17T11:56:37.644 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.642+0000 7f819dffb700 1 -- 172.21.15.8:0/377553791 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f8194027070 con 0x7f81a0075600 2023-12-17T11:56:37.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.646+0000 7f81a6d17700 1 -- 172.21.15.8:0/377553791 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f81900388c0 msgr2=0x7f819003ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:37.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.646+0000 7f81a6d17700 1 --2- 172.21.15.8:0/377553791 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f81900388c0 0x7f819003ad80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f818c006fd0 tx=0x7f818c006e40 comp rx=0 tx=0).stop 2023-12-17T11:56:37.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.646+0000 7f81a6d17700 1 -- 172.21.15.8:0/377553791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81a0075600 msgr2=0x7f81a019c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:37.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.646+0000 7f81a6d17700 1 --2- 172.21.15.8:0/377553791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81a0075600 0x7f81a019c900 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8194005790 tx=0x7f81940047b0 comp rx=0 tx=0).stop 2023-12-17T11:56:37.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.646+0000 7f81a6d17700 1 -- 172.21.15.8:0/377553791 shutdown_connections 2023-12-17T11:56:37.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.646+0000 7f81a6d17700 1 --2- 172.21.15.8:0/377553791 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f81900388c0 0x7f819003ad80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:37.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.646+0000 7f81a6d17700 1 --2- 172.21.15.8:0/377553791 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f81a0075600 0x7f81a019c900 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:37.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.646+0000 7f81a6d17700 1 -- 172.21.15.8:0/377553791 >> 172.21.15.8:0/377553791 conn(0x7f81a00fc4f0 msgr2=0x7f81a00fd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:37.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.647+0000 7f81a6d17700 1 -- 172.21.15.8:0/377553791 shutdown_connections 2023-12-17T11:56:37.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:37.647+0000 7f81a6d17700 1 -- 172.21.15.8:0/377553791 wait complete. 2023-12-17T11:56:38.071 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-12-17T11:56:38.071 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-12-17T11:56:38.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:37 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:56:38.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:37 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:56:38.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:37 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi008", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:56:38.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:37 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:56:38.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:37 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:56:38.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:37 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:56:38.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:37 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/377553791' entity='client.admin' 2023-12-17T11:56:38.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:37 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:56:38.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:37 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:56:38.501 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T11:56:39.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:39.902+0000 7fb02cf6a700 1 -- 172.21.15.8:0/4023089857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0281019f0 msgr2=0x7fb028103de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:39.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:39.902+0000 7fb02cf6a700 1 --2- 172.21.15.8:0/4023089857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0281019f0 0x7fb028103de0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb018009910 tx=0x7fb018009c20 comp rx=0 tx=0).stop 2023-12-17T11:56:39.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:39.902+0000 7fb02cf6a700 1 -- 172.21.15.8:0/4023089857 shutdown_connections 2023-12-17T11:56:39.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:39.902+0000 7fb02cf6a700 1 --2- 172.21.15.8:0/4023089857 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0281019f0 0x7fb028103de0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:39.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:39.902+0000 7fb02cf6a700 1 -- 172.21.15.8:0/4023089857 >> 172.21.15.8:0/4023089857 conn(0x7fb0280fb400 msgr2=0x7fb0280fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:39.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:39.902+0000 7fb02cf6a700 1 -- 172.21.15.8:0/4023089857 shutdown_connections 2023-12-17T11:56:39.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:39.902+0000 7fb02cf6a700 1 -- 172.21.15.8:0/4023089857 wait complete. 2023-12-17T11:56:39.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:39.903+0000 7fb02cf6a700 1 Processor -- start 2023-12-17T11:56:39.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:39.903+0000 7fb02cf6a700 1 -- start start 2023-12-17T11:56:39.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:39.904+0000 7fb02cf6a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0281019f0 0x7fb0281984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:39.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:39.904+0000 7fb02cf6a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb028198a20 con 0x7fb0281019f0 2023-12-17T11:56:39.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:39.904+0000 7fb02659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0281019f0 0x7fb0281984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:39.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:39.904+0000 7fb02659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0281019f0 0x7fb0281984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57492/0 (socket says 172.21.15.8:57492) 2023-12-17T11:56:39.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:39.904+0000 7fb02659c700 1 -- 172.21.15.8:0/1134665930 learned_addr learned my addr 172.21.15.8:0/1134665930 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:39.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:39.904+0000 7fb02659c700 1 -- 172.21.15.8:0/1134665930 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0180095f0 con 0x7fb0281019f0 2023-12-17T11:56:39.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:39.905+0000 7fb02659c700 1 --2- 172.21.15.8:0/1134665930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0281019f0 0x7fb0281984e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb01800b5c0 tx=0x7fb018005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:39.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:39.905+0000 7fb0177fe700 1 -- 172.21.15.8:0/1134665930 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb01800b960 con 0x7fb0281019f0 2023-12-17T11:56:39.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:39.905+0000 7fb0177fe700 1 -- 172.21.15.8:0/1134665930 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb01800f460 con 0x7fb0281019f0 2023-12-17T11:56:39.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:39.905+0000 7fb02cf6a700 1 -- 172.21.15.8:0/1134665930 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb028198c20 con 0x7fb0281019f0 2023-12-17T11:56:39.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:39.905+0000 7fb0177fe700 1 -- 172.21.15.8:0/1134665930 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fb018017440 con 0x7fb0281019f0 2023-12-17T11:56:39.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:39.905+0000 7fb02cf6a700 1 -- 172.21.15.8:0/1134665930 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0281990c0 con 0x7fb0281019f0 2023-12-17T11:56:39.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:39.906+0000 7fb0177fe700 1 -- 172.21.15.8:0/1134665930 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7fb01800bac0 con 0x7fb0281019f0 2023-12-17T11:56:39.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:39.906+0000 7fb02cf6a700 1 -- 172.21.15.8:0/1134665930 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb028191f30 con 0x7fb0281019f0 2023-12-17T11:56:39.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:39.906+0000 7fb0177fe700 1 --2- 172.21.15.8:0/1134665930 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fb0100388c0 0x7fb01003ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:39.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:39.906+0000 7fb0177fe700 1 -- 172.21.15.8:0/1134665930 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb01804ca20 con 0x7fb0281019f0 2023-12-17T11:56:39.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:39.907+0000 7fb025d9b700 1 --2- 172.21.15.8:0/1134665930 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fb0100388c0 0x7fb01003ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:39.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:39.907+0000 7fb025d9b700 1 --2- 172.21.15.8:0/1134665930 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fb0100388c0 0x7fb01003ad80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb01c006fd0 tx=0x7fb01c006e40 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:39.914 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:39.912+0000 7fb0177fe700 1 -- 172.21.15.8:0/1134665930 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fb01802a7d0 con 0x7fb0281019f0 2023-12-17T11:56:40.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:40.125+0000 7fb02cf6a700 1 -- 172.21.15.8:0/1134665930 --> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7fb028061a10 con 0x7fb0100388c0 2023-12-17T11:56:40.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:40.129+0000 7fb0177fe700 1 -- 172.21.15.8:0/1134665930 <== mgr.14154 v2:172.21.15.8:6800/268548699 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb028061a10 con 0x7fb0100388c0 2023-12-17T11:56:40.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:40.131+0000 7fb02cf6a700 1 -- 172.21.15.8:0/1134665930 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fb0100388c0 msgr2=0x7fb01003ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:40.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:40.131+0000 7fb02cf6a700 1 --2- 172.21.15.8:0/1134665930 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fb0100388c0 0x7fb01003ad80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb01c006fd0 tx=0x7fb01c006e40 comp rx=0 tx=0).stop 2023-12-17T11:56:40.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:40.131+0000 7fb02cf6a700 1 -- 172.21.15.8:0/1134665930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0281019f0 msgr2=0x7fb0281984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:40.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:40.131+0000 7fb02cf6a700 1 --2- 172.21.15.8:0/1134665930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0281019f0 0x7fb0281984e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb01800b5c0 tx=0x7fb018005810 comp rx=0 tx=0).stop 2023-12-17T11:56:40.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:40.131+0000 7fb02cf6a700 1 -- 172.21.15.8:0/1134665930 shutdown_connections 2023-12-17T11:56:40.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:40.131+0000 7fb02cf6a700 1 --2- 172.21.15.8:0/1134665930 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fb0100388c0 0x7fb01003ad80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:40.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:40.131+0000 7fb02cf6a700 1 --2- 172.21.15.8:0/1134665930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb0281019f0 0x7fb0281984e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:40.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:40.131+0000 7fb02cf6a700 1 -- 172.21.15.8:0/1134665930 >> 172.21.15.8:0/1134665930 conn(0x7fb0280fb400 msgr2=0x7fb0280fd840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:40.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:40.132+0000 7fb02cf6a700 1 -- 172.21.15.8:0/1134665930 shutdown_connections 2023-12-17T11:56:40.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:40.132+0000 7fb02cf6a700 1 -- 172.21.15.8:0/1134665930 wait complete. 2023-12-17T11:56:40.529 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi100 2023-12-17T11:56:40.529 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-12-17T11:56:40.530 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/etc/ceph/ceph.conf 2023-12-17T11:56:40.577 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-12-17T11:56:40.578 DEBUG:teuthology.orchestra.run.smithi100:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-17T11:56:40.663 INFO:tasks.cephadm:Adding host smithi100 to orchestrator... 2023-12-17T11:56:40.663 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph orch host add smithi100 2023-12-17T11:56:41.091 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T11:56:41.433 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:41 smithi008 ceph-mon[36830]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:56:41.433 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:41 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:56:41.433 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:41 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:56:41.434 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:41 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:56:41.434 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:41 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:56:41.434 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:41 smithi008 ceph-mon[36830]: Updating smithi008:/etc/ceph/ceph.conf 2023-12-17T11:56:42.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:42.317+0000 7f1e8ffba700 1 -- 172.21.15.8:0/731272747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e88101140 msgr2=0x7f1e88101520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:42.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:42.317+0000 7f1e8ffba700 1 --2- 172.21.15.8:0/731272747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e88101140 0x7f1e88101520 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1e84009910 tx=0x7f1e84009c20 comp rx=0 tx=0).stop 2023-12-17T11:56:42.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:42.317+0000 7f1e8ffba700 1 -- 172.21.15.8:0/731272747 shutdown_connections 2023-12-17T11:56:42.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:42.317+0000 7f1e8ffba700 1 --2- 172.21.15.8:0/731272747 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e88101140 0x7f1e88101520 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:42.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:42.317+0000 7f1e8ffba700 1 -- 172.21.15.8:0/731272747 >> 172.21.15.8:0/731272747 conn(0x7f1e880fc9d0 msgr2=0x7f1e880fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:42.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:42.317+0000 7f1e8ffba700 1 -- 172.21.15.8:0/731272747 shutdown_connections 2023-12-17T11:56:42.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:42.317+0000 7f1e8ffba700 1 -- 172.21.15.8:0/731272747 wait complete. 2023-12-17T11:56:42.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:42.318+0000 7f1e8ffba700 1 Processor -- start 2023-12-17T11:56:42.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:42.318+0000 7f1e8ffba700 1 -- start start 2023-12-17T11:56:42.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:42.319+0000 7f1e8ffba700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e88101140 0x7f1e88196740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:42.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:42.319+0000 7f1e8ffba700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e88196c80 con 0x7f1e88101140 2023-12-17T11:56:42.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:42.319+0000 7f1e8dd56700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e88101140 0x7f1e88196740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:42.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:42.319+0000 7f1e8dd56700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e88101140 0x7f1e88196740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60200/0 (socket says 172.21.15.8:60200) 2023-12-17T11:56:42.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:42.319+0000 7f1e8dd56700 1 -- 172.21.15.8:0/1689023445 learned_addr learned my addr 172.21.15.8:0/1689023445 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:42.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:42.319+0000 7f1e8dd56700 1 -- 172.21.15.8:0/1689023445 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e840095f0 con 0x7f1e88101140 2023-12-17T11:56:42.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:42.320+0000 7f1e8dd56700 1 --2- 172.21.15.8:0/1689023445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e88101140 0x7f1e88196740 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1e84005660 tx=0x7f1e84005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:42.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:42.320+0000 7f1e7effd700 1 -- 172.21.15.8:0/1689023445 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e8401d070 con 0x7f1e88101140 2023-12-17T11:56:42.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:42.320+0000 7f1e7effd700 1 -- 172.21.15.8:0/1689023445 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1e8400b750 con 0x7f1e88101140 2023-12-17T11:56:42.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:42.320+0000 7f1e7effd700 1 -- 172.21.15.8:0/1689023445 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1e840037d0 con 0x7f1e88101140 2023-12-17T11:56:42.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:42.320+0000 7f1e8ffba700 1 -- 172.21.15.8:0/1689023445 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e88196e80 con 0x7f1e88101140 2023-12-17T11:56:42.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:42.320+0000 7f1e8ffba700 1 -- 172.21.15.8:0/1689023445 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e881972a0 con 0x7f1e88101140 2023-12-17T11:56:42.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:42.321+0000 7f1e8ffba700 1 -- 172.21.15.8:0/1689023445 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e88102620 con 0x7f1e88101140 2023-12-17T11:56:42.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:42.321+0000 7f1e7effd700 1 -- 172.21.15.8:0/1689023445 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7f1e84004390 con 0x7f1e88101140 2023-12-17T11:56:42.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:42.322+0000 7f1e7effd700 1 --2- 172.21.15.8:0/1689023445 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f1e74038910 0x7f1e7403add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:42.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:42.322+0000 7f1e7effd700 1 -- 172.21.15.8:0/1689023445 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f1e8404c5a0 con 0x7f1e88101140 2023-12-17T11:56:42.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:42.322+0000 7f1e8d555700 1 --2- 172.21.15.8:0/1689023445 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f1e74038910 0x7f1e7403add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:42.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:42.323+0000 7f1e8d555700 1 --2- 172.21.15.8:0/1689023445 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f1e74038910 0x7f1e7403add0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1e78006fd0 tx=0x7f1e78006e40 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:42.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:42.327+0000 7f1e7effd700 1 -- 172.21.15.8:0/1689023445 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f1e84003a40 con 0x7f1e88101140 2023-12-17T11:56:42.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:42 smithi008 ceph-mon[36830]: Updating smithi008:/var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-17T11:56:42.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:42 smithi008 ceph-mon[36830]: Updating smithi008:/etc/ceph/ceph.client.admin.keyring 2023-12-17T11:56:42.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:42.547+0000 7f1e8ffba700 1 -- 172.21.15.8:0/1689023445 --> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi100", "target": ["mon-mgr", ""]}) v1 -- 0x7f1e8810b0e0 con 0x7f1e74038910 2023-12-17T11:56:43.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:43 smithi008 ceph-mon[36830]: Updating smithi008:/var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-17T11:56:43.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:43 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:56:43.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:43 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:56:43.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:43 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:56:44.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:44 smithi008 ceph-mon[36830]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi100", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:56:44.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:44 smithi008 ceph-mon[36830]: Deploying cephadm binary to smithi100 2023-12-17T11:56:47.365 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:47.362+0000 7f1e7effd700 1 -- 172.21.15.8:0/1689023445 <== mgr.14154 v2:172.21.15.8:6800/268548699 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f1e8810b0e0 con 0x7f1e74038910 2023-12-17T11:56:47.365 INFO:teuthology.orchestra.run.smithi008.stdout:Added host 'smithi100' with addr '172.21.15.100' 2023-12-17T11:56:47.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:47.365+0000 7f1e8ffba700 1 -- 172.21.15.8:0/1689023445 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f1e74038910 msgr2=0x7f1e7403add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:47.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:47.365+0000 7f1e8ffba700 1 --2- 172.21.15.8:0/1689023445 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f1e74038910 0x7f1e7403add0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1e78006fd0 tx=0x7f1e78006e40 comp rx=0 tx=0).stop 2023-12-17T11:56:47.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:47.365+0000 7f1e8ffba700 1 -- 172.21.15.8:0/1689023445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e88101140 msgr2=0x7f1e88196740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:47.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:47.365+0000 7f1e8ffba700 1 --2- 172.21.15.8:0/1689023445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e88101140 0x7f1e88196740 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1e84005660 tx=0x7f1e84005740 comp rx=0 tx=0).stop 2023-12-17T11:56:47.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:47.365+0000 7f1e8ffba700 1 -- 172.21.15.8:0/1689023445 shutdown_connections 2023-12-17T11:56:47.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:47.365+0000 7f1e8ffba700 1 --2- 172.21.15.8:0/1689023445 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f1e74038910 0x7f1e7403add0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:47.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:47.365+0000 7f1e8ffba700 1 --2- 172.21.15.8:0/1689023445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1e88101140 0x7f1e88196740 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:47.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:47.365+0000 7f1e8ffba700 1 -- 172.21.15.8:0/1689023445 >> 172.21.15.8:0/1689023445 conn(0x7f1e880fc9d0 msgr2=0x7f1e88102b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:47.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:47.365+0000 7f1e8ffba700 1 -- 172.21.15.8:0/1689023445 shutdown_connections 2023-12-17T11:56:47.369 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:47.365+0000 7f1e8ffba700 1 -- 172.21.15.8:0/1689023445 wait complete. 2023-12-17T11:56:47.737 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph orch host ls --format=json 2023-12-17T11:56:48.147 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T11:56:48.602 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:48 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:56:48.602 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:48 smithi008 ceph-mon[36830]: Added host smithi100 2023-12-17T11:56:48.602 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:48 smithi008 ceph-mon[36830]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:56:48.602 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:48 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:56:48.602 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:48 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:56:49.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.246+0000 7ff443f64700 1 -- 172.21.15.8:0/1161047245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff43c101140 msgr2=0x7ff43c101520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:49.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.246+0000 7ff443f64700 1 --2- 172.21.15.8:0/1161047245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff43c101140 0x7ff43c101520 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff438009910 tx=0x7ff438009c20 comp rx=0 tx=0).stop 2023-12-17T11:56:49.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.246+0000 7ff443f64700 1 -- 172.21.15.8:0/1161047245 shutdown_connections 2023-12-17T11:56:49.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.246+0000 7ff443f64700 1 --2- 172.21.15.8:0/1161047245 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff43c101140 0x7ff43c101520 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:49.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.246+0000 7ff443f64700 1 -- 172.21.15.8:0/1161047245 >> 172.21.15.8:0/1161047245 conn(0x7ff43c0fc9d0 msgr2=0x7ff43c0fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:49.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.246+0000 7ff443f64700 1 -- 172.21.15.8:0/1161047245 shutdown_connections 2023-12-17T11:56:49.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.246+0000 7ff443f64700 1 -- 172.21.15.8:0/1161047245 wait complete. 2023-12-17T11:56:49.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.247+0000 7ff443f64700 1 Processor -- start 2023-12-17T11:56:49.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.247+0000 7ff443f64700 1 -- start start 2023-12-17T11:56:49.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.248+0000 7ff443f64700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff43c101140 0x7ff43c0738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:49.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.248+0000 7ff443f64700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c075790 con 0x7ff43c101140 2023-12-17T11:56:49.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.248+0000 7ff441d00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff43c101140 0x7ff43c0738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:49.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.248+0000 7ff441d00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff43c101140 0x7ff43c0738d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60212/0 (socket says 172.21.15.8:60212) 2023-12-17T11:56:49.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.248+0000 7ff441d00700 1 -- 172.21.15.8:0/4195801264 learned_addr learned my addr 172.21.15.8:0/4195801264 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:49.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.248+0000 7ff441d00700 1 -- 172.21.15.8:0/4195801264 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4380095f0 con 0x7ff43c101140 2023-12-17T11:56:49.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.249+0000 7ff441d00700 1 --2- 172.21.15.8:0/4195801264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff43c101140 0x7ff43c0738d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff4380098e0 tx=0x7ff438005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:49.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.249+0000 7ff432ffd700 1 -- 172.21.15.8:0/4195801264 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff43801d070 con 0x7ff43c101140 2023-12-17T11:56:49.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.249+0000 7ff432ffd700 1 -- 172.21.15.8:0/4195801264 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff438009e60 con 0x7ff43c101140 2023-12-17T11:56:49.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.249+0000 7ff432ffd700 1 -- 172.21.15.8:0/4195801264 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff438022b30 con 0x7ff43c101140 2023-12-17T11:56:49.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.249+0000 7ff443f64700 1 -- 172.21.15.8:0/4195801264 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff43c073e10 con 0x7ff43c101140 2023-12-17T11:56:49.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.249+0000 7ff443f64700 1 -- 172.21.15.8:0/4195801264 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff43c074230 con 0x7ff43c101140 2023-12-17T11:56:49.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.250+0000 7ff432ffd700 1 -- 172.21.15.8:0/4195801264 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7ff438022470 con 0x7ff43c101140 2023-12-17T11:56:49.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.250+0000 7ff443f64700 1 -- 172.21.15.8:0/4195801264 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff43c102620 con 0x7ff43c101140 2023-12-17T11:56:49.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.250+0000 7ff432ffd700 1 --2- 172.21.15.8:0/4195801264 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7ff428038910 0x7ff42803add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:49.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.250+0000 7ff432ffd700 1 -- 172.21.15.8:0/4195801264 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff43804cd30 con 0x7ff43c101140 2023-12-17T11:56:49.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.251+0000 7ff4414ff700 1 --2- 172.21.15.8:0/4195801264 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7ff428038910 0x7ff42803add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:49.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.251+0000 7ff4414ff700 1 --2- 172.21.15.8:0/4195801264 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7ff428038910 0x7ff42803add0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff42c006fd0 tx=0x7ff42c006e40 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:49.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.256+0000 7ff432ffd700 1 -- 172.21.15.8:0/4195801264 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ff43802ba00 con 0x7ff43c101140 2023-12-17T11:56:49.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.474+0000 7ff443f64700 1 -- 172.21.15.8:0/4195801264 --> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff43c074470 con 0x7ff428038910 2023-12-17T11:56:49.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.476+0000 7ff432ffd700 1 -- 172.21.15.8:0/4195801264 <== mgr.14154 v2:172.21.15.8:6800/268548699 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+159 (secure 0 0 0) 0x7ff43c074470 con 0x7ff428038910 2023-12-17T11:56:49.478 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T11:56:49.478 INFO:teuthology.orchestra.run.smithi008.stdout:[{"addr": "172.21.15.8", "hostname": "smithi008", "labels": [], "status": ""}, {"addr": "172.21.15.100", "hostname": "smithi100", "labels": [], "status": ""}] 2023-12-17T11:56:49.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.478+0000 7ff443f64700 1 -- 172.21.15.8:0/4195801264 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7ff428038910 msgr2=0x7ff42803add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:49.480 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.478+0000 7ff443f64700 1 --2- 172.21.15.8:0/4195801264 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7ff428038910 0x7ff42803add0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff42c006fd0 tx=0x7ff42c006e40 comp rx=0 tx=0).stop 2023-12-17T11:56:49.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.478+0000 7ff443f64700 1 -- 172.21.15.8:0/4195801264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff43c101140 msgr2=0x7ff43c0738d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:49.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.478+0000 7ff443f64700 1 --2- 172.21.15.8:0/4195801264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff43c101140 0x7ff43c0738d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff4380098e0 tx=0x7ff438005710 comp rx=0 tx=0).stop 2023-12-17T11:56:49.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.478+0000 7ff443f64700 1 -- 172.21.15.8:0/4195801264 shutdown_connections 2023-12-17T11:56:49.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.478+0000 7ff443f64700 1 --2- 172.21.15.8:0/4195801264 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7ff428038910 0x7ff42803add0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:49.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.478+0000 7ff443f64700 1 --2- 172.21.15.8:0/4195801264 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff43c101140 0x7ff43c0738d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:49.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.478+0000 7ff443f64700 1 -- 172.21.15.8:0/4195801264 >> 172.21.15.8:0/4195801264 conn(0x7ff43c0fc9d0 msgr2=0x7ff43c102b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:49.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.478+0000 7ff443f64700 1 -- 172.21.15.8:0/4195801264 shutdown_connections 2023-12-17T11:56:49.481 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:49.478+0000 7ff443f64700 1 -- 172.21.15.8:0/4195801264 wait complete. 2023-12-17T11:56:49.677 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:49 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:56:49.855 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi186 2023-12-17T11:56:49.855 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-12-17T11:56:49.855 DEBUG:teuthology.orchestra.run.smithi186:> dd of=/etc/ceph/ceph.conf 2023-12-17T11:56:49.903 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-12-17T11:56:49.903 DEBUG:teuthology.orchestra.run.smithi186:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-17T11:56:49.989 INFO:tasks.cephadm:Adding host smithi186 to orchestrator... 2023-12-17T11:56:49.989 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph orch host add smithi186 2023-12-17T11:56:50.404 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T11:56:50.719 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:50 smithi008 ceph-mon[36830]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:56:50.719 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:50 smithi008 ceph-mon[36830]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-17T11:56:50.719 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:50 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:56:51.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:51.562+0000 7ff1b5852700 1 -- 172.21.15.8:0/2407608824 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1b0073970 msgr2=0x7ff1b0073d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:51.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:51.562+0000 7ff1b5852700 1 --2- 172.21.15.8:0/2407608824 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1b0073970 0x7ff1b0073d50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff1a0009910 tx=0x7ff1a0009c20 comp rx=0 tx=0).stop 2023-12-17T11:56:51.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:51.562+0000 7ff1b5852700 1 -- 172.21.15.8:0/2407608824 shutdown_connections 2023-12-17T11:56:51.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:51.562+0000 7ff1b5852700 1 --2- 172.21.15.8:0/2407608824 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1b0073970 0x7ff1b0073d50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:51.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:51.563+0000 7ff1b5852700 1 -- 172.21.15.8:0/2407608824 >> 172.21.15.8:0/2407608824 conn(0x7ff1b00fc9d0 msgr2=0x7ff1b00fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:51.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:51.563+0000 7ff1b5852700 1 -- 172.21.15.8:0/2407608824 shutdown_connections 2023-12-17T11:56:51.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:51.563+0000 7ff1b5852700 1 -- 172.21.15.8:0/2407608824 wait complete. 2023-12-17T11:56:51.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:51.564+0000 7ff1b5852700 1 Processor -- start 2023-12-17T11:56:51.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:51.564+0000 7ff1b5852700 1 -- start start 2023-12-17T11:56:51.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:51.564+0000 7ff1b5852700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1b0073970 0x7ff1b01a2980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:51.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:51.564+0000 7ff1b5852700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1b01a2ec0 con 0x7ff1b0073970 2023-12-17T11:56:51.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:51.564+0000 7ff1aeffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1b0073970 0x7ff1b01a2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:51.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:51.564+0000 7ff1aeffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1b0073970 0x7ff1b01a2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47534/0 (socket says 172.21.15.8:47534) 2023-12-17T11:56:51.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:51.564+0000 7ff1aeffd700 1 -- 172.21.15.8:0/1908872002 learned_addr learned my addr 172.21.15.8:0/1908872002 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:51.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:51.565+0000 7ff1aeffd700 1 -- 172.21.15.8:0/1908872002 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a00095f0 con 0x7ff1b0073970 2023-12-17T11:56:51.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:51.565+0000 7ff1aeffd700 1 --2- 172.21.15.8:0/1908872002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1b0073970 0x7ff1b01a2980 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff1a00098e0 tx=0x7ff1a0005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:51.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:51.565+0000 7ff1b4850700 1 -- 172.21.15.8:0/1908872002 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1a001d070 con 0x7ff1b0073970 2023-12-17T11:56:51.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:51.565+0000 7ff1b4850700 1 -- 172.21.15.8:0/1908872002 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff1a0009e60 con 0x7ff1b0073970 2023-12-17T11:56:51.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:51.565+0000 7ff1b4850700 1 -- 172.21.15.8:0/1908872002 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff1a0022c10 con 0x7ff1b0073970 2023-12-17T11:56:51.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:51.565+0000 7ff1b5852700 1 -- 172.21.15.8:0/1908872002 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1b01a3120 con 0x7ff1b0073970 2023-12-17T11:56:51.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:51.565+0000 7ff1b5852700 1 -- 172.21.15.8:0/1908872002 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1b019cac0 con 0x7ff1b0073970 2023-12-17T11:56:51.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:51.566+0000 7ff1b4850700 1 -- 172.21.15.8:0/1908872002 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7ff1a0022470 con 0x7ff1b0073970 2023-12-17T11:56:51.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:51.566+0000 7ff1b5852700 1 -- 172.21.15.8:0/1908872002 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1b00750b0 con 0x7ff1b0073970 2023-12-17T11:56:51.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:51.567+0000 7ff1b4850700 1 --2- 172.21.15.8:0/1908872002 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7ff198038910 0x7ff19803add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:51.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:51.567+0000 7ff1b4850700 1 -- 172.21.15.8:0/1908872002 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff1a004cb20 con 0x7ff1b0073970 2023-12-17T11:56:51.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:51.567+0000 7ff1ae7fc700 1 --2- 172.21.15.8:0/1908872002 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7ff198038910 0x7ff19803add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:51.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:51.568+0000 7ff1ae7fc700 1 --2- 172.21.15.8:0/1908872002 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7ff198038910 0x7ff19803add0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4006fd0 tx=0x7ff1a4006e40 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:51.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:51.572+0000 7ff1b4850700 1 -- 172.21.15.8:0/1908872002 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ff1a002b590 con 0x7ff1b0073970 2023-12-17T11:56:51.788 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:51.785+0000 7ff1b5852700 1 -- 172.21.15.8:0/1908872002 --> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi186", "target": ["mon-mgr", ""]}) v1 -- 0x7ff1b019dff0 con 0x7ff198038910 2023-12-17T11:56:52.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:52 smithi008 ceph-mon[36830]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:56:53.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:53 smithi008 ceph-mon[36830]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi186", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:56:53.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:53 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:56:53.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:53 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:56:53.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:53 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:56:53.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:53 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:56:53.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:53 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi100", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:56:53.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:53 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:56:53.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:53 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:56:54.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:54 smithi008 ceph-mon[36830]: Deploying cephadm binary to smithi186 2023-12-17T11:56:54.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:54 smithi008 ceph-mon[36830]: Updating smithi100:/etc/ceph/ceph.conf 2023-12-17T11:56:54.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:54 smithi008 ceph-mon[36830]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:56:56.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:55 smithi008 ceph-mon[36830]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:56:56.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:56.539+0000 7ff1b4850700 1 -- 172.21.15.8:0/1908872002 <== mgr.14154 v2:172.21.15.8:6800/268548699 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7ff1b019dff0 con 0x7ff198038910 2023-12-17T11:56:56.542 INFO:teuthology.orchestra.run.smithi008.stdout:Added host 'smithi186' with addr '172.21.15.186' 2023-12-17T11:56:56.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:56.542+0000 7ff1b5852700 1 -- 172.21.15.8:0/1908872002 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7ff198038910 msgr2=0x7ff19803add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:56.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:56.542+0000 7ff1b5852700 1 --2- 172.21.15.8:0/1908872002 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7ff198038910 0x7ff19803add0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff1a4006fd0 tx=0x7ff1a4006e40 comp rx=0 tx=0).stop 2023-12-17T11:56:56.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:56.542+0000 7ff1b5852700 1 -- 172.21.15.8:0/1908872002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1b0073970 msgr2=0x7ff1b01a2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:56.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:56.542+0000 7ff1b5852700 1 --2- 172.21.15.8:0/1908872002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1b0073970 0x7ff1b01a2980 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff1a00098e0 tx=0x7ff1a0005710 comp rx=0 tx=0).stop 2023-12-17T11:56:56.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:56.542+0000 7ff1b5852700 1 -- 172.21.15.8:0/1908872002 shutdown_connections 2023-12-17T11:56:56.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:56.542+0000 7ff1b5852700 1 --2- 172.21.15.8:0/1908872002 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7ff198038910 0x7ff19803add0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:56.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:56.542+0000 7ff1b5852700 1 --2- 172.21.15.8:0/1908872002 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff1b0073970 0x7ff1b01a2980 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:56.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:56.542+0000 7ff1b5852700 1 -- 172.21.15.8:0/1908872002 >> 172.21.15.8:0/1908872002 conn(0x7ff1b00fc9d0 msgr2=0x7ff1b00fcdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:56.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:56.543+0000 7ff1b5852700 1 -- 172.21.15.8:0/1908872002 shutdown_connections 2023-12-17T11:56:56.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:56.543+0000 7ff1b5852700 1 -- 172.21.15.8:0/1908872002 wait complete. 2023-12-17T11:56:56.913 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph orch host ls --format=json 2023-12-17T11:56:57.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:56 smithi008 ceph-mon[36830]: Updating smithi100:/var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-17T11:56:57.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:56 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:56:57.333 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T11:56:58.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:57 smithi008 ceph-mon[36830]: Added host smithi186 2023-12-17T11:56:58.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:57 smithi008 ceph-mon[36830]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2023-12-17T11:56:58.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:57 smithi008 ceph-mon[36830]: Updating smithi100:/var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-17T11:56:58.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:57 smithi008 ceph-mon[36830]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:56:58.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:57 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:56:58.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:57 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:56:58.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:57 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:56:58.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.519+0000 7fbd38510700 1 -- 172.21.15.8:0/4242174582 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd30101140 msgr2=0x7fbd30101520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:58.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.519+0000 7fbd38510700 1 --2- 172.21.15.8:0/4242174582 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd30101140 0x7fbd30101520 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c009910 tx=0x7fbd2c009c20 comp rx=0 tx=0).stop 2023-12-17T11:56:58.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.519+0000 7fbd38510700 1 -- 172.21.15.8:0/4242174582 shutdown_connections 2023-12-17T11:56:58.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.519+0000 7fbd38510700 1 --2- 172.21.15.8:0/4242174582 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd30101140 0x7fbd30101520 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:58.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.519+0000 7fbd38510700 1 -- 172.21.15.8:0/4242174582 >> 172.21.15.8:0/4242174582 conn(0x7fbd300fc9d0 msgr2=0x7fbd300fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:58.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.519+0000 7fbd38510700 1 -- 172.21.15.8:0/4242174582 shutdown_connections 2023-12-17T11:56:58.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.519+0000 7fbd38510700 1 -- 172.21.15.8:0/4242174582 wait complete. 2023-12-17T11:56:58.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.520+0000 7fbd38510700 1 Processor -- start 2023-12-17T11:56:58.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.521+0000 7fbd38510700 1 -- start start 2023-12-17T11:56:58.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.521+0000 7fbd38510700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd30101140 0x7fbd3019e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:58.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.521+0000 7fbd38510700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3019eb90 con 0x7fbd30101140 2023-12-17T11:56:58.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.521+0000 7fbd362ac700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd30101140 0x7fbd3019e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:58.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.521+0000 7fbd362ac700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd30101140 0x7fbd3019e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47542/0 (socket says 172.21.15.8:47542) 2023-12-17T11:56:58.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.521+0000 7fbd362ac700 1 -- 172.21.15.8:0/3377722146 learned_addr learned my addr 172.21.15.8:0/3377722146 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:56:58.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.522+0000 7fbd362ac700 1 -- 172.21.15.8:0/3377722146 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd2c0095f0 con 0x7fbd30101140 2023-12-17T11:56:58.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.522+0000 7fbd362ac700 1 --2- 172.21.15.8:0/3377722146 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd30101140 0x7fbd3019e650 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c0098e0 tx=0x7fbd2c005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:58.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.522+0000 7fbd277fe700 1 -- 172.21.15.8:0/3377722146 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd2c01d070 con 0x7fbd30101140 2023-12-17T11:56:58.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.522+0000 7fbd277fe700 1 -- 172.21.15.8:0/3377722146 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbd2c009e60 con 0x7fbd30101140 2023-12-17T11:56:58.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.522+0000 7fbd277fe700 1 -- 172.21.15.8:0/3377722146 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbd2c022b30 con 0x7fbd30101140 2023-12-17T11:56:58.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.522+0000 7fbd38510700 1 -- 172.21.15.8:0/3377722146 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd3019ed30 con 0x7fbd30101140 2023-12-17T11:56:58.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.522+0000 7fbd38510700 1 -- 172.21.15.8:0/3377722146 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd3019f150 con 0x7fbd30101140 2023-12-17T11:56:58.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.523+0000 7fbd277fe700 1 -- 172.21.15.8:0/3377722146 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7fbd2c022470 con 0x7fbd30101140 2023-12-17T11:56:58.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.524+0000 7fbd38510700 1 -- 172.21.15.8:0/3377722146 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd30102620 con 0x7fbd30101140 2023-12-17T11:56:58.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.524+0000 7fbd277fe700 1 --2- 172.21.15.8:0/3377722146 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fbd1c038910 0x7fbd1c03add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:56:58.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.524+0000 7fbd277fe700 1 -- 172.21.15.8:0/3377722146 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fbd2c04cd70 con 0x7fbd30101140 2023-12-17T11:56:58.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.524+0000 7fbd35aab700 1 --2- 172.21.15.8:0/3377722146 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fbd1c038910 0x7fbd1c03add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:56:58.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.525+0000 7fbd35aab700 1 --2- 172.21.15.8:0/3377722146 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fbd1c038910 0x7fbd1c03add0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbd20006fd0 tx=0x7fbd20006e40 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:56:58.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.530+0000 7fbd277fe700 1 -- 172.21.15.8:0/3377722146 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fbd2c02ba00 con 0x7fbd30101140 2023-12-17T11:56:58.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.759+0000 7fbd38510700 1 -- 172.21.15.8:0/3377722146 --> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbd3010b0e0 con 0x7fbd1c038910 2023-12-17T11:56:58.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.760+0000 7fbd277fe700 1 -- 172.21.15.8:0/3377722146 <== mgr.14154 v2:172.21.15.8:6800/268548699 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+239 (secure 0 0 0) 0x7fbd3010b0e0 con 0x7fbd1c038910 2023-12-17T11:56:58.762 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T11:56:58.763 INFO:teuthology.orchestra.run.smithi008.stdout:[{"addr": "172.21.15.8", "hostname": "smithi008", "labels": [], "status": ""}, {"addr": "172.21.15.100", "hostname": "smithi100", "labels": [], "status": ""}, {"addr": "172.21.15.186", "hostname": "smithi186", "labels": [], "status": ""}] 2023-12-17T11:56:58.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.762+0000 7fbd38510700 1 -- 172.21.15.8:0/3377722146 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fbd1c038910 msgr2=0x7fbd1c03add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:58.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.762+0000 7fbd38510700 1 --2- 172.21.15.8:0/3377722146 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fbd1c038910 0x7fbd1c03add0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbd20006fd0 tx=0x7fbd20006e40 comp rx=0 tx=0).stop 2023-12-17T11:56:58.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.762+0000 7fbd38510700 1 -- 172.21.15.8:0/3377722146 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd30101140 msgr2=0x7fbd3019e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:56:58.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.762+0000 7fbd38510700 1 --2- 172.21.15.8:0/3377722146 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd30101140 0x7fbd3019e650 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c0098e0 tx=0x7fbd2c005710 comp rx=0 tx=0).stop 2023-12-17T11:56:58.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.762+0000 7fbd38510700 1 -- 172.21.15.8:0/3377722146 shutdown_connections 2023-12-17T11:56:58.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.762+0000 7fbd38510700 1 --2- 172.21.15.8:0/3377722146 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fbd1c038910 0x7fbd1c03add0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:58.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.762+0000 7fbd38510700 1 --2- 172.21.15.8:0/3377722146 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbd30101140 0x7fbd3019e650 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:56:58.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.762+0000 7fbd38510700 1 -- 172.21.15.8:0/3377722146 >> 172.21.15.8:0/3377722146 conn(0x7fbd300fc9d0 msgr2=0x7fbd30102b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:56:58.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.762+0000 7fbd38510700 1 -- 172.21.15.8:0/3377722146 shutdown_connections 2023-12-17T11:56:58.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:56:58.762+0000 7fbd38510700 1 -- 172.21.15.8:0/3377722146 wait complete. 2023-12-17T11:56:59.161 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:58 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:56:59.161 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:56:58 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:56:59.332 INFO:tasks.cephadm:Setting crush tunables to default 2023-12-17T11:56:59.332 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph osd crush tunables default 2023-12-17T11:56:59.745 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T11:57:00.209 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:00 smithi008 ceph-mon[36830]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-17T11:57:00.209 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:00 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:00.209 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:00 smithi008 ceph-mon[36830]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:00.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:00.870+0000 7fbe36fcf700 1 -- 172.21.15.8:0/3251076877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe30101140 msgr2=0x7fbe30101520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:00.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:00.870+0000 7fbe36fcf700 1 --2- 172.21.15.8:0/3251076877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe30101140 0x7fbe30101520 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fbe24009910 tx=0x7fbe24009c20 comp rx=0 tx=0).stop 2023-12-17T11:57:00.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:00.870+0000 7fbe36fcf700 1 -- 172.21.15.8:0/3251076877 shutdown_connections 2023-12-17T11:57:00.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:00.870+0000 7fbe36fcf700 1 --2- 172.21.15.8:0/3251076877 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe30101140 0x7fbe30101520 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:00.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:00.870+0000 7fbe36fcf700 1 -- 172.21.15.8:0/3251076877 >> 172.21.15.8:0/3251076877 conn(0x7fbe300fc9d0 msgr2=0x7fbe300fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:00.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:00.870+0000 7fbe36fcf700 1 -- 172.21.15.8:0/3251076877 shutdown_connections 2023-12-17T11:57:00.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:00.871+0000 7fbe36fcf700 1 -- 172.21.15.8:0/3251076877 wait complete. 2023-12-17T11:57:00.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:00.871+0000 7fbe36fcf700 1 Processor -- start 2023-12-17T11:57:00.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:00.872+0000 7fbe36fcf700 1 -- start start 2023-12-17T11:57:00.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:00.872+0000 7fbe36fcf700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe30101140 0x7fbe300738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:00.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:00.872+0000 7fbe36fcf700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe30075790 con 0x7fbe30101140 2023-12-17T11:57:00.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:00.872+0000 7fbe34d6b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe30101140 0x7fbe300738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:00.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:00.872+0000 7fbe34d6b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe30101140 0x7fbe300738d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47562/0 (socket says 172.21.15.8:47562) 2023-12-17T11:57:00.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:00.872+0000 7fbe34d6b700 1 -- 172.21.15.8:0/1321124994 learned_addr learned my addr 172.21.15.8:0/1321124994 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:57:00.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:00.873+0000 7fbe34d6b700 1 -- 172.21.15.8:0/1321124994 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe240095f0 con 0x7fbe30101140 2023-12-17T11:57:00.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:00.873+0000 7fbe34d6b700 1 --2- 172.21.15.8:0/1321124994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe30101140 0x7fbe300738d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbe240098e0 tx=0x7fbe24005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:00.879 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:00.873+0000 7fbe2dffb700 1 -- 172.21.15.8:0/1321124994 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe2401d070 con 0x7fbe30101140 2023-12-17T11:57:00.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:00.873+0000 7fbe2dffb700 1 -- 172.21.15.8:0/1321124994 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe24009e60 con 0x7fbe30101140 2023-12-17T11:57:00.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:00.873+0000 7fbe2dffb700 1 -- 172.21.15.8:0/1321124994 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fbe24022b30 con 0x7fbe30101140 2023-12-17T11:57:00.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:00.873+0000 7fbe36fcf700 1 -- 172.21.15.8:0/1321124994 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe30073e10 con 0x7fbe30101140 2023-12-17T11:57:00.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:00.873+0000 7fbe36fcf700 1 -- 172.21.15.8:0/1321124994 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe30074230 con 0x7fbe30101140 2023-12-17T11:57:00.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:00.875+0000 7fbe36fcf700 1 -- 172.21.15.8:0/1321124994 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe30102620 con 0x7fbe30101140 2023-12-17T11:57:00.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:00.875+0000 7fbe2dffb700 1 -- 172.21.15.8:0/1321124994 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7fbe24022470 con 0x7fbe30101140 2023-12-17T11:57:00.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:00.875+0000 7fbe2dffb700 1 --2- 172.21.15.8:0/1321124994 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fbe20038910 0x7fbe2003add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:00.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:00.875+0000 7fbe2dffb700 1 -- 172.21.15.8:0/1321124994 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fbe2404cdf0 con 0x7fbe30101140 2023-12-17T11:57:00.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:00.875+0000 7fbe2ffff700 1 --2- 172.21.15.8:0/1321124994 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fbe20038910 0x7fbe2003add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:00.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:00.876+0000 7fbe2ffff700 1 --2- 172.21.15.8:0/1321124994 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fbe20038910 0x7fbe2003add0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c006fd0 tx=0x7fbe1c006e40 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:00.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:00.881+0000 7fbe2dffb700 1 -- 172.21.15.8:0/1321124994 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fbe2402ba00 con 0x7fbe30101140 2023-12-17T11:57:01.103 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:01.100+0000 7fbe36fcf700 1 -- 172.21.15.8:0/1321124994 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fbe30074470 con 0x7fbe30101140 2023-12-17T11:57:01.340 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:01.337+0000 7fbe2dffb700 1 -- 172.21.15.8:0/1321124994 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7fbe24027030 con 0x7fbe30101140 2023-12-17T11:57:01.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:01.340+0000 7fbe36fcf700 1 -- 172.21.15.8:0/1321124994 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fbe20038910 msgr2=0x7fbe2003add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:01.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:01.340+0000 7fbe36fcf700 1 --2- 172.21.15.8:0/1321124994 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fbe20038910 0x7fbe2003add0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fbe1c006fd0 tx=0x7fbe1c006e40 comp rx=0 tx=0).stop 2023-12-17T11:57:01.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:01.340+0000 7fbe36fcf700 1 -- 172.21.15.8:0/1321124994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe30101140 msgr2=0x7fbe300738d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:01.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:01.340+0000 7fbe36fcf700 1 --2- 172.21.15.8:0/1321124994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe30101140 0x7fbe300738d0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fbe240098e0 tx=0x7fbe24005710 comp rx=0 tx=0).stop 2023-12-17T11:57:01.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:01.340+0000 7fbe36fcf700 1 -- 172.21.15.8:0/1321124994 shutdown_connections 2023-12-17T11:57:01.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:01.340+0000 7fbe36fcf700 1 --2- 172.21.15.8:0/1321124994 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fbe20038910 0x7fbe2003add0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:01.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:01.340+0000 7fbe36fcf700 1 --2- 172.21.15.8:0/1321124994 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbe30101140 0x7fbe300738d0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:01.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:01.340+0000 7fbe36fcf700 1 -- 172.21.15.8:0/1321124994 >> 172.21.15.8:0/1321124994 conn(0x7fbe300fc9d0 msgr2=0x7fbe30102b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:01.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:01.340+0000 7fbe36fcf700 1 -- 172.21.15.8:0/1321124994 shutdown_connections 2023-12-17T11:57:01.343 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:01.340+0000 7fbe36fcf700 1 -- 172.21.15.8:0/1321124994 wait complete. 2023-12-17T11:57:01.343 INFO:teuthology.orchestra.run.smithi008.stderr:adjusted tunables profile to default 2023-12-17T11:57:01.678 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:01 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:01.678 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:01 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/1321124994' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-12-17T11:57:01.712 INFO:tasks.cephadm:Adding mon.a on smithi008 2023-12-17T11:57:01.712 INFO:tasks.cephadm:Adding mon.b on smithi100 2023-12-17T11:57:01.713 INFO:tasks.cephadm:Adding mon.c on smithi186 2023-12-17T11:57:01.713 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph orch apply mon '3;smithi008:172.21.15.8=a;smithi100:172.21.15.100=b;smithi186:172.21.15.186=c' 2023-12-17T11:57:02.127 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-17T11:57:02.223 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-17T11:57:02.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:02 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/1321124994' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-12-17T11:57:02.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:02 smithi008 ceph-mon[36830]: osdmap e4: 0 total, 0 up, 0 in 2023-12-17T11:57:02.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:02 smithi008 ceph-mon[36830]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:03.603 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.600+0000 7fc9a15c4700 1 -- 172.21.15.186:0/809427131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc99c100f00 msgr2=0x7fc99c101340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:03.603 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.600+0000 7fc9a15c4700 1 --2- 172.21.15.186:0/809427131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc99c100f00 0x7fc99c101340 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc98c009910 tx=0x7fc98c009c20 comp rx=0 tx=0).stop 2023-12-17T11:57:03.603 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.600+0000 7fc9a15c4700 1 -- 172.21.15.186:0/809427131 shutdown_connections 2023-12-17T11:57:03.603 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.600+0000 7fc9a15c4700 1 --2- 172.21.15.186:0/809427131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc99c100f00 0x7fc99c101340 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:03.603 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.600+0000 7fc9a15c4700 1 -- 172.21.15.186:0/809427131 >> 172.21.15.186:0/809427131 conn(0x7fc99c0fc4f0 msgr2=0x7fc99c0fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:03.603 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.600+0000 7fc9a15c4700 1 -- 172.21.15.186:0/809427131 shutdown_connections 2023-12-17T11:57:03.603 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.600+0000 7fc9a15c4700 1 -- 172.21.15.186:0/809427131 wait complete. 2023-12-17T11:57:03.604 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.601+0000 7fc9a15c4700 1 Processor -- start 2023-12-17T11:57:03.604 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.602+0000 7fc9a15c4700 1 -- start start 2023-12-17T11:57:03.604 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.602+0000 7fc9a15c4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc99c100f00 0x7fc99c198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:03.604 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.602+0000 7fc9a15c4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc99c1989d0 con 0x7fc99c100f00 2023-12-17T11:57:03.605 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.602+0000 7fc99affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc99c100f00 0x7fc99c198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:03.605 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.602+0000 7fc99affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc99c100f00 0x7fc99c198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.186:38326/0 (socket says 172.21.15.186:38326) 2023-12-17T11:57:03.605 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.602+0000 7fc99affd700 1 -- 172.21.15.186:0/1195296168 learned_addr learned my addr 172.21.15.186:0/1195296168 (peer_addr_for_me v2:172.21.15.186:0/0) 2023-12-17T11:57:03.605 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.603+0000 7fc99affd700 1 -- 172.21.15.186:0/1195296168 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc98c0095f0 con 0x7fc99c100f00 2023-12-17T11:57:03.605 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.603+0000 7fc99affd700 1 --2- 172.21.15.186:0/1195296168 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc99c100f00 0x7fc99c198490 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc98c0098e0 tx=0x7fc98c005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:03.606 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.603+0000 7fc983fff700 1 -- 172.21.15.186:0/1195296168 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc98c00ba90 con 0x7fc99c100f00 2023-12-17T11:57:03.606 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.604+0000 7fc983fff700 1 -- 172.21.15.186:0/1195296168 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc98c00bbf0 con 0x7fc99c100f00 2023-12-17T11:57:03.606 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.604+0000 7fc9a15c4700 1 -- 172.21.15.186:0/1195296168 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc99c198c30 con 0x7fc99c100f00 2023-12-17T11:57:03.606 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.604+0000 7fc983fff700 1 -- 172.21.15.186:0/1195296168 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc98c00fe70 con 0x7fc99c100f00 2023-12-17T11:57:03.606 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.604+0000 7fc9a15c4700 1 -- 172.21.15.186:0/1195296168 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc99c19b900 con 0x7fc99c100f00 2023-12-17T11:57:03.607 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.605+0000 7fc983fff700 1 -- 172.21.15.186:0/1195296168 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7fc98c00f460 con 0x7fc99c100f00 2023-12-17T11:57:03.607 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.605+0000 7fc9a15c4700 1 -- 172.21.15.186:0/1195296168 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc99c191e20 con 0x7fc99c100f00 2023-12-17T11:57:03.608 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.605+0000 7fc983fff700 1 --2- 172.21.15.186:0/1195296168 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fc984038910 0x7fc98403add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:03.608 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.605+0000 7fc983fff700 1 -- 172.21.15.186:0/1195296168 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc98c04cac0 con 0x7fc99c100f00 2023-12-17T11:57:03.608 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.606+0000 7fc99a7fc700 1 --2- 172.21.15.186:0/1195296168 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fc984038910 0x7fc98403add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:03.608 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.606+0000 7fc99a7fc700 1 --2- 172.21.15.186:0/1195296168 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fc984038910 0x7fc98403add0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc990006fd0 tx=0x7fc990006e40 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:03.613 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.611+0000 7fc983fff700 1 -- 172.21.15.186:0/1195296168 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fc98c02ad30 con 0x7fc99c100f00 2023-12-17T11:57:03.857 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.853+0000 7fc9a15c4700 1 -- 172.21.15.186:0/1195296168 --> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi008:172.21.15.8=a;smithi100:172.21.15.100=b;smithi186:172.21.15.186=c", "target": ["mon-mgr", ""]}) v1 -- 0x7fc99c061a10 con 0x7fc984038910 2023-12-17T11:57:03.862 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.860+0000 7fc983fff700 1 -- 172.21.15.186:0/1195296168 <== mgr.14154 v2:172.21.15.8:6800/268548699 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fc99c061a10 con 0x7fc984038910 2023-12-17T11:57:03.862 INFO:teuthology.orchestra.run.smithi186.stdout:Scheduled mon update... 2023-12-17T11:57:03.865 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.863+0000 7fc9a15c4700 1 -- 172.21.15.186:0/1195296168 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fc984038910 msgr2=0x7fc98403add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:03.865 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.863+0000 7fc9a15c4700 1 --2- 172.21.15.186:0/1195296168 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fc984038910 0x7fc98403add0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc990006fd0 tx=0x7fc990006e40 comp rx=0 tx=0).stop 2023-12-17T11:57:03.865 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.863+0000 7fc9a15c4700 1 -- 172.21.15.186:0/1195296168 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc99c100f00 msgr2=0x7fc99c198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:03.865 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.863+0000 7fc9a15c4700 1 --2- 172.21.15.186:0/1195296168 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc99c100f00 0x7fc99c198490 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc98c0098e0 tx=0x7fc98c005810 comp rx=0 tx=0).stop 2023-12-17T11:57:03.865 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.863+0000 7fc9a15c4700 1 -- 172.21.15.186:0/1195296168 shutdown_connections 2023-12-17T11:57:03.865 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.863+0000 7fc9a15c4700 1 --2- 172.21.15.186:0/1195296168 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fc984038910 0x7fc98403add0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:03.865 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.863+0000 7fc9a15c4700 1 --2- 172.21.15.186:0/1195296168 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc99c100f00 0x7fc99c198490 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:03.865 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.863+0000 7fc9a15c4700 1 -- 172.21.15.186:0/1195296168 >> 172.21.15.186:0/1195296168 conn(0x7fc99c0fc4f0 msgr2=0x7fc99c0fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:03.866 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.863+0000 7fc9a15c4700 1 -- 172.21.15.186:0/1195296168 shutdown_connections 2023-12-17T11:57:03.866 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:03.863+0000 7fc9a15c4700 1 -- 172.21.15.186:0/1195296168 wait complete. 2023-12-17T11:57:04.253 DEBUG:teuthology.orchestra.run.smithi100:mon.b> sudo journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mon.b.service 2023-12-17T11:57:04.259 DEBUG:teuthology.orchestra.run.smithi186:mon.c> sudo journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mon.c.service 2023-12-17T11:57:04.264 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-12-17T11:57:04.264 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-17T11:57:04.335 INFO:journalctl@ceph.mon.b.smithi100.stdout:-- Logs begin at Sun 2023-12-17 11:35:53 UTC. -- 2023-12-17T11:57:04.336 INFO:journalctl@ceph.mon.c.smithi186.stdout:-- Logs begin at Sun 2023-12-17 11:40:47 UTC. -- 2023-12-17T11:57:04.714 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-17T11:57:04.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:04 smithi008 ceph-mon[36830]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:04.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:04 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:04.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:04 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:04.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:04 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:04.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:04 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:04.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:04 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:57:04.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:04 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:04.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:04 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:57:04.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:04 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:04.811 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /etc/ceph/ceph.conf 2023-12-17T11:57:05.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:05 smithi008 ceph-mon[36830]: Updating smithi186:/etc/ceph/ceph.conf 2023-12-17T11:57:05.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:05 smithi008 ceph-mon[36830]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi008:172.21.15.8=a;smithi100:172.21.15.100=b;smithi186:172.21.15.186=c", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:57:05.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:05 smithi008 ceph-mon[36830]: Saving service mon spec with placement smithi008:172.21.15.8=a;smithi100:172.21.15.100=b;smithi186:172.21.15.186=c;count:3 2023-12-17T11:57:05.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:05 smithi008 ceph-mon[36830]: Updating smithi186:/var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-17T11:57:05.973 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:05.970+0000 7fadbfa0f700 1 -- 172.21.15.186:0/1861793345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadb8101140 msgr2=0x7fadb8101520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:05.973 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:05.970+0000 7fadbfa0f700 1 --2- 172.21.15.186:0/1861793345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadb8101140 0x7fadb8101520 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fadb4009910 tx=0x7fadb4009c20 comp rx=0 tx=0).stop 2023-12-17T11:57:05.973 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:05.971+0000 7fadbfa0f700 1 -- 172.21.15.186:0/1861793345 shutdown_connections 2023-12-17T11:57:05.973 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:05.971+0000 7fadbfa0f700 1 --2- 172.21.15.186:0/1861793345 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadb8101140 0x7fadb8101520 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:05.973 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:05.971+0000 7fadbfa0f700 1 -- 172.21.15.186:0/1861793345 >> 172.21.15.186:0/1861793345 conn(0x7fadb80fc9d0 msgr2=0x7fadb80fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:05.973 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:05.971+0000 7fadbfa0f700 1 -- 172.21.15.186:0/1861793345 shutdown_connections 2023-12-17T11:57:05.973 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:05.971+0000 7fadbfa0f700 1 -- 172.21.15.186:0/1861793345 wait complete. 2023-12-17T11:57:05.974 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:05.972+0000 7fadbfa0f700 1 Processor -- start 2023-12-17T11:57:05.974 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:05.972+0000 7fadbfa0f700 1 -- start start 2023-12-17T11:57:05.974 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:05.973+0000 7fadbfa0f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadb8101140 0x7fadb819e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:05.975 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:05.973+0000 7fadbfa0f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadb819eb50 con 0x7fadb8101140 2023-12-17T11:57:05.975 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:05.973+0000 7fadbd7ab700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadb8101140 0x7fadb819e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:05.975 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:05.973+0000 7fadbd7ab700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadb8101140 0x7fadb819e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.186:40946/0 (socket says 172.21.15.186:40946) 2023-12-17T11:57:05.976 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:05.973+0000 7fadbd7ab700 1 -- 172.21.15.186:0/1665720873 learned_addr learned my addr 172.21.15.186:0/1665720873 (peer_addr_for_me v2:172.21.15.186:0/0) 2023-12-17T11:57:05.976 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:05.974+0000 7fadbd7ab700 1 -- 172.21.15.186:0/1665720873 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadb40095f0 con 0x7fadb8101140 2023-12-17T11:57:05.976 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:05.974+0000 7fadbd7ab700 1 --2- 172.21.15.186:0/1665720873 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadb8101140 0x7fadb819e610 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fadb40098e0 tx=0x7fadb4005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:05.977 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:05.974+0000 7fadae7fc700 1 -- 172.21.15.186:0/1665720873 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fadb401d070 con 0x7fadb8101140 2023-12-17T11:57:05.977 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:05.974+0000 7fadbfa0f700 1 -- 172.21.15.186:0/1665720873 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadb819ed50 con 0x7fadb8101140 2023-12-17T11:57:05.977 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:05.974+0000 7fadae7fc700 1 -- 172.21.15.186:0/1665720873 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fadb4009e60 con 0x7fadb8101140 2023-12-17T11:57:05.977 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:05.974+0000 7fadae7fc700 1 -- 172.21.15.186:0/1665720873 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fadb4022b30 con 0x7fadb8101140 2023-12-17T11:57:05.977 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:05.974+0000 7fadbfa0f700 1 -- 172.21.15.186:0/1665720873 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadb819f170 con 0x7fadb8101140 2023-12-17T11:57:05.977 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:05.975+0000 7fadbfa0f700 1 -- 172.21.15.186:0/1665720873 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadb8102620 con 0x7fadb8101140 2023-12-17T11:57:05.978 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:05.976+0000 7fadae7fc700 1 -- 172.21.15.186:0/1665720873 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7fadb4022470 con 0x7fadb8101140 2023-12-17T11:57:05.978 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:05.976+0000 7fadae7fc700 1 --2- 172.21.15.186:0/1665720873 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fada4038910 0x7fada403add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:05.978 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:05.976+0000 7fadae7fc700 1 -- 172.21.15.186:0/1665720873 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fadb404cbf0 con 0x7fadb8101140 2023-12-17T11:57:05.978 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:05.977+0000 7fadbcfaa700 1 --2- 172.21.15.186:0/1665720873 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fada4038910 0x7fada403add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:05.979 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:05.977+0000 7fadbcfaa700 1 --2- 172.21.15.186:0/1665720873 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fada4038910 0x7fada403add0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fada8006fd0 tx=0x7fada8006e40 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:05.984 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:05.982+0000 7fadae7fc700 1 -- 172.21.15.186:0/1665720873 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fadb402bdf0 con 0x7fadb8101140 2023-12-17T11:57:06.297 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:06.294+0000 7fadbfa0f700 1 -- 172.21.15.186:0/1665720873 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fadb810b0e0 con 0x7fadb8101140 2023-12-17T11:57:06.297 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:06.295+0000 7fadae7fc700 1 -- 172.21.15.186:0/1665720873 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+732 (secure 0 0 0) 0x7fadb4027030 con 0x7fadb8101140 2023-12-17T11:57:06.298 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-12-17T11:57:06.298 INFO:teuthology.orchestra.run.smithi186.stdout:{"epoch":1,"fsid":"f43f508a-9cd2-11ee-95a5-87774f69a715","modified":"2023-12-17T11:55:27.908334Z","created":"2023-12-17T11:55:27.908334Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-17T11:57:06.300 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:06.298+0000 7fadbfa0f700 1 -- 172.21.15.186:0/1665720873 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fada4038910 msgr2=0x7fada403add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:06.300 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:06.298+0000 7fadbfa0f700 1 --2- 172.21.15.186:0/1665720873 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fada4038910 0x7fada403add0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fada8006fd0 tx=0x7fada8006e40 comp rx=0 tx=0).stop 2023-12-17T11:57:06.300 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:06.298+0000 7fadbfa0f700 1 -- 172.21.15.186:0/1665720873 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadb8101140 msgr2=0x7fadb819e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:06.300 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:06.298+0000 7fadbfa0f700 1 --2- 172.21.15.186:0/1665720873 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadb8101140 0x7fadb819e610 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fadb40098e0 tx=0x7fadb4005710 comp rx=0 tx=0).stop 2023-12-17T11:57:06.300 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:06.298+0000 7fadbfa0f700 1 -- 172.21.15.186:0/1665720873 shutdown_connections 2023-12-17T11:57:06.300 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:06.298+0000 7fadbfa0f700 1 --2- 172.21.15.186:0/1665720873 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fada4038910 0x7fada403add0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:06.300 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:06.298+0000 7fadbfa0f700 1 --2- 172.21.15.186:0/1665720873 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fadb8101140 0x7fadb819e610 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:06.300 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:06.298+0000 7fadbfa0f700 1 -- 172.21.15.186:0/1665720873 >> 172.21.15.186:0/1665720873 conn(0x7fadb80fc9d0 msgr2=0x7fadb8104b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:06.300 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:06.298+0000 7fadbfa0f700 1 -- 172.21.15.186:0/1665720873 shutdown_connections 2023-12-17T11:57:06.300 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:06.298+0000 7fadbfa0f700 1 -- 172.21.15.186:0/1665720873 wait complete. 2023-12-17T11:57:06.301 INFO:teuthology.orchestra.run.smithi186.stderr:dumped monmap epoch 1 2023-12-17T11:57:06.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:06 smithi008 ceph-mon[36830]: Updating smithi186:/etc/ceph/ceph.client.admin.keyring 2023-12-17T11:57:06.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:06 smithi008 ceph-mon[36830]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:06.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:06 smithi008 ceph-mon[36830]: Updating smithi186:/var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-17T11:57:06.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:06 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:06.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:06 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:06.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:06 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:06.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:06 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-17T11:57:06.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:06 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:06.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:06 smithi008 ceph-mon[36830]: from='client.? 172.21.15.186:0/1665720873' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:57:07.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:07 smithi008 ceph-mon[36830]: Deploying daemon mon.c on smithi186 2023-12-17T11:57:07.768 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-12-17T11:57:07.769 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-17T11:57:08.299 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.c/config 2023-12-17T11:57:08.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:08 smithi008 ceph-mon[36830]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:09.841 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:09.838+0000 7f34a748a700 1 -- 172.21.15.186:0/315686590 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34a01022a0 msgr2=0x7f34a0102680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:09.841 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:09.838+0000 7f34a748a700 1 --2- 172.21.15.186:0/315686590 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34a01022a0 0x7f34a0102680 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f349c009910 tx=0x7f349c009c20 comp rx=0 tx=0).stop 2023-12-17T11:57:09.842 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:09.838+0000 7f34a748a700 1 -- 172.21.15.186:0/315686590 shutdown_connections 2023-12-17T11:57:09.842 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:09.838+0000 7f34a748a700 1 --2- 172.21.15.186:0/315686590 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34a01022a0 0x7f34a0102680 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:09.842 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:09.838+0000 7f34a748a700 1 -- 172.21.15.186:0/315686590 >> 172.21.15.186:0/315686590 conn(0x7f34a00fba10 msgr2=0x7f34a00fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:09.842 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:09.839+0000 7f34a748a700 1 -- 172.21.15.186:0/315686590 shutdown_connections 2023-12-17T11:57:09.842 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:09.839+0000 7f34a748a700 1 -- 172.21.15.186:0/315686590 wait complete. 2023-12-17T11:57:09.845 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:09.840+0000 7f34a748a700 1 Processor -- start 2023-12-17T11:57:09.845 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:09.840+0000 7f34a748a700 1 -- start start 2023-12-17T11:57:09.845 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:09.840+0000 7f34a748a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34a01022a0 0x7f34a00fff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:09.845 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:09.840+0000 7f34a748a700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34a0101dc0 con 0x7f34a01022a0 2023-12-17T11:57:09.845 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:09.841+0000 7f34a5226700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34a01022a0 0x7f34a00fff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:09.846 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:09.841+0000 7f34a5226700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34a01022a0 0x7f34a00fff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.186:40970/0 (socket says 172.21.15.186:40970) 2023-12-17T11:57:09.846 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:09.841+0000 7f34a5226700 1 -- 172.21.15.186:0/2229927072 learned_addr learned my addr 172.21.15.186:0/2229927072 (peer_addr_for_me v2:172.21.15.186:0/0) 2023-12-17T11:57:09.846 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:09.841+0000 7f34a5226700 1 -- 172.21.15.186:0/2229927072 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349c0095f0 con 0x7f34a01022a0 2023-12-17T11:57:09.846 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:09.842+0000 7f34a5226700 1 --2- 172.21.15.186:0/2229927072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34a01022a0 0x7f34a00fff00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f349c005660 tx=0x7f349c005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:09.846 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:09.842+0000 7f34967fc700 1 -- 172.21.15.186:0/2229927072 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f349c01d070 con 0x7f34a01022a0 2023-12-17T11:57:09.846 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:09.842+0000 7f34a748a700 1 -- 172.21.15.186:0/2229927072 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34a0100440 con 0x7f34a01022a0 2023-12-17T11:57:09.846 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:09.842+0000 7f34967fc700 1 -- 172.21.15.186:0/2229927072 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f349c00b750 con 0x7f34a01022a0 2023-12-17T11:57:09.847 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:09.842+0000 7f34967fc700 1 -- 172.21.15.186:0/2229927072 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f349c0037d0 con 0x7f34a01022a0 2023-12-17T11:57:09.847 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:09.842+0000 7f34a748a700 1 -- 172.21.15.186:0/2229927072 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34a0100860 con 0x7f34a01022a0 2023-12-17T11:57:09.848 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:09.843+0000 7f34967fc700 1 -- 172.21.15.186:0/2229927072 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7f349c003a90 con 0x7f34a01022a0 2023-12-17T11:57:09.848 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:09.843+0000 7f34a748a700 1 -- 172.21.15.186:0/2229927072 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34a0069cc0 con 0x7f34a01022a0 2023-12-17T11:57:09.849 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:09.844+0000 7f34967fc700 1 --2- 172.21.15.186:0/2229927072 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f348c0388c0 0x7f348c03ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:09.849 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:09.844+0000 7f34967fc700 1 -- 172.21.15.186:0/2229927072 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f349c04c890 con 0x7f34a01022a0 2023-12-17T11:57:09.849 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:09.844+0000 7f34a4a25700 1 --2- 172.21.15.186:0/2229927072 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f348c0388c0 0x7f348c03ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:09.849 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:09.845+0000 7f34a4a25700 1 --2- 172.21.15.186:0/2229927072 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f348c0388c0 0x7f348c03ad80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3490006fd0 tx=0x7f3490006e40 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:09.852 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:09.849+0000 7f34967fc700 1 -- 172.21.15.186:0/2229927072 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f349c029770 con 0x7f34a01022a0 2023-12-17T11:57:10.155 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:10.153+0000 7f34a748a700 1 -- 172.21.15.186:0/2229927072 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f34a01014b0 con 0x7f34a01022a0 2023-12-17T11:57:10.155 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:10.153+0000 7f34967fc700 1 -- 172.21.15.186:0/2229927072 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+732 (secure 0 0 0) 0x7f349c026030 con 0x7f34a01022a0 2023-12-17T11:57:10.156 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-12-17T11:57:10.156 INFO:teuthology.orchestra.run.smithi186.stdout:{"epoch":1,"fsid":"f43f508a-9cd2-11ee-95a5-87774f69a715","modified":"2023-12-17T11:55:27.908334Z","created":"2023-12-17T11:55:27.908334Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-12-17T11:57:10.158 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:10.156+0000 7f34a748a700 1 -- 172.21.15.186:0/2229927072 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f348c0388c0 msgr2=0x7f348c03ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:10.158 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:10.156+0000 7f34a748a700 1 --2- 172.21.15.186:0/2229927072 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f348c0388c0 0x7f348c03ad80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f3490006fd0 tx=0x7f3490006e40 comp rx=0 tx=0).stop 2023-12-17T11:57:10.158 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:10.156+0000 7f34a748a700 1 -- 172.21.15.186:0/2229927072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34a01022a0 msgr2=0x7f34a00fff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:10.158 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:10.156+0000 7f34a748a700 1 --2- 172.21.15.186:0/2229927072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34a01022a0 0x7f34a00fff00 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f349c005660 tx=0x7f349c005740 comp rx=0 tx=0).stop 2023-12-17T11:57:10.158 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:10.156+0000 7f34a748a700 1 -- 172.21.15.186:0/2229927072 shutdown_connections 2023-12-17T11:57:10.158 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:10.156+0000 7f34a748a700 1 --2- 172.21.15.186:0/2229927072 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f348c0388c0 0x7f348c03ad80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:10.158 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:10.156+0000 7f34a748a700 1 --2- 172.21.15.186:0/2229927072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f34a01022a0 0x7f34a00fff00 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:10.159 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:10.156+0000 7f34a748a700 1 -- 172.21.15.186:0/2229927072 >> 172.21.15.186:0/2229927072 conn(0x7f34a00fba10 msgr2=0x7f34a0103050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:10.159 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:10.156+0000 7f34a748a700 1 -- 172.21.15.186:0/2229927072 shutdown_connections 2023-12-17T11:57:10.159 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:10.156+0000 7f34a748a700 1 -- 172.21.15.186:0/2229927072 wait complete. 2023-12-17T11:57:10.159 INFO:teuthology.orchestra.run.smithi186.stderr:dumped monmap epoch 1 2023-12-17T11:57:10.438 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:10 smithi186 ceph-mon[41182]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-12-17T11:57:11.622 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-12-17T11:57:11.622 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-17T11:57:12.031 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.c/config 2023-12-17T11:57:15.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:15 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-17T11:57:15.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:15 smithi186 ceph-mon[41182]: mon.a calling monitor election 2023-12-17T11:57:15.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:15 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-17T11:57:15.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:15 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-17T11:57:15.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:15 smithi186 ceph-mon[41182]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:15.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:15 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-17T11:57:15.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:15 smithi186 ceph-mon[41182]: mon.c calling monitor election 2023-12-17T11:57:15.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:15 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-17T11:57:15.727 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:15 smithi186 ceph-mon[41182]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:15.727 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:15 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-17T11:57:15.727 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:15 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-17T11:57:15.727 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:15 smithi186 ceph-mon[41182]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-12-17T11:57:15.727 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:15 smithi186 ceph-mon[41182]: monmap e2: 2 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],c=[v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-17T11:57:15.727 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:15 smithi186 ceph-mon[41182]: fsmap 2023-12-17T11:57:15.727 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:15 smithi186 ceph-mon[41182]: osdmap e4: 0 total, 0 up, 0 in 2023-12-17T11:57:15.727 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:15 smithi186 ceph-mon[41182]: mgrmap e13: x(active, since 47s) 2023-12-17T11:57:15.727 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:15 smithi186 ceph-mon[41182]: overall HEALTH_OK 2023-12-17T11:57:15.727 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:15 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:15.727 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:15 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:15.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:15 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-17T11:57:15.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:15 smithi008 ceph-mon[36830]: mon.a calling monitor election 2023-12-17T11:57:15.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:15 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-17T11:57:15.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:15 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-17T11:57:15.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:15 smithi008 ceph-mon[36830]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:15.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:15 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-17T11:57:15.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:15 smithi008 ceph-mon[36830]: mon.c calling monitor election 2023-12-17T11:57:15.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:15 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-17T11:57:15.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:15 smithi008 ceph-mon[36830]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:15.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:15 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-17T11:57:15.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:15 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-17T11:57:15.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:15 smithi008 ceph-mon[36830]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-12-17T11:57:15.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:15 smithi008 ceph-mon[36830]: monmap e2: 2 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],c=[v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-17T11:57:15.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:15 smithi008 ceph-mon[36830]: fsmap 2023-12-17T11:57:15.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:15 smithi008 ceph-mon[36830]: osdmap e4: 0 total, 0 up, 0 in 2023-12-17T11:57:15.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:15 smithi008 ceph-mon[36830]: mgrmap e13: x(active, since 47s) 2023-12-17T11:57:15.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:15 smithi008 ceph-mon[36830]: overall HEALTH_OK 2023-12-17T11:57:15.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:15 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:15.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:15 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:16.218 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.215+0000 7f228bfd8700 1 -- 172.21.15.186:0/3097200654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22841021d0 msgr2=0x7f2270005610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:16.218 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.215+0000 7f228bfd8700 1 --2- 172.21.15.186:0/3097200654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22841021d0 0x7f2270005610 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2280005fa0 tx=0x7f228000ffc0 comp rx=0 tx=0).stop 2023-12-17T11:57:16.218 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.215+0000 7f228bfd8700 1 -- 172.21.15.186:0/3097200654 shutdown_connections 2023-12-17T11:57:16.218 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.215+0000 7f228bfd8700 1 --2- 172.21.15.186:0/3097200654 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f22841021d0 0x7f2270005610 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:16.218 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.215+0000 7f228bfd8700 1 -- 172.21.15.186:0/3097200654 >> 172.21.15.186:0/3097200654 conn(0x7f2284076bb0 msgr2=0x7f22840fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:16.219 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.216+0000 7f228bfd8700 1 -- 172.21.15.186:0/3097200654 shutdown_connections 2023-12-17T11:57:16.219 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.216+0000 7f228bfd8700 1 -- 172.21.15.186:0/3097200654 wait complete. 2023-12-17T11:57:16.219 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.217+0000 7f228bfd8700 1 Processor -- start 2023-12-17T11:57:16.219 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.217+0000 7f228bfd8700 1 -- start start 2023-12-17T11:57:16.219 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.218+0000 7f228bfd8700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f22841021d0 0x7f22840ffe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:16.220 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.218+0000 7f228bfd8700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2284101a90 0x7f2284100370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:16.220 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.218+0000 7f228bfd8700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22841008b0 con 0x7f2284101a90 2023-12-17T11:57:16.220 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.218+0000 7f228bfd8700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22841009f0 con 0x7f22841021d0 2023-12-17T11:57:16.221 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.218+0000 7f2289573700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2284101a90 0x7f2284100370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:16.221 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.218+0000 7f2289d74700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f22841021d0 0x7f22840ffe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:16.221 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.218+0000 7f2289573700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2284101a90 0x7f2284100370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.186:50422/0 (socket says 172.21.15.186:50422) 2023-12-17T11:57:16.221 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.218+0000 7f2289573700 1 -- 172.21.15.186:0/3199456684 learned_addr learned my addr 172.21.15.186:0/3199456684 (peer_addr_for_me v2:172.21.15.186:0/0) 2023-12-17T11:57:16.221 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.218+0000 7f2289d74700 1 -- 172.21.15.186:0/3199456684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f22841021d0 msgr2=0x7f22840ffe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-12-17T11:57:16.221 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.218+0000 7f2289d74700 1 -- 172.21.15.186:0/3199456684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f22841021d0 msgr2=0x7f22840ffe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-17T11:57:16.221 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.218+0000 7f2289d74700 1 --2- 172.21.15.186:0/3199456684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f22841021d0 0x7f22840ffe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-17T11:57:16.221 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.219+0000 7f2289d74700 1 --2- 172.21.15.186:0/3199456684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f22841021d0 0x7f22840ffe30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-17T11:57:16.221 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.219+0000 7f2289573700 1 -- 172.21.15.186:0/3199456684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f22841021d0 msgr2=0x7f22840ffe30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-17T11:57:16.221 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.219+0000 7f2289573700 1 --2- 172.21.15.186:0/3199456684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f22841021d0 0x7f22840ffe30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:16.221 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.219+0000 7f2289573700 1 -- 172.21.15.186:0/3199456684 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f228000f9c0 con 0x7f2284101a90 2023-12-17T11:57:16.222 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.219+0000 7f2289573700 1 --2- 172.21.15.186:0/3199456684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2284101a90 0x7f2284100370 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f227400b700 tx=0x7f227400bac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:16.222 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.219+0000 7f227affd700 1 -- 172.21.15.186:0/3199456684 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f2274011630 con 0x7f2284101a90 2023-12-17T11:57:16.222 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.220+0000 7f227affd700 1 -- 172.21.15.186:0/3199456684 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2274011c20 con 0x7f2284101a90 2023-12-17T11:57:16.222 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.220+0000 7f227affd700 1 -- 172.21.15.186:0/3199456684 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f2274010b80 con 0x7f2284101a90 2023-12-17T11:57:16.222 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.220+0000 7f228bfd8700 1 -- 172.21.15.186:0/3199456684 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2284100c40 con 0x7f2284101a90 2023-12-17T11:57:16.223 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.220+0000 7f228bfd8700 1 -- 172.21.15.186:0/3199456684 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22841a7450 con 0x7f2284101a90 2023-12-17T11:57:16.223 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.221+0000 7f228bfd8700 1 -- 172.21.15.186:0/3199456684 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22840694f0 con 0x7f2284101a90 2023-12-17T11:57:16.223 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.221+0000 7f227affd700 1 -- 172.21.15.186:0/3199456684 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7f2274010ce0 con 0x7f2284101a90 2023-12-17T11:57:16.223 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.222+0000 7f227affd700 1 --2- 172.21.15.186:0/3199456684 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f2268038700 0x7f226803abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:16.224 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.222+0000 7f227affd700 1 -- 172.21.15.186:0/3199456684 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f227404a930 con 0x7f2284101a90 2023-12-17T11:57:16.224 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.222+0000 7f2289d74700 1 --2- 172.21.15.186:0/3199456684 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f2268038700 0x7f226803abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:16.225 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.223+0000 7f2289d74700 1 --2- 172.21.15.186:0/3199456684 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f2268038700 0x7f226803abc0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f22800059d0 tx=0x7f2280005960 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:16.229 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.227+0000 7f227affd700 1 -- 172.21.15.186:0/3199456684 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f2274010380 con 0x7f2284101a90 2023-12-17T11:57:16.512 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.510+0000 7f228bfd8700 1 -- 172.21.15.186:0/3199456684 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f2284062c00 con 0x7f2284101a90 2023-12-17T11:57:16.513 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.511+0000 7f227affd700 1 -- 172.21.15.186:0/3199456684 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1002 (secure 0 0 0) 0x7f2274018310 con 0x7f2284101a90 2023-12-17T11:57:16.513 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-12-17T11:57:16.513 INFO:teuthology.orchestra.run.smithi186.stdout:{"epoch":2,"fsid":"f43f508a-9cd2-11ee-95a5-87774f69a715","modified":"2023-12-17T11:57:10.272070Z","created":"2023-12-17T11:55:27.908334Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:3300","nonce":0},{"type":"v1","addr":"172.21.15.186:6789","nonce":0}]},"addr":"172.21.15.186:6789/0","public_addr":"172.21.15.186:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-12-17T11:57:16.516 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.513+0000 7f228bfd8700 1 -- 172.21.15.186:0/3199456684 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f2268038700 msgr2=0x7f226803abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:16.516 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.513+0000 7f228bfd8700 1 --2- 172.21.15.186:0/3199456684 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f2268038700 0x7f226803abc0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f22800059d0 tx=0x7f2280005960 comp rx=0 tx=0).stop 2023-12-17T11:57:16.516 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.513+0000 7f228bfd8700 1 -- 172.21.15.186:0/3199456684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2284101a90 msgr2=0x7f2284100370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:16.516 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.513+0000 7f228bfd8700 1 --2- 172.21.15.186:0/3199456684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2284101a90 0x7f2284100370 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f227400b700 tx=0x7f227400bac0 comp rx=0 tx=0).stop 2023-12-17T11:57:16.516 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.513+0000 7f228bfd8700 1 -- 172.21.15.186:0/3199456684 shutdown_connections 2023-12-17T11:57:16.516 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.513+0000 7f228bfd8700 1 --2- 172.21.15.186:0/3199456684 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f2268038700 0x7f226803abc0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:16.517 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.513+0000 7f228bfd8700 1 --2- 172.21.15.186:0/3199456684 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f22841021d0 0x7f22840ffe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:16.517 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.513+0000 7f228bfd8700 1 --2- 172.21.15.186:0/3199456684 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2284101a90 0x7f2284100370 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:16.517 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.513+0000 7f228bfd8700 1 -- 172.21.15.186:0/3199456684 >> 172.21.15.186:0/3199456684 conn(0x7f2284076bb0 msgr2=0x7f2284102fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:16.517 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.513+0000 7f228bfd8700 1 -- 172.21.15.186:0/3199456684 shutdown_connections 2023-12-17T11:57:16.517 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:16.513+0000 7f228bfd8700 1 -- 172.21.15.186:0/3199456684 wait complete. 2023-12-17T11:57:16.518 INFO:teuthology.orchestra.run.smithi186.stderr:dumped monmap epoch 2 2023-12-17T11:57:16.707 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:16 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:16.707 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:16 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-17T11:57:16.707 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:16 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:16.707 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:16 smithi186 ceph-mon[41182]: Deploying daemon mon.b on smithi100 2023-12-17T11:57:16.707 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:16 smithi186 ceph-mon[41182]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:16.707 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:16 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-17T11:57:16.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:16 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:16.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:16 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-17T11:57:16.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:16 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:16.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:16 smithi008 ceph-mon[36830]: Deploying daemon mon.b on smithi100 2023-12-17T11:57:16.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:16 smithi008 ceph-mon[36830]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:16.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:16 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-17T11:57:17.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:17 smithi186 ceph-mon[41182]: from='client.? 172.21.15.186:0/3199456684' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:57:17.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:17 smithi008 ceph-mon[36830]: from='client.? 172.21.15.186:0/3199456684' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:57:17.746 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 11:57:17 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T11:57:17.272+0000 7f5bfcd87700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-17T11:57:17.941 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-12-17T11:57:17.941 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph mon dump -f json 2023-12-17T11:57:18.348 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.c/config 2023-12-17T11:57:18.453 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 systemd[1]: Starting Ceph mon.b for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T11:57:18.652 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:18 smithi186 ceph-mon[41182]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:18.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:18 smithi008 ceph-mon[36830]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:19.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 bash[41228]: 3477e24ddac054562b672d39e8a841148c438b50c0b99f952f1ef35a30f0b801 2023-12-17T11:57:19.167 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 systemd[1]: Started Ceph mon.b for f43f508a-9cd2-11ee-95a5-87774f69a715. 2023-12-17T11:57:19.167 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: set uid:gid to 167:167 (ceph:ceph) 2023-12-17T11:57:19.167 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev), process ceph-mon, pid 7 2023-12-17T11:57:19.167 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: pidfile_write: ignore empty --pid-file 2023-12-17T11:57:19.167 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: load: jerasure load: lrc 2023-12-17T11:57:19.167 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: RocksDB version: 7.9.2 2023-12-17T11:57:19.167 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Git sha 0 2023-12-17T11:57:19.167 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Compile date 2023-12-11 11:29:13 2023-12-17T11:57:19.167 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: DB SUMMARY 2023-12-17T11:57:19.167 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: DB Session ID: JHJTFO284DW7JGII2KDH 2023-12-17T11:57:19.167 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: CURRENT file: CURRENT 2023-12-17T11:57:19.167 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: IDENTITY file: IDENTITY 2023-12-17T11:57:19.167 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-12-17T11:57:19.167 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2023-12-17T11:57:19.168 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2023-12-17T11:57:19.168 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.error_if_exists: 0 2023-12-17T11:57:19.168 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.create_if_missing: 0 2023-12-17T11:57:19.168 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.paranoid_checks: 1 2023-12-17T11:57:19.168 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.flush_verify_memtable_count: 1 2023-12-17T11:57:19.168 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-12-17T11:57:19.168 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-12-17T11:57:19.168 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.env: 0x55eb7cb1aa60 2023-12-17T11:57:19.168 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.fs: PosixFileSystem 2023-12-17T11:57:19.168 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.info_log: 0x55eb7d951780 2023-12-17T11:57:19.168 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.max_file_opening_threads: 16 2023-12-17T11:57:19.168 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.statistics: (nil) 2023-12-17T11:57:19.168 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.use_fsync: 0 2023-12-17T11:57:19.168 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.max_log_file_size: 0 2023-12-17T11:57:19.169 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-12-17T11:57:19.169 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.log_file_time_to_roll: 0 2023-12-17T11:57:19.169 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.keep_log_file_num: 1000 2023-12-17T11:57:19.169 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.recycle_log_file_num: 0 2023-12-17T11:57:19.169 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.allow_fallocate: 1 2023-12-17T11:57:19.169 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.allow_mmap_reads: 0 2023-12-17T11:57:19.169 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.allow_mmap_writes: 0 2023-12-17T11:57:19.169 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.use_direct_reads: 0 2023-12-17T11:57:19.169 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-12-17T11:57:19.169 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.create_missing_column_families: 0 2023-12-17T11:57:19.169 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.db_log_dir: 2023-12-17T11:57:19.169 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.wal_dir: 2023-12-17T11:57:19.169 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.table_cache_numshardbits: 6 2023-12-17T11:57:19.169 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.WAL_ttl_seconds: 0 2023-12-17T11:57:19.170 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.WAL_size_limit_MB: 0 2023-12-17T11:57:19.170 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-12-17T11:57:19.170 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-12-17T11:57:19.170 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.is_fd_close_on_exec: 1 2023-12-17T11:57:19.170 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.advise_random_on_open: 1 2023-12-17T11:57:19.170 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.db_write_buffer_size: 0 2023-12-17T11:57:19.170 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.write_buffer_manager: 0x55eb7d907360 2023-12-17T11:57:19.170 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-12-17T11:57:19.170 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-12-17T11:57:19.170 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.use_adaptive_mutex: 0 2023-12-17T11:57:19.170 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.rate_limiter: (nil) 2023-12-17T11:57:19.170 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-12-17T11:57:19.170 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.wal_recovery_mode: 2 2023-12-17T11:57:19.170 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.enable_thread_tracking: 0 2023-12-17T11:57:19.171 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.enable_pipelined_write: 0 2023-12-17T11:57:19.171 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.unordered_write: 0 2023-12-17T11:57:19.171 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-12-17T11:57:19.171 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-12-17T11:57:19.171 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-12-17T11:57:19.171 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-12-17T11:57:19.171 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.row_cache: None 2023-12-17T11:57:19.171 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.wal_filter: None 2023-12-17T11:57:19.171 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-12-17T11:57:19.171 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.allow_ingest_behind: 0 2023-12-17T11:57:19.171 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.two_write_queues: 0 2023-12-17T11:57:19.171 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.manual_wal_flush: 0 2023-12-17T11:57:19.171 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.wal_compression: 0 2023-12-17T11:57:19.172 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.atomic_flush: 0 2023-12-17T11:57:19.172 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-12-17T11:57:19.172 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.persist_stats_to_disk: 0 2023-12-17T11:57:19.172 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.write_dbid_to_manifest: 0 2023-12-17T11:57:19.172 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.log_readahead_size: 0 2023-12-17T11:57:19.172 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-12-17T11:57:19.172 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.best_efforts_recovery: 0 2023-12-17T11:57:19.172 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-12-17T11:57:19.172 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-12-17T11:57:19.172 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.allow_data_in_errors: 0 2023-12-17T11:57:19.172 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.db_host_id: __hostname__ 2023-12-17T11:57:19.172 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.enforce_single_del_contracts: true 2023-12-17T11:57:19.172 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.max_background_jobs: 2 2023-12-17T11:57:19.172 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.max_background_compactions: -1 2023-12-17T11:57:19.172 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.max_subcompactions: 1 2023-12-17T11:57:19.172 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-12-17T11:57:19.173 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-12-17T11:57:19.173 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.delayed_write_rate : 16777216 2023-12-17T11:57:19.173 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.max_total_wal_size: 0 2023-12-17T11:57:19.173 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-12-17T11:57:19.173 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.stats_dump_period_sec: 600 2023-12-17T11:57:19.173 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.stats_persist_period_sec: 600 2023-12-17T11:57:19.173 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-12-17T11:57:19.173 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.max_open_files: -1 2023-12-17T11:57:19.173 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.bytes_per_sync: 0 2023-12-17T11:57:19.173 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.wal_bytes_per_sync: 0 2023-12-17T11:57:19.173 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.strict_bytes_per_sync: 0 2023-12-17T11:57:19.173 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.compaction_readahead_size: 0 2023-12-17T11:57:19.173 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.max_background_flushes: -1 2023-12-17T11:57:19.173 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Compression algorithms supported: 2023-12-17T11:57:19.174 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-12-17T11:57:19.174 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: kZSTD supported: 0 2023-12-17T11:57:19.174 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: kXpressCompression supported: 0 2023-12-17T11:57:19.174 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: kLZ4HCCompression supported: 1 2023-12-17T11:57:19.174 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: kZlibCompression supported: 1 2023-12-17T11:57:19.174 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: kSnappyCompression supported: 1 2023-12-17T11:57:19.174 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: kLZ4Compression supported: 1 2023-12-17T11:57:19.174 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: kBZip2Compression supported: 0 2023-12-17T11:57:19.174 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Fast CRC32 supported: Supported on x86 2023-12-17T11:57:19.174 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: DMutex implementation: pthread_mutex_t 2023-12-17T11:57:19.174 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2023-12-17T11:57:19.174 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-12-17T11:57:19.174 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-12-17T11:57:19.174 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.merge_operator: 2023-12-17T11:57:19.174 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.compaction_filter: None 2023-12-17T11:57:19.175 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.compaction_filter_factory: None 2023-12-17T11:57:19.175 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.sst_partitioner_factory: None 2023-12-17T11:57:19.175 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.memtable_factory: SkipListFactory 2023-12-17T11:57:19.175 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.table_factory: BlockBasedTable 2023-12-17T11:57:19.175 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55eb7d9518a0) 2023-12-17T11:57:19.175 INFO:journalctl@ceph.mon.b.smithi100.stdout: cache_index_and_filter_blocks: 1 2023-12-17T11:57:19.175 INFO:journalctl@ceph.mon.b.smithi100.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-12-17T11:57:19.175 INFO:journalctl@ceph.mon.b.smithi100.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-12-17T11:57:19.175 INFO:journalctl@ceph.mon.b.smithi100.stdout: pin_top_level_index_and_filter: 1 2023-12-17T11:57:19.175 INFO:journalctl@ceph.mon.b.smithi100.stdout: index_type: 0 2023-12-17T11:57:19.175 INFO:journalctl@ceph.mon.b.smithi100.stdout: data_block_index_type: 0 2023-12-17T11:57:19.175 INFO:journalctl@ceph.mon.b.smithi100.stdout: index_shortening: 1 2023-12-17T11:57:19.175 INFO:journalctl@ceph.mon.b.smithi100.stdout: data_block_hash_table_util_ratio: 0.750000 2023-12-17T11:57:19.175 INFO:journalctl@ceph.mon.b.smithi100.stdout: checksum: 4 2023-12-17T11:57:19.175 INFO:journalctl@ceph.mon.b.smithi100.stdout: no_block_cache: 0 2023-12-17T11:57:19.176 INFO:journalctl@ceph.mon.b.smithi100.stdout: block_cache: 0x55eb7d9a7090 2023-12-17T11:57:19.176 INFO:journalctl@ceph.mon.b.smithi100.stdout: block_cache_name: BinnedLRUCache 2023-12-17T11:57:19.176 INFO:journalctl@ceph.mon.b.smithi100.stdout: block_cache_options: 2023-12-17T11:57:19.176 INFO:journalctl@ceph.mon.b.smithi100.stdout: capacity : 536870912 2023-12-17T11:57:19.176 INFO:journalctl@ceph.mon.b.smithi100.stdout: num_shard_bits : 4 2023-12-17T11:57:19.176 INFO:journalctl@ceph.mon.b.smithi100.stdout: strict_capacity_limit : 0 2023-12-17T11:57:19.176 INFO:journalctl@ceph.mon.b.smithi100.stdout: high_pri_pool_ratio: 0.000 2023-12-17T11:57:19.176 INFO:journalctl@ceph.mon.b.smithi100.stdout: block_cache_compressed: (nil) 2023-12-17T11:57:19.176 INFO:journalctl@ceph.mon.b.smithi100.stdout: persistent_cache: (nil) 2023-12-17T11:57:19.176 INFO:journalctl@ceph.mon.b.smithi100.stdout: block_size: 4096 2023-12-17T11:57:19.176 INFO:journalctl@ceph.mon.b.smithi100.stdout: block_size_deviation: 10 2023-12-17T11:57:19.177 INFO:journalctl@ceph.mon.b.smithi100.stdout: block_restart_interval: 16 2023-12-17T11:57:19.177 INFO:journalctl@ceph.mon.b.smithi100.stdout: index_block_restart_interval: 1 2023-12-17T11:57:19.177 INFO:journalctl@ceph.mon.b.smithi100.stdout: metadata_block_size: 4096 2023-12-17T11:57:19.177 INFO:journalctl@ceph.mon.b.smithi100.stdout: partition_filters: 0 2023-12-17T11:57:19.177 INFO:journalctl@ceph.mon.b.smithi100.stdout: use_delta_encoding: 1 2023-12-17T11:57:19.177 INFO:journalctl@ceph.mon.b.smithi100.stdout: filter_policy: bloomfilter 2023-12-17T11:57:19.177 INFO:journalctl@ceph.mon.b.smithi100.stdout: whole_key_filtering: 1 2023-12-17T11:57:19.177 INFO:journalctl@ceph.mon.b.smithi100.stdout: verify_compression: 0 2023-12-17T11:57:19.177 INFO:journalctl@ceph.mon.b.smithi100.stdout: read_amp_bytes_per_bit: 0 2023-12-17T11:57:19.177 INFO:journalctl@ceph.mon.b.smithi100.stdout: format_version: 5 2023-12-17T11:57:19.177 INFO:journalctl@ceph.mon.b.smithi100.stdout: enable_index_compression: 1 2023-12-17T11:57:19.178 INFO:journalctl@ceph.mon.b.smithi100.stdout: block_align: 0 2023-12-17T11:57:19.178 INFO:journalctl@ceph.mon.b.smithi100.stdout: max_auto_readahead_size: 262144 2023-12-17T11:57:19.178 INFO:journalctl@ceph.mon.b.smithi100.stdout: prepopulate_block_cache: 0 2023-12-17T11:57:19.178 INFO:journalctl@ceph.mon.b.smithi100.stdout: initial_auto_readahead_size: 8192 2023-12-17T11:57:19.178 INFO:journalctl@ceph.mon.b.smithi100.stdout: num_file_reads_for_auto_readahead: 2 2023-12-17T11:57:19.178 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.write_buffer_size: 33554432 2023-12-17T11:57:19.178 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.max_write_buffer_number: 2 2023-12-17T11:57:19.178 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.compression: NoCompression 2023-12-17T11:57:19.178 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.bottommost_compression: Disabled 2023-12-17T11:57:19.178 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.prefix_extractor: nullptr 2023-12-17T11:57:19.178 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-12-17T11:57:19.178 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.num_levels: 7 2023-12-17T11:57:19.179 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-12-17T11:57:19.179 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-12-17T11:57:19.179 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-12-17T11:57:19.179 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-12-17T11:57:19.179 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-12-17T11:57:19.179 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-12-17T11:57:19.179 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-12-17T11:57:19.179 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-12-17T11:57:19.179 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-12-17T11:57:19.179 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-12-17T11:57:19.179 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-12-17T11:57:19.179 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-12-17T11:57:19.179 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.compression_opts.window_bits: -14 2023-12-17T11:57:19.179 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.compression_opts.level: 32767 2023-12-17T11:57:19.179 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.compression_opts.strategy: 0 2023-12-17T11:57:19.180 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-12-17T11:57:19.180 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-12-17T11:57:19.180 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-12-17T11:57:19.180 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-12-17T11:57:19.180 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.compression_opts.enabled: false 2023-12-17T11:57:19.180 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-12-17T11:57:19.180 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-12-17T11:57:19.180 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-12-17T11:57:19.180 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-12-17T11:57:19.180 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.target_file_size_base: 67108864 2023-12-17T11:57:19.180 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.target_file_size_multiplier: 1 2023-12-17T11:57:19.180 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-12-17T11:57:19.180 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-12-17T11:57:19.180 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-12-17T11:57:19.180 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-12-17T11:57:19.181 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-12-17T11:57:19.181 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-12-17T11:57:19.181 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-12-17T11:57:19.181 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-12-17T11:57:19.181 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-12-17T11:57:19.181 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-12-17T11:57:19.181 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-12-17T11:57:19.181 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-12-17T11:57:19.181 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-12-17T11:57:19.181 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.arena_block_size: 1048576 2023-12-17T11:57:19.181 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-12-17T11:57:19.181 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-12-17T11:57:19.181 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.disable_auto_compactions: 0 2023-12-17T11:57:19.181 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-12-17T11:57:19.183 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-12-17T11:57:19.183 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-12-17T11:57:19.183 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-12-17T11:57:19.183 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-12-17T11:57:19.183 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-12-17T11:57:19.183 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-12-17T11:57:19.183 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-12-17T11:57:19.183 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-12-17T11:57:19.183 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-12-17T11:57:19.183 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.table_properties_collectors: 2023-12-17T11:57:19.183 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.inplace_update_support: 0 2023-12-17T11:57:19.183 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.inplace_update_num_locks: 10000 2023-12-17T11:57:19.183 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-12-17T11:57:19.183 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-12-17T11:57:19.184 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.memtable_huge_page_size: 0 2023-12-17T11:57:19.184 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.bloom_locality: 0 2023-12-17T11:57:19.184 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.max_successive_merges: 0 2023-12-17T11:57:19.184 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.optimize_filters_for_hits: 0 2023-12-17T11:57:19.184 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.paranoid_file_checks: 0 2023-12-17T11:57:19.184 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.force_consistency_checks: 1 2023-12-17T11:57:19.184 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.report_bg_io_stats: 0 2023-12-17T11:57:19.184 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.ttl: 2592000 2023-12-17T11:57:19.184 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.periodic_compaction_seconds: 0 2023-12-17T11:57:19.184 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-12-17T11:57:19.184 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-12-17T11:57:19.184 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.enable_blob_files: false 2023-12-17T11:57:19.184 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.min_blob_size: 0 2023-12-17T11:57:19.184 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.blob_file_size: 268435456 2023-12-17T11:57:19.184 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.blob_compression_type: NoCompression 2023-12-17T11:57:19.185 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.enable_blob_garbage_collection: false 2023-12-17T11:57:19.185 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-12-17T11:57:19.185 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-12-17T11:57:19.185 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-12-17T11:57:19.185 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.blob_file_starting_level: 0 2023-12-17T11:57:19.185 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-12-17T11:57:19.185 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-12-17T11:57:19.185 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-12-17T11:57:19.185 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: a370978e-bc05-4a68-9d38-bfa8f76bf25d 2023-12-17T11:57:19.185 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702814238851368, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-12-17T11:57:19.185 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-12-17T11:57:19.185 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702814238852180, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1702814238, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a370978e-bc05-4a68-9d38-bfa8f76bf25d", "db_session_id": "JHJTFO284DW7JGII2KDH", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-12-17T11:57:19.185 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: EVENT_LOG_v1 {"time_micros": 1702814238852402, "job": 1, "event": "recovery_finished"} 2023-12-17T11:57:19.185 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-12-17T11:57:19.185 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-12-17T11:57:19.186 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55eb7da42000 2023-12-17T11:57:19.186 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: DB pointer 0x55eb7da2e000 2023-12-17T11:57:19.186 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-12-17T11:57:19.186 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-12-17T11:57:19.186 INFO:journalctl@ceph.mon.b.smithi100.stdout: ** DB Stats ** 2023-12-17T11:57:19.186 INFO:journalctl@ceph.mon.b.smithi100.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-17T11:57:19.186 INFO:journalctl@ceph.mon.b.smithi100.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-12-17T11:57:19.186 INFO:journalctl@ceph.mon.b.smithi100.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-17T11:57:19.186 INFO:journalctl@ceph.mon.b.smithi100.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-17T11:57:19.186 INFO:journalctl@ceph.mon.b.smithi100.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-12-17T11:57:19.186 INFO:journalctl@ceph.mon.b.smithi100.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-12-17T11:57:19.186 INFO:journalctl@ceph.mon.b.smithi100.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-12-17T11:57:19.186 INFO:journalctl@ceph.mon.b.smithi100.stdout: 2023-12-17T11:57:19.186 INFO:journalctl@ceph.mon.b.smithi100.stdout: ** Compaction Stats [default] ** 2023-12-17T11:57:19.186 INFO:journalctl@ceph.mon.b.smithi100.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-17T11:57:19.187 INFO:journalctl@ceph.mon.b.smithi100.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-12-17T11:57:19.187 INFO:journalctl@ceph.mon.b.smithi100.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-17T11:57:19.187 INFO:journalctl@ceph.mon.b.smithi100.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-17T11:57:19.187 INFO:journalctl@ceph.mon.b.smithi100.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-17T11:57:19.187 INFO:journalctl@ceph.mon.b.smithi100.stdout: 2023-12-17T11:57:19.187 INFO:journalctl@ceph.mon.b.smithi100.stdout: ** Compaction Stats [default] ** 2023-12-17T11:57:19.187 INFO:journalctl@ceph.mon.b.smithi100.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-12-17T11:57:19.187 INFO:journalctl@ceph.mon.b.smithi100.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-12-17T11:57:19.187 INFO:journalctl@ceph.mon.b.smithi100.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-12-17T11:57:19.187 INFO:journalctl@ceph.mon.b.smithi100.stdout: 2023-12-17T11:57:19.187 INFO:journalctl@ceph.mon.b.smithi100.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-12-17T11:57:19.187 INFO:journalctl@ceph.mon.b.smithi100.stdout: 2023-12-17T11:57:19.187 INFO:journalctl@ceph.mon.b.smithi100.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-12-17T11:57:19.187 INFO:journalctl@ceph.mon.b.smithi100.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-12-17T11:57:19.187 INFO:journalctl@ceph.mon.b.smithi100.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-12-17T11:57:19.188 INFO:journalctl@ceph.mon.b.smithi100.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-12-17T11:57:19.188 INFO:journalctl@ceph.mon.b.smithi100.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-12-17T11:57:19.188 INFO:journalctl@ceph.mon.b.smithi100.stdout: AddFile(Keys): cumulative 0, interval 0 2023-12-17T11:57:19.188 INFO:journalctl@ceph.mon.b.smithi100.stdout: Cumulative compaction: 0.00 GB write, 0.31 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-17T11:57:19.188 INFO:journalctl@ceph.mon.b.smithi100.stdout: Interval compaction: 0.00 GB write, 0.31 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-12-17T11:57:19.188 INFO:journalctl@ceph.mon.b.smithi100.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-12-17T11:57:19.188 INFO:journalctl@ceph.mon.b.smithi100.stdout: Block cache BinnedLRUCache@0x55eb7d9a7090#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2023-12-17T11:57:19.188 INFO:journalctl@ceph.mon.b.smithi100.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-12-17T11:57:19.188 INFO:journalctl@ceph.mon.b.smithi100.stdout: 2023-12-17T11:57:19.188 INFO:journalctl@ceph.mon.b.smithi100.stdout: ** File Read Latency Histogram By Level [default] ** 2023-12-17T11:57:19.188 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: mon.b does not exist in monmap, will attempt to join an existing cluster 2023-12-17T11:57:19.188 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: using public_addr v2:172.21.15.100:0/0 -> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] 2023-12-17T11:57:19.188 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: starting mon.b rank -1 at public addrs [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] at bind addrs [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid f43f508a-9cd2-11ee-95a5-87774f69a715 2023-12-17T11:57:19.188 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: mon.b@-1(???) e0 preinit fsid f43f508a-9cd2-11ee-95a5-87774f69a715 2023-12-17T11:57:19.189 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: mon.b@-1(synchronizing).mds e1 new map 2023-12-17T11:57:19.189 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: mon.b@-1(synchronizing).mds e1 print_map 2023-12-17T11:57:19.189 INFO:journalctl@ceph.mon.b.smithi100.stdout: e1 2023-12-17T11:57:19.189 INFO:journalctl@ceph.mon.b.smithi100.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-12-17T11:57:19.189 INFO:journalctl@ceph.mon.b.smithi100.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-12-17T11:57:19.189 INFO:journalctl@ceph.mon.b.smithi100.stdout: legacy client fscid: -1 2023-12-17T11:57:19.189 INFO:journalctl@ceph.mon.b.smithi100.stdout: 2023-12-17T11:57:19.189 INFO:journalctl@ceph.mon.b.smithi100.stdout: No filesystems configured 2023-12-17T11:57:19.189 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-12-17T11:57:19.189 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-12-17T11:57:19.189 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-12-17T11:57:19.189 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-12-17T11:57:19.189 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-12-17T11:57:19.189 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-12-17T11:57:19.189 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-12-17T11:57:19.190 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-12-17T11:57:19.190 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-12-17T11:57:19.190 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-12-17T11:57:19.190 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi186", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:57:19.190 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:19.190 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:19.190 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:19.190 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:19.190 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi100", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:57:19.190 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:19.190 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:57:19.190 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: Deploying cephadm binary to smithi186 2023-12-17T11:57:19.190 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: Updating smithi100:/etc/ceph/ceph.conf 2023-12-17T11:57:19.190 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:19.190 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:19.190 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: Updating smithi100:/var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-17T11:57:19.191 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:19.191 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: Added host smithi186 2023-12-17T11:57:19.191 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: Updating smithi100:/etc/ceph/ceph.client.admin.keyring 2023-12-17T11:57:19.191 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: Updating smithi100:/var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-17T11:57:19.191 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:19.191 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:19.191 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:19.191 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:19.191 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:57:19.191 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:19.191 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-17T11:57:19.191 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:19.191 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:19.191 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:19.191 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/1321124994' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-12-17T11:57:19.192 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/1321124994' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-12-17T11:57:19.192 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: osdmap e4: 0 total, 0 up, 0 in 2023-12-17T11:57:19.192 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:19.192 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:19.192 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:19.192 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:19.192 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:19.192 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:19.192 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi186", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:57:19.192 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:19.192 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:57:19.192 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:19.192 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: Updating smithi186:/etc/ceph/ceph.conf 2023-12-17T11:57:19.192 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi008:172.21.15.8=a;smithi100:172.21.15.100=b;smithi186:172.21.15.186=c", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:57:19.192 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: Saving service mon spec with placement smithi008:172.21.15.8=a;smithi100:172.21.15.100=b;smithi186:172.21.15.186=c;count:3 2023-12-17T11:57:19.193 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: Updating smithi186:/var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-17T11:57:19.193 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: Updating smithi186:/etc/ceph/ceph.client.admin.keyring 2023-12-17T11:57:19.193 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:19.193 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: Updating smithi186:/var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/config/ceph.client.admin.keyring 2023-12-17T11:57:19.193 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:19.193 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:19.193 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:19.193 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-17T11:57:19.193 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:19.193 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='client.? 172.21.15.186:0/1665720873' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:57:19.193 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: Deploying daemon mon.c on smithi186 2023-12-17T11:57:19.193 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:19.193 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-17T11:57:19.193 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: mon.a calling monitor election 2023-12-17T11:57:19.194 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-17T11:57:19.194 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-17T11:57:19.194 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:19.194 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-17T11:57:19.194 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: mon.c calling monitor election 2023-12-17T11:57:19.194 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-17T11:57:19.194 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:19.194 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-17T11:57:19.194 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-17T11:57:19.194 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-12-17T11:57:19.194 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: monmap e2: 2 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],c=[v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-17T11:57:19.194 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: fsmap 2023-12-17T11:57:19.194 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: osdmap e4: 0 total, 0 up, 0 in 2023-12-17T11:57:19.194 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: mgrmap e13: x(active, since 47s) 2023-12-17T11:57:19.194 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: overall HEALTH_OK 2023-12-17T11:57:19.195 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:19.195 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:19.195 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:19.195 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-17T11:57:19.195 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:19.195 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: Deploying daemon mon.b on smithi100 2023-12-17T11:57:19.195 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:19.195 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-17T11:57:19.195 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: from='client.? 172.21.15.186:0/3199456684' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:57:19.195 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:19.195 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:18 smithi100 ceph-mon[41266]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-12-17T11:57:23.920 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.917+0000 7fb5b44aa700 1 -- 172.21.15.186:0/1762522785 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5ac101270 msgr2=0x7fb598005610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:23.920 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.917+0000 7fb5b44aa700 1 --2- 172.21.15.186:0/1762522785 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5ac101270 0x7fb598005610 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8005fa0 tx=0x7fb5a800ff70 comp rx=0 tx=0).stop 2023-12-17T11:57:23.921 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.917+0000 7fb5b44aa700 1 -- 172.21.15.186:0/1762522785 shutdown_connections 2023-12-17T11:57:23.921 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.917+0000 7fb5b44aa700 1 --2- 172.21.15.186:0/1762522785 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5ac101270 0x7fb598005610 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:23.921 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.917+0000 7fb5b44aa700 1 -- 172.21.15.186:0/1762522785 >> 172.21.15.186:0/1762522785 conn(0x7fb5ac0fcb20 msgr2=0x7fb5ac0fef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:23.921 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.917+0000 7fb5b44aa700 1 -- 172.21.15.186:0/1762522785 shutdown_connections 2023-12-17T11:57:23.921 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.918+0000 7fb5b44aa700 1 -- 172.21.15.186:0/1762522785 wait complete. 2023-12-17T11:57:23.923 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.919+0000 7fb5b44aa700 1 Processor -- start 2023-12-17T11:57:23.923 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.919+0000 7fb5b44aa700 1 -- start start 2023-12-17T11:57:23.923 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.920+0000 7fb5b44aa700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5ac101270 0x7fb5ac0738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:23.924 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.920+0000 7fb5b44aa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5ac073e10 0x7fb5ac074290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:23.924 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.920+0000 7fb5b44aa700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5ac1a2a40 0x7fb5ac1a4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:23.924 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.920+0000 7fb5b44aa700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac1a5400 con 0x7fb5ac073e10 2023-12-17T11:57:23.924 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.920+0000 7fb5b44aa700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac1a5540 con 0x7fb5ac101270 2023-12-17T11:57:23.924 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.920+0000 7fb5b44aa700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5ac1a5700 con 0x7fb5ac1a2a40 2023-12-17T11:57:23.924 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.920+0000 7fb5b2a47700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5ac1a2a40 0x7fb5ac1a4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:23.924 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.920+0000 7fb5b1a45700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5ac073e10 0x7fb5ac074290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:23.924 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.920+0000 7fb5b2a47700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5ac1a2a40 0x7fb5ac1a4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:56314/0 (socket says 172.21.15.186:56314) 2023-12-17T11:57:23.924 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.920+0000 7fb5b2a47700 1 -- 172.21.15.186:0/2844989844 learned_addr learned my addr 172.21.15.186:0/2844989844 (peer_addr_for_me v2:172.21.15.186:0/0) 2023-12-17T11:57:23.924 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.920+0000 7fb5b2246700 1 --2- 172.21.15.186:0/2844989844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5ac101270 0x7fb5ac0738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:23.924 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.920+0000 7fb5b2a47700 1 -- 172.21.15.186:0/2844989844 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5ac1a2a40 msgr2=0x7fb5ac1a4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-12-17T11:57:23.924 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.920+0000 7fb5b2a47700 1 -- 172.21.15.186:0/2844989844 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5ac1a2a40 msgr2=0x7fb5ac1a4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-17T11:57:23.924 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.920+0000 7fb5b2a47700 1 --2- 172.21.15.186:0/2844989844 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5ac1a2a40 0x7fb5ac1a4e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-17T11:57:23.925 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.920+0000 7fb5b2a47700 1 --2- 172.21.15.186:0/2844989844 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5ac1a2a40 0x7fb5ac1a4e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-17T11:57:23.925 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.921+0000 7fb5b2246700 1 -- 172.21.15.186:0/2844989844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5ac101270 msgr2=0x7fb5ac0738d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-12-17T11:57:23.925 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.921+0000 7fb5b2246700 1 -- 172.21.15.186:0/2844989844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5ac101270 msgr2=0x7fb5ac0738d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-12-17T11:57:23.925 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.921+0000 7fb5b2246700 1 --2- 172.21.15.186:0/2844989844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5ac101270 0x7fb5ac0738d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-17T11:57:23.925 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.921+0000 7fb5b1a45700 1 -- 172.21.15.186:0/2844989844 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5ac1a2a40 msgr2=0x7fb5ac1a4e30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-17T11:57:23.925 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.921+0000 7fb5b1a45700 1 --2- 172.21.15.186:0/2844989844 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5ac1a2a40 0x7fb5ac1a4e30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:23.925 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.921+0000 7fb5b1a45700 1 -- 172.21.15.186:0/2844989844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5ac101270 msgr2=0x7fb5ac0738d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:23.925 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.921+0000 7fb5b2246700 1 --2- 172.21.15.186:0/2844989844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5ac101270 0x7fb5ac0738d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-17T11:57:23.925 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.921+0000 7fb5b1a45700 1 --2- 172.21.15.186:0/2844989844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5ac101270 0x7fb5ac0738d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:23.925 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.921+0000 7fb5b1a45700 1 -- 172.21.15.186:0/2844989844 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5a800f970 con 0x7fb5ac073e10 2023-12-17T11:57:23.925 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.921+0000 7fb5b1a45700 1 --2- 172.21.15.186:0/2844989844 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5ac073e10 0x7fb5ac074290 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb59c00b550 tx=0x7fb59c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:23.925 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.921+0000 7fb5a37fe700 1 -- 172.21.15.186:0/2844989844 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c004230 con 0x7fb5ac073e10 2023-12-17T11:57:23.925 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.921+0000 7fb5a37fe700 1 -- 172.21.15.186:0/2844989844 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb59c004390 con 0x7fb5ac073e10 2023-12-17T11:57:23.926 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.921+0000 7fb5b44aa700 1 -- 172.21.15.186:0/2844989844 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5ac1a59e0 con 0x7fb5ac073e10 2023-12-17T11:57:23.926 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.921+0000 7fb5a37fe700 1 -- 172.21.15.186:0/2844989844 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb59c011a50 con 0x7fb5ac073e10 2023-12-17T11:57:23.926 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.922+0000 7fb5b44aa700 1 -- 172.21.15.186:0/2844989844 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5ac1a5ee0 con 0x7fb5ac073e10 2023-12-17T11:57:23.927 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.923+0000 7fb5a37fe700 1 -- 172.21.15.186:0/2844989844 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7fb59c011bb0 con 0x7fb5ac073e10 2023-12-17T11:57:23.927 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.923+0000 7fb5b44aa700 1 -- 172.21.15.186:0/2844989844 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5ac102750 con 0x7fb5ac073e10 2023-12-17T11:57:23.927 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.923+0000 7fb5a37fe700 1 --2- 172.21.15.186:0/2844989844 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fb590038d90 0x7fb59003b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:23.927 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.923+0000 7fb5a37fe700 1 -- 172.21.15.186:0/2844989844 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb59c04aef0 con 0x7fb5ac073e10 2023-12-17T11:57:23.927 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.924+0000 7fb5b2246700 1 --2- 172.21.15.186:0/2844989844 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fb590038d90 0x7fb59003b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:23.927 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.924+0000 7fb5b2246700 1 --2- 172.21.15.186:0/2844989844 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fb590038d90 0x7fb59003b250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb5a800f470 tx=0x7fb5a800f3c0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:23.931 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:23.929+0000 7fb5a37fe700 1 -- 172.21.15.186:0/2844989844 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fb59c01ae40 con 0x7fb5ac073e10 2023-12-17T11:57:24.212 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:24.210+0000 7fb5b44aa700 1 -- 172.21.15.186:0/2844989844 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fb5ac062c00 con 0x7fb5ac073e10 2023-12-17T11:57:24.213 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:24.211+0000 7fb5a37fe700 1 -- 172.21.15.186:0/2844989844 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1270 (secure 0 0 0) 0x7fb59c00f2e0 con 0x7fb5ac073e10 2023-12-17T11:57:24.213 INFO:teuthology.orchestra.run.smithi186.stdout: 2023-12-17T11:57:24.213 INFO:teuthology.orchestra.run.smithi186.stdout:{"epoch":3,"fsid":"f43f508a-9cd2-11ee-95a5-87774f69a715","modified":"2023-12-17T11:57:18.894516Z","created":"2023-12-17T11:55:27.908334Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:3300","nonce":0},{"type":"v1","addr":"172.21.15.8:6789","nonce":0}]},"addr":"172.21.15.8:6789/0","public_addr":"172.21.15.8:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:3300","nonce":0},{"type":"v1","addr":"172.21.15.186:6789","nonce":0}]},"addr":"172.21.15.186:6789/0","public_addr":"172.21.15.186:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:3300","nonce":0},{"type":"v1","addr":"172.21.15.100:6789","nonce":0}]},"addr":"172.21.15.100:6789/0","public_addr":"172.21.15.100:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-12-17T11:57:24.216 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:24.213+0000 7fb5b44aa700 1 -- 172.21.15.186:0/2844989844 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fb590038d90 msgr2=0x7fb59003b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:24.216 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:24.213+0000 7fb5b44aa700 1 --2- 172.21.15.186:0/2844989844 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fb590038d90 0x7fb59003b250 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb5a800f470 tx=0x7fb5a800f3c0 comp rx=0 tx=0).stop 2023-12-17T11:57:24.216 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:24.213+0000 7fb5b44aa700 1 -- 172.21.15.186:0/2844989844 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5ac073e10 msgr2=0x7fb5ac074290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:24.216 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:24.213+0000 7fb5b44aa700 1 --2- 172.21.15.186:0/2844989844 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5ac073e10 0x7fb5ac074290 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb59c00b550 tx=0x7fb59c00b910 comp rx=0 tx=0).stop 2023-12-17T11:57:24.216 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:24.214+0000 7fb5b44aa700 1 -- 172.21.15.186:0/2844989844 shutdown_connections 2023-12-17T11:57:24.216 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:24.214+0000 7fb5b44aa700 1 --2- 172.21.15.186:0/2844989844 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fb590038d90 0x7fb59003b250 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:24.217 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:24.214+0000 7fb5b44aa700 1 --2- 172.21.15.186:0/2844989844 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb5ac1a2a40 0x7fb5ac1a4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:24.217 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:24.214+0000 7fb5b44aa700 1 --2- 172.21.15.186:0/2844989844 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fb5ac101270 0x7fb5ac0738d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:24.217 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:24.214+0000 7fb5b44aa700 1 --2- 172.21.15.186:0/2844989844 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fb5ac073e10 0x7fb5ac074290 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:24.217 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:24.214+0000 7fb5b44aa700 1 -- 172.21.15.186:0/2844989844 >> 172.21.15.186:0/2844989844 conn(0x7fb5ac0fcb20 msgr2=0x7fb5ac104c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:24.217 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:24.214+0000 7fb5b44aa700 1 -- 172.21.15.186:0/2844989844 shutdown_connections 2023-12-17T11:57:24.217 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:24.214+0000 7fb5b44aa700 1 -- 172.21.15.186:0/2844989844 wait complete. 2023-12-17T11:57:24.217 INFO:teuthology.orchestra.run.smithi186.stderr:dumped monmap epoch 3 2023-12-17T11:57:24.225 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:23 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-17T11:57:24.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:23 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-17T11:57:24.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:23 smithi186 ceph-mon[41182]: mon.a calling monitor election 2023-12-17T11:57:24.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:23 smithi186 ceph-mon[41182]: mon.c calling monitor election 2023-12-17T11:57:24.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:23 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-17T11:57:24.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:23 smithi186 ceph-mon[41182]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:24.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:23 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-17T11:57:24.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:23 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-17T11:57:24.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:23 smithi186 ceph-mon[41182]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:24.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:23 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-17T11:57:24.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:23 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-17T11:57:24.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:23 smithi186 ceph-mon[41182]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:24.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:23 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-17T11:57:24.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:23 smithi186 ceph-mon[41182]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-12-17T11:57:24.227 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:23 smithi186 ceph-mon[41182]: monmap e3: 3 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],b=[v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0],c=[v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-17T11:57:24.227 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:23 smithi186 ceph-mon[41182]: fsmap 2023-12-17T11:57:24.227 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:23 smithi186 ceph-mon[41182]: osdmap e4: 0 total, 0 up, 0 in 2023-12-17T11:57:24.227 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:23 smithi186 ceph-mon[41182]: mgrmap e13: x(active, since 56s) 2023-12-17T11:57:24.227 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:23 smithi186 ceph-mon[41182]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-12-17T11:57:24.227 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:23 smithi186 ceph-mon[41182]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-12-17T11:57:24.227 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:23 smithi186 ceph-mon[41182]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-12-17T11:57:24.227 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:23 smithi186 ceph-mon[41182]: mon.b (rank 2) addr [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] is down (out of quorum) 2023-12-17T11:57:24.227 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:23 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:24.227 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:23 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:24.227 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:23 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:24.227 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:23 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:24.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:23 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-17T11:57:24.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:23 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-17T11:57:24.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:23 smithi008 ceph-mon[36830]: mon.a calling monitor election 2023-12-17T11:57:24.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:23 smithi008 ceph-mon[36830]: mon.c calling monitor election 2023-12-17T11:57:24.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:23 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-17T11:57:24.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:23 smithi008 ceph-mon[36830]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:24.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:23 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-17T11:57:24.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:23 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-17T11:57:24.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:23 smithi008 ceph-mon[36830]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:24.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:23 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-17T11:57:24.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:23 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-17T11:57:24.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:23 smithi008 ceph-mon[36830]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:24.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:23 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-17T11:57:24.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:23 smithi008 ceph-mon[36830]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-12-17T11:57:24.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:23 smithi008 ceph-mon[36830]: monmap e3: 3 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],b=[v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0],c=[v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-17T11:57:24.247 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:23 smithi008 ceph-mon[36830]: fsmap 2023-12-17T11:57:24.247 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:23 smithi008 ceph-mon[36830]: osdmap e4: 0 total, 0 up, 0 in 2023-12-17T11:57:24.247 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:23 smithi008 ceph-mon[36830]: mgrmap e13: x(active, since 56s) 2023-12-17T11:57:24.247 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:23 smithi008 ceph-mon[36830]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-12-17T11:57:24.247 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:23 smithi008 ceph-mon[36830]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-12-17T11:57:24.247 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:23 smithi008 ceph-mon[36830]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-12-17T11:57:24.247 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:23 smithi008 ceph-mon[36830]: mon.b (rank 2) addr [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] is down (out of quorum) 2023-12-17T11:57:24.247 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:23 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:24.247 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:23 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:24.247 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:23 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:24.247 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:23 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:24.612 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-12-17T11:57:24.612 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph config generate-minimal-conf 2023-12-17T11:57:25.035 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T11:57:25.225 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:24 smithi186 ceph-mon[41182]: from='client.? 172.21.15.186:0/2844989844' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:57:25.225 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:24 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:57:25.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:24 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-17T11:57:25.242 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:24 smithi008 ceph-mon[36830]: from='client.? 172.21.15.186:0/2844989844' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:57:25.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:24 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:57:25.243 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:24 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-17T11:57:26.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:25 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-17T11:57:26.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:25 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-17T11:57:26.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:25 smithi100 ceph-mon[41266]: mon.a calling monitor election 2023-12-17T11:57:26.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:25 smithi100 ceph-mon[41266]: mon.c calling monitor election 2023-12-17T11:57:26.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:25 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-17T11:57:26.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:25 smithi100 ceph-mon[41266]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:26.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:25 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-17T11:57:26.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:25 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-17T11:57:26.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:25 smithi100 ceph-mon[41266]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:26.167 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:25 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-17T11:57:26.167 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:25 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-17T11:57:26.167 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:25 smithi100 ceph-mon[41266]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:26.167 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:25 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-17T11:57:26.167 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:25 smithi100 ceph-mon[41266]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-12-17T11:57:26.167 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:25 smithi100 ceph-mon[41266]: monmap e3: 3 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],b=[v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0],c=[v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-17T11:57:26.167 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:25 smithi100 ceph-mon[41266]: fsmap 2023-12-17T11:57:26.167 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:25 smithi100 ceph-mon[41266]: osdmap e4: 0 total, 0 up, 0 in 2023-12-17T11:57:26.167 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:25 smithi100 ceph-mon[41266]: mgrmap e13: x(active, since 56s) 2023-12-17T11:57:26.167 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:25 smithi100 ceph-mon[41266]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-12-17T11:57:26.167 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:25 smithi100 ceph-mon[41266]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-12-17T11:57:26.167 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:25 smithi100 ceph-mon[41266]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-12-17T11:57:26.167 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:25 smithi100 ceph-mon[41266]: mon.b (rank 2) addr [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] is down (out of quorum) 2023-12-17T11:57:26.167 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:25 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:26.167 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:25 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:26.168 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:25 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:26.168 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:25 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:26.168 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:25 smithi100 ceph-mon[41266]: from='client.? 172.21.15.186:0/2844989844' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-12-17T11:57:26.168 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:25 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:57:26.168 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:25 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-17T11:57:26.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.166+0000 7fba47e30700 1 -- 172.21.15.8:0/1174421541 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba40101140 msgr2=0x7fba40101520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:26.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.166+0000 7fba47e30700 1 --2- 172.21.15.8:0/1174421541 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba40101140 0x7fba40101520 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fba3c009910 tx=0x7fba3c009c20 comp rx=0 tx=0).stop 2023-12-17T11:57:26.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.167+0000 7fba47e30700 1 -- 172.21.15.8:0/1174421541 shutdown_connections 2023-12-17T11:57:26.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.167+0000 7fba47e30700 1 --2- 172.21.15.8:0/1174421541 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba40101140 0x7fba40101520 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:26.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.167+0000 7fba47e30700 1 -- 172.21.15.8:0/1174421541 >> 172.21.15.8:0/1174421541 conn(0x7fba400fc9d0 msgr2=0x7fba400fedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:26.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.167+0000 7fba47e30700 1 -- 172.21.15.8:0/1174421541 shutdown_connections 2023-12-17T11:57:26.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.167+0000 7fba47e30700 1 -- 172.21.15.8:0/1174421541 wait complete. 2023-12-17T11:57:26.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.168+0000 7fba47e30700 1 Processor -- start 2023-12-17T11:57:26.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.168+0000 7fba47e30700 1 -- start start 2023-12-17T11:57:26.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.169+0000 7fba47e30700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba40101140 0x7fba4019c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:26.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.169+0000 7fba47e30700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba4019cc10 0x7fba40196860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:26.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.169+0000 7fba47e30700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba40196da0 0x7fba40197220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:26.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.169+0000 7fba47e30700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4019d280 con 0x7fba40196da0 2023-12-17T11:57:26.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.169+0000 7fba47e30700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba401a34f0 con 0x7fba4019cc10 2023-12-17T11:57:26.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.169+0000 7fba47e30700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba401a3660 con 0x7fba40101140 2023-12-17T11:57:26.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.169+0000 7fba463cd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba40196da0 0x7fba40197220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:26.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.169+0000 7fba453cb700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba4019cc10 0x7fba40196860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:26.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.169+0000 7fba463cd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba40196da0 0x7fba40197220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:37222/0 (socket says 172.21.15.8:37222) 2023-12-17T11:57:26.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.170+0000 7fba463cd700 1 -- 172.21.15.8:0/219184668 learned_addr learned my addr 172.21.15.8:0/219184668 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:57:26.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.170+0000 7fba463cd700 1 -- 172.21.15.8:0/219184668 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba40101140 msgr2=0x7fba4019c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:26.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.170+0000 7fba45bcc700 1 --2- 172.21.15.8:0/219184668 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba40101140 0x7fba4019c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:26.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.170+0000 7fba463cd700 1 --2- 172.21.15.8:0/219184668 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba40101140 0x7fba4019c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:26.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.170+0000 7fba463cd700 1 -- 172.21.15.8:0/219184668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba4019cc10 msgr2=0x7fba40196860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:26.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.170+0000 7fba463cd700 1 --2- 172.21.15.8:0/219184668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba4019cc10 0x7fba40196860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:26.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.170+0000 7fba463cd700 1 -- 172.21.15.8:0/219184668 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba3c0095f0 con 0x7fba40196da0 2023-12-17T11:57:26.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.170+0000 7fba45bcc700 1 --2- 172.21.15.8:0/219184668 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba40101140 0x7fba4019c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:57:26.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.170+0000 7fba463cd700 1 --2- 172.21.15.8:0/219184668 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba40196da0 0x7fba40197220 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fba3800ba50 tx=0x7fba3800bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:26.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.170+0000 7fba36ffd700 1 -- 172.21.15.8:0/219184668 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba3800c9b0 con 0x7fba40196da0 2023-12-17T11:57:26.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.171+0000 7fba36ffd700 1 -- 172.21.15.8:0/219184668 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fba38014440 con 0x7fba40196da0 2023-12-17T11:57:26.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.171+0000 7fba36ffd700 1 -- 172.21.15.8:0/219184668 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba380075b0 con 0x7fba40196da0 2023-12-17T11:57:26.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.171+0000 7fba47e30700 1 -- 172.21.15.8:0/219184668 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba401a3940 con 0x7fba40196da0 2023-12-17T11:57:26.174 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.171+0000 7fba47e30700 1 -- 172.21.15.8:0/219184668 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba401a3df0 con 0x7fba40196da0 2023-12-17T11:57:26.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.172+0000 7fba36ffd700 1 -- 172.21.15.8:0/219184668 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7fba3800cb10 con 0x7fba40196da0 2023-12-17T11:57:26.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.172+0000 7fba47e30700 1 -- 172.21.15.8:0/219184668 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba40102620 con 0x7fba40196da0 2023-12-17T11:57:26.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.172+0000 7fba36ffd700 1 --2- 172.21.15.8:0/219184668 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fba2c038d90 0x7fba2c03b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:26.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.172+0000 7fba36ffd700 1 -- 172.21.15.8:0/219184668 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fba3804ac80 con 0x7fba40196da0 2023-12-17T11:57:26.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.173+0000 7fba45bcc700 1 --2- 172.21.15.8:0/219184668 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fba2c038d90 0x7fba2c03b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:26.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.173+0000 7fba45bcc700 1 --2- 172.21.15.8:0/219184668 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fba2c038d90 0x7fba2c03b250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fba3c00b5c0 tx=0x7fba3c0058e0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:26.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.178+0000 7fba36ffd700 1 -- 172.21.15.8:0/219184668 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fba380148b0 con 0x7fba40196da0 2023-12-17T11:57:26.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.413+0000 7fba47e30700 1 -- 172.21.15.8:0/219184668 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7fba40062c00 con 0x7fba40196da0 2023-12-17T11:57:26.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.414+0000 7fba36ffd700 1 -- 172.21.15.8:0/219184668 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+273 (secure 0 0 0) 0x7fba38012340 con 0x7fba40196da0 2023-12-17T11:57:26.416 INFO:teuthology.orchestra.run.smithi008.stdout:# minimal ceph.conf for f43f508a-9cd2-11ee-95a5-87774f69a715 2023-12-17T11:57:26.416 INFO:teuthology.orchestra.run.smithi008.stdout:[global] 2023-12-17T11:57:26.416 INFO:teuthology.orchestra.run.smithi008.stdout: fsid = f43f508a-9cd2-11ee-95a5-87774f69a715 2023-12-17T11:57:26.416 INFO:teuthology.orchestra.run.smithi008.stdout: mon_host = [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] 2023-12-17T11:57:26.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.416+0000 7fba47e30700 1 -- 172.21.15.8:0/219184668 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fba2c038d90 msgr2=0x7fba2c03b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:26.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.416+0000 7fba47e30700 1 --2- 172.21.15.8:0/219184668 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fba2c038d90 0x7fba2c03b250 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fba3c00b5c0 tx=0x7fba3c0058e0 comp rx=0 tx=0).stop 2023-12-17T11:57:26.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.416+0000 7fba47e30700 1 -- 172.21.15.8:0/219184668 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba40196da0 msgr2=0x7fba40197220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:26.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.416+0000 7fba47e30700 1 --2- 172.21.15.8:0/219184668 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba40196da0 0x7fba40197220 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fba3800ba50 tx=0x7fba3800bd60 comp rx=0 tx=0).stop 2023-12-17T11:57:26.418 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.416+0000 7fba47e30700 1 -- 172.21.15.8:0/219184668 shutdown_connections 2023-12-17T11:57:26.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.416+0000 7fba47e30700 1 --2- 172.21.15.8:0/219184668 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fba2c038d90 0x7fba2c03b250 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:26.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.416+0000 7fba47e30700 1 --2- 172.21.15.8:0/219184668 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fba40196da0 0x7fba40197220 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:26.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.416+0000 7fba47e30700 1 --2- 172.21.15.8:0/219184668 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba40101140 0x7fba4019c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:26.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.416+0000 7fba47e30700 1 --2- 172.21.15.8:0/219184668 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fba4019cc10 0x7fba40196860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:26.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.416+0000 7fba47e30700 1 -- 172.21.15.8:0/219184668 >> 172.21.15.8:0/219184668 conn(0x7fba400fc9d0 msgr2=0x7fba40102b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:26.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.417+0000 7fba47e30700 1 -- 172.21.15.8:0/219184668 shutdown_connections 2023-12-17T11:57:26.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:26.417+0000 7fba47e30700 1 -- 172.21.15.8:0/219184668 wait complete. 2023-12-17T11:57:26.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:26 smithi186 ceph-mon[41182]: mon.b calling monitor election 2023-12-17T11:57:26.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:26 smithi186 ceph-mon[41182]: mon.b calling monitor election 2023-12-17T11:57:26.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:26 smithi186 ceph-mon[41182]: mon.c calling monitor election 2023-12-17T11:57:26.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:26 smithi186 ceph-mon[41182]: mon.a calling monitor election 2023-12-17T11:57:26.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:26 smithi186 ceph-mon[41182]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-12-17T11:57:26.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:26 smithi186 ceph-mon[41182]: monmap e3: 3 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],b=[v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0],c=[v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-17T11:57:26.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:26 smithi186 ceph-mon[41182]: fsmap 2023-12-17T11:57:26.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:26 smithi186 ceph-mon[41182]: osdmap e4: 0 total, 0 up, 0 in 2023-12-17T11:57:26.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:26 smithi186 ceph-mon[41182]: mgrmap e13: x(active, since 58s) 2023-12-17T11:57:26.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:26 smithi186 ceph-mon[41182]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-12-17T11:57:26.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:26 smithi186 ceph-mon[41182]: Cluster is now healthy 2023-12-17T11:57:26.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:26 smithi186 ceph-mon[41182]: overall HEALTH_OK 2023-12-17T11:57:26.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:26 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/219184668' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:26.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:26 smithi008 ceph-mon[36830]: mon.b calling monitor election 2023-12-17T11:57:26.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:26 smithi008 ceph-mon[36830]: mon.b calling monitor election 2023-12-17T11:57:26.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:26 smithi008 ceph-mon[36830]: mon.c calling monitor election 2023-12-17T11:57:26.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:26 smithi008 ceph-mon[36830]: mon.a calling monitor election 2023-12-17T11:57:26.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:26 smithi008 ceph-mon[36830]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-12-17T11:57:26.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:26 smithi008 ceph-mon[36830]: monmap e3: 3 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],b=[v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0],c=[v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-17T11:57:26.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:26 smithi008 ceph-mon[36830]: fsmap 2023-12-17T11:57:26.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:26 smithi008 ceph-mon[36830]: osdmap e4: 0 total, 0 up, 0 in 2023-12-17T11:57:26.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:26 smithi008 ceph-mon[36830]: mgrmap e13: x(active, since 58s) 2023-12-17T11:57:26.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:26 smithi008 ceph-mon[36830]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-12-17T11:57:26.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:26 smithi008 ceph-mon[36830]: Cluster is now healthy 2023-12-17T11:57:26.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:26 smithi008 ceph-mon[36830]: overall HEALTH_OK 2023-12-17T11:57:26.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:26 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/219184668' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:26.812 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-12-17T11:57:26.812 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-12-17T11:57:26.812 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/ceph/ceph.conf 2023-12-17T11:57:26.883 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-12-17T11:57:26.884 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-17T11:57:26.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:26 smithi100 ceph-mon[41266]: mon.b calling monitor election 2023-12-17T11:57:26.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:26 smithi100 ceph-mon[41266]: mon.b calling monitor election 2023-12-17T11:57:26.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:26 smithi100 ceph-mon[41266]: mon.c calling monitor election 2023-12-17T11:57:26.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:26 smithi100 ceph-mon[41266]: mon.a calling monitor election 2023-12-17T11:57:26.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:26 smithi100 ceph-mon[41266]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-12-17T11:57:26.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:26 smithi100 ceph-mon[41266]: monmap e3: 3 mons at {a=[v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0],b=[v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0],c=[v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0]} removed_ranks: {} disallowed_leaders: {} 2023-12-17T11:57:26.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:26 smithi100 ceph-mon[41266]: fsmap 2023-12-17T11:57:26.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:26 smithi100 ceph-mon[41266]: osdmap e4: 0 total, 0 up, 0 in 2023-12-17T11:57:26.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:26 smithi100 ceph-mon[41266]: mgrmap e13: x(active, since 58s) 2023-12-17T11:57:26.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:26 smithi100 ceph-mon[41266]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-12-17T11:57:26.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:26 smithi100 ceph-mon[41266]: Cluster is now healthy 2023-12-17T11:57:26.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:26 smithi100 ceph-mon[41266]: overall HEALTH_OK 2023-12-17T11:57:26.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:26 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/219184668' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:26.999 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-12-17T11:57:26.999 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.conf 2023-12-17T11:57:27.071 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-12-17T11:57:27.071 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-17T11:57:27.179 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-12-17T11:57:27.179 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/ceph/ceph.conf 2023-12-17T11:57:27.250 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-12-17T11:57:27.250 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-12-17T11:57:27.358 INFO:tasks.cephadm:Adding mgr.x on smithi008 2023-12-17T11:57:27.358 INFO:tasks.cephadm:Adding mgr.y on smithi100 2023-12-17T11:57:27.358 INFO:tasks.cephadm:Adding mgr.z on smithi186 2023-12-17T11:57:27.358 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph orch apply mgr '3;smithi008=x;smithi100=y;smithi186=z' 2023-12-17T11:57:27.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:27 smithi186 ceph-mon[41182]: Updating smithi100:/var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-17T11:57:27.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:27 smithi186 ceph-mon[41182]: Updating smithi008:/var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-17T11:57:27.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:27 smithi186 ceph-mon[41182]: Updating smithi186:/var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-17T11:57:27.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:27.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:27.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:27.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:27.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:27.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:27.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:27.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-17T11:57:27.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:27.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:27.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:27.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:27.727 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-17T11:57:27.727 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-17T11:57:27.727 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:27.727 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:27.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:27 smithi008 ceph-mon[36830]: Updating smithi100:/var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-17T11:57:27.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:27 smithi008 ceph-mon[36830]: Updating smithi008:/var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-17T11:57:27.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:27 smithi008 ceph-mon[36830]: Updating smithi186:/var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-17T11:57:27.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:27.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:27.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:27.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:27.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:27.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:27.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:27.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-17T11:57:27.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:27.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:27.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:27.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:27.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-17T11:57:27.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-17T11:57:27.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:27.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:27.789 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.c/config 2023-12-17T11:57:27.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:27 smithi100 ceph-mon[41266]: Updating smithi100:/var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-17T11:57:27.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:27 smithi100 ceph-mon[41266]: Updating smithi008:/var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-17T11:57:27.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:27 smithi100 ceph-mon[41266]: Updating smithi186:/var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/config/ceph.conf 2023-12-17T11:57:27.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:27.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:27.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:27.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:27.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:27.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:27.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:27.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-17T11:57:27.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:27.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:27.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:27.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:27.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-17T11:57:27.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-17T11:57:27.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:27.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:28.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:28 smithi186 ceph-mon[41182]: Reconfiguring mon.a (unknown last config time)... 2023-12-17T11:57:28.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:28 smithi186 ceph-mon[41182]: Reconfiguring daemon mon.a on smithi008 2023-12-17T11:57:28.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:28 smithi186 ceph-mon[41182]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:28.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:28 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:28.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:28 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:28.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:28 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-17T11:57:28.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:28 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-17T11:57:28.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:28 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:28.727 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:28 smithi100 ceph-mon[41266]: Reconfiguring mon.a (unknown last config time)... 2023-12-17T11:57:28.727 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:28 smithi100 ceph-mon[41266]: Reconfiguring daemon mon.a on smithi008 2023-12-17T11:57:28.727 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:28 smithi100 ceph-mon[41266]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:28.727 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:28 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:28.727 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:28 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:28.727 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:28 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-17T11:57:28.727 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:28 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-17T11:57:28.727 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:28 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:28.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:28 smithi008 ceph-mon[36830]: Reconfiguring mon.a (unknown last config time)... 2023-12-17T11:57:28.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:28 smithi008 ceph-mon[36830]: Reconfiguring daemon mon.a on smithi008 2023-12-17T11:57:28.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:28 smithi008 ceph-mon[36830]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:28.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:28 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:28.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:28 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:28.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:28 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-17T11:57:28.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:28 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-17T11:57:28.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:28 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:29.001 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:28.999+0000 7f248123c700 1 -- 172.21.15.186:0/3528667760 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f247c101060 msgr2=0x7f247c101480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:29.001 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:28.999+0000 7f248123c700 1 --2- 172.21.15.186:0/3528667760 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f247c101060 0x7f247c101480 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f246c009910 tx=0x7f246c009c20 comp rx=0 tx=0).stop 2023-12-17T11:57:29.002 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:28.999+0000 7f248123c700 1 -- 172.21.15.186:0/3528667760 shutdown_connections 2023-12-17T11:57:29.002 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:28.999+0000 7f248123c700 1 --2- 172.21.15.186:0/3528667760 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f247c101060 0x7f247c101480 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:29.002 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:28.999+0000 7f248123c700 1 -- 172.21.15.186:0/3528667760 >> 172.21.15.186:0/3528667760 conn(0x7f247c0fc620 msgr2=0x7f247c0fea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:29.002 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:28.999+0000 7f248123c700 1 -- 172.21.15.186:0/3528667760 shutdown_connections 2023-12-17T11:57:29.002 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:28.999+0000 7f248123c700 1 -- 172.21.15.186:0/3528667760 wait complete. 2023-12-17T11:57:29.003 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.000+0000 7f248123c700 1 Processor -- start 2023-12-17T11:57:29.003 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.000+0000 7f248123c700 1 -- start start 2023-12-17T11:57:29.003 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.000+0000 7f248123c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f247c101060 0x7f247c198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:29.003 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.000+0000 7f248123c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f247c198c80 0x7f247c19dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:29.003 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.000+0000 7f248123c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f247c199100 0x7f247c1a0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:29.004 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.000+0000 7f248123c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247c1a09d0 con 0x7f247c198c80 2023-12-17T11:57:29.004 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.000+0000 7f248123c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247c1a0b40 con 0x7f247c101060 2023-12-17T11:57:29.004 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.000+0000 7f248123c700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f247c1a0d00 con 0x7f247c199100 2023-12-17T11:57:29.004 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.001+0000 7f247b59e700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f247c199100 0x7f247c1a0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:29.004 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.001+0000 7f247b59e700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f247c199100 0x7f247c1a0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:52066/0 (socket says 172.21.15.186:52066) 2023-12-17T11:57:29.004 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.001+0000 7f247b59e700 1 -- 172.21.15.186:0/3107860283 learned_addr learned my addr 172.21.15.186:0/3107860283 (peer_addr_for_me v2:172.21.15.186:0/0) 2023-12-17T11:57:29.004 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.001+0000 7f247a59c700 1 --2- 172.21.15.186:0/3107860283 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f247c198c80 0x7f247c19dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:29.004 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.001+0000 7f247ad9d700 1 --2- 172.21.15.186:0/3107860283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f247c101060 0x7f247c198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:29.004 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.001+0000 7f247b59e700 1 -- 172.21.15.186:0/3107860283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f247c101060 msgr2=0x7f247c198740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:29.004 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.001+0000 7f247b59e700 1 --2- 172.21.15.186:0/3107860283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f247c101060 0x7f247c198740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:29.004 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.001+0000 7f247b59e700 1 -- 172.21.15.186:0/3107860283 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f247c198c80 msgr2=0x7f247c19dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:29.004 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.001+0000 7f247b59e700 1 --2- 172.21.15.186:0/3107860283 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f247c198c80 0x7f247c19dca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:29.004 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.001+0000 7f247b59e700 1 -- 172.21.15.186:0/3107860283 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f246c0095f0 con 0x7f247c199100 2023-12-17T11:57:29.006 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.002+0000 7f247b59e700 1 --2- 172.21.15.186:0/3107860283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f247c199100 0x7f247c1a0230 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f247400ba50 tx=0x7f247400bd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:29.006 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.002+0000 7f2463fff700 1 -- 172.21.15.186:0/3107860283 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247400c930 con 0x7f247c199100 2023-12-17T11:57:29.006 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.002+0000 7f2463fff700 1 -- 172.21.15.186:0/3107860283 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2474014440 con 0x7f247c199100 2023-12-17T11:57:29.006 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.002+0000 7f248123c700 1 -- 172.21.15.186:0/3107860283 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f247c1a0fe0 con 0x7f247c199100 2023-12-17T11:57:29.006 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.002+0000 7f2463fff700 1 -- 172.21.15.186:0/3107860283 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24740075b0 con 0x7f247c199100 2023-12-17T11:57:29.006 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.002+0000 7f248123c700 1 -- 172.21.15.186:0/3107860283 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f247c1a1480 con 0x7f247c199100 2023-12-17T11:57:29.006 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.003+0000 7f2463fff700 1 -- 172.21.15.186:0/3107860283 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7f24740145b0 con 0x7f247c199100 2023-12-17T11:57:29.006 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.003+0000 7f248123c700 1 -- 172.21.15.186:0/3107860283 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f247c192030 con 0x7f247c199100 2023-12-17T11:57:29.006 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.003+0000 7f2463fff700 1 --2- 172.21.15.186:0/3107860283 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f2464038d90 0x7f246403b250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:29.006 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.004+0000 7f2463fff700 1 -- 172.21.15.186:0/3107860283 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f247404ac60 con 0x7f247c199100 2023-12-17T11:57:29.006 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.004+0000 7f247ad9d700 1 --2- 172.21.15.186:0/3107860283 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f2464038d90 0x7f246403b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:29.007 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.005+0000 7f247ad9d700 1 --2- 172.21.15.186:0/3107860283 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f2464038d90 0x7f246403b250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f246c009fd0 tx=0x7f246c005160 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:29.011 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.009+0000 7f2463fff700 1 -- 172.21.15.186:0/3107860283 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f24740139f0 con 0x7f247c199100 2023-12-17T11:57:29.221 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.219+0000 7f248123c700 1 -- 172.21.15.186:0/3107860283 --> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi008=x;smithi100=y;smithi186=z", "target": ["mon-mgr", ""]}) v1 -- 0x7f247c02d3b0 con 0x7f2464038d90 2023-12-17T11:57:29.229 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.227+0000 7f2463fff700 1 -- 172.21.15.186:0/3107860283 <== mgr.14154 v2:172.21.15.8:6800/268548699 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f247c02d3b0 con 0x7f2464038d90 2023-12-17T11:57:29.229 INFO:teuthology.orchestra.run.smithi186.stdout:Scheduled mgr update... 2023-12-17T11:57:29.232 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.229+0000 7f248123c700 1 -- 172.21.15.186:0/3107860283 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f2464038d90 msgr2=0x7f246403b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:29.232 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.229+0000 7f248123c700 1 --2- 172.21.15.186:0/3107860283 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f2464038d90 0x7f246403b250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f246c009fd0 tx=0x7f246c005160 comp rx=0 tx=0).stop 2023-12-17T11:57:29.232 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.229+0000 7f248123c700 1 -- 172.21.15.186:0/3107860283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f247c199100 msgr2=0x7f247c1a0230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:29.232 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.229+0000 7f248123c700 1 --2- 172.21.15.186:0/3107860283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f247c199100 0x7f247c1a0230 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f247400ba50 tx=0x7f247400bd60 comp rx=0 tx=0).stop 2023-12-17T11:57:29.232 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.230+0000 7f248123c700 1 -- 172.21.15.186:0/3107860283 shutdown_connections 2023-12-17T11:57:29.232 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.230+0000 7f248123c700 1 --2- 172.21.15.186:0/3107860283 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f2464038d90 0x7f246403b250 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:29.232 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.230+0000 7f248123c700 1 --2- 172.21.15.186:0/3107860283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f247c199100 0x7f247c1a0230 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:29.232 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.230+0000 7f248123c700 1 --2- 172.21.15.186:0/3107860283 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f247c101060 0x7f247c198740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:29.232 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.230+0000 7f248123c700 1 --2- 172.21.15.186:0/3107860283 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f247c198c80 0x7f247c19dca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:29.232 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.230+0000 7f248123c700 1 -- 172.21.15.186:0/3107860283 >> 172.21.15.186:0/3107860283 conn(0x7f247c0fc620 msgr2=0x7f247c0fea10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:29.232 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.230+0000 7f248123c700 1 -- 172.21.15.186:0/3107860283 shutdown_connections 2023-12-17T11:57:29.232 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:57:29.230+0000 7f248123c700 1 -- 172.21.15.186:0/3107860283 wait complete. 2023-12-17T11:57:29.599 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:29 smithi186 ceph-mon[41182]: Reconfiguring mon.b (monmap changed)... 2023-12-17T11:57:29.600 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:29 smithi186 ceph-mon[41182]: Reconfiguring daemon mon.b on smithi100 2023-12-17T11:57:29.600 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:29 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:29.600 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:29 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:29.600 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:29 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:29.600 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:29 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-17T11:57:29.600 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:29 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-17T11:57:29.600 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:29 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:29.638 DEBUG:teuthology.orchestra.run.smithi100:mgr.y> sudo journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mgr.y.service 2023-12-17T11:57:29.643 DEBUG:teuthology.orchestra.run.smithi186:mgr.z> sudo journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mgr.z.service 2023-12-17T11:57:29.648 INFO:tasks.cephadm:Deploying OSDs... 2023-12-17T11:57:29.649 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-12-17T11:57:29.649 DEBUG:teuthology.orchestra.run.smithi008:> dd if=/scratch_devs of=/dev/stdout 2023-12-17T11:57:29.697 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-17T11:57:29.698 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_1 2023-12-17T11:57:29.713 INFO:journalctl@ceph.mgr.y.smithi100.stdout:-- Logs begin at Sun 2023-12-17 11:35:53 UTC. -- 2023-12-17T11:57:29.721 INFO:journalctl@ceph.mgr.z.smithi186.stdout:-- Logs begin at Sun 2023-12-17 11:40:47 UTC. -- 2023-12-17T11:57:29.745 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-17T11:57:29.745 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-17T11:57:29.745 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 5h/5d Inode: 452 Links: 1 2023-12-17T11:57:29.745 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-17T11:57:29.745 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-12-17T11:57:29.746 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-12-17 11:56:38.225650008 +0000 2023-12-17T11:57:29.746 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-12-17 11:48:40.892797755 +0000 2023-12-17T11:57:29.746 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-12-17 11:48:40.892797755 +0000 2023-12-17T11:57:29.746 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2023-12-17 11:48:40.868798025 +0000 2023-12-17T11:57:29.746 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-17T11:57:29.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:29 smithi008 ceph-mon[36830]: Reconfiguring mon.b (monmap changed)... 2023-12-17T11:57:29.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:29 smithi008 ceph-mon[36830]: Reconfiguring daemon mon.b on smithi100 2023-12-17T11:57:29.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:29 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:29.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:29 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:29.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:29 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:29.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:29 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-17T11:57:29.748 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:29 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-17T11:57:29.748 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:29 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:29.816 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-12-17T11:57:29.816 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-12-17T11:57:29.816 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000194457 s, 2.6 MB/s 2023-12-17T11:57:29.819 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-17T11:57:29.866 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_2 2023-12-17T11:57:29.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:29 smithi100 ceph-mon[41266]: Reconfiguring mon.b (monmap changed)... 2023-12-17T11:57:29.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:29 smithi100 ceph-mon[41266]: Reconfiguring daemon mon.b on smithi100 2023-12-17T11:57:29.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:29 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:29.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:29 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:29.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:29 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:29.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:29 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-12-17T11:57:29.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:29 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-12-17T11:57:29.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:29 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:29.951 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-17T11:57:29.951 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-17T11:57:29.951 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 5h/5d Inode: 458 Links: 1 2023-12-17T11:57:29.951 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-17T11:57:29.951 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-12-17T11:57:29.951 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-12-17 11:56:38.290649275 +0000 2023-12-17T11:57:29.951 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-12-17 11:48:41.713788487 +0000 2023-12-17T11:57:29.951 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-12-17 11:48:41.713788487 +0000 2023-12-17T11:57:29.951 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2023-12-17 11:48:41.691788736 +0000 2023-12-17T11:57:29.951 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-17T11:57:30.058 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-12-17T11:57:30.058 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-12-17T11:57:30.058 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000218103 s, 2.3 MB/s 2023-12-17T11:57:30.060 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-17T11:57:30.106 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_3 2023-12-17T11:57:30.191 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-17T11:57:30.191 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-17T11:57:30.191 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 5h/5d Inode: 464 Links: 1 2023-12-17T11:57:30.191 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-17T11:57:30.191 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-12-17T11:57:30.191 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-12-17 11:56:38.360648486 +0000 2023-12-17T11:57:30.191 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-12-17 11:48:42.544779106 +0000 2023-12-17T11:57:30.191 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-12-17 11:48:42.544779106 +0000 2023-12-17T11:57:30.191 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2023-12-17 11:48:42.522779355 +0000 2023-12-17T11:57:30.192 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-17T11:57:30.298 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-12-17T11:57:30.298 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-12-17T11:57:30.298 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.00019003 s, 2.7 MB/s 2023-12-17T11:57:30.300 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-17T11:57:30.346 DEBUG:teuthology.orchestra.run.smithi008:> stat /dev/vg_nvme/lv_4 2023-12-17T11:57:30.430 INFO:teuthology.orchestra.run.smithi008.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-17T11:57:30.430 INFO:teuthology.orchestra.run.smithi008.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-17T11:57:30.430 INFO:teuthology.orchestra.run.smithi008.stdout:Device: 5h/5d Inode: 470 Links: 1 2023-12-17T11:57:30.431 INFO:teuthology.orchestra.run.smithi008.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-17T11:57:30.431 INFO:teuthology.orchestra.run.smithi008.stdout:Context: system_u:object_r:device_t:s0 2023-12-17T11:57:30.431 INFO:teuthology.orchestra.run.smithi008.stdout:Access: 2023-12-17 11:56:38.430647697 +0000 2023-12-17T11:57:30.431 INFO:teuthology.orchestra.run.smithi008.stdout:Modify: 2023-12-17 11:48:43.384769624 +0000 2023-12-17T11:57:30.431 INFO:teuthology.orchestra.run.smithi008.stdout:Change: 2023-12-17 11:48:43.384769624 +0000 2023-12-17T11:57:30.431 INFO:teuthology.orchestra.run.smithi008.stdout: Birth: 2023-12-17 11:48:43.365769839 +0000 2023-12-17T11:57:30.431 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-17T11:57:30.538 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records in 2023-12-17T11:57:30.538 INFO:teuthology.orchestra.run.smithi008.stderr:1+0 records out 2023-12-17T11:57:30.538 INFO:teuthology.orchestra.run.smithi008.stderr:512 bytes copied, 0.000218788 s, 2.3 MB/s 2023-12-17T11:57:30.541 DEBUG:teuthology.orchestra.run.smithi008:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-17T11:57:30.589 DEBUG:teuthology.orchestra.run.smithi100:> set -ex 2023-12-17T11:57:30.589 DEBUG:teuthology.orchestra.run.smithi100:> dd if=/scratch_devs of=/dev/stdout 2023-12-17T11:57:30.636 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-17T11:57:30.636 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_1 2023-12-17T11:57:30.723 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-17T11:57:30.723 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-17T11:57:30.723 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 451 Links: 1 2023-12-17T11:57:30.723 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-17T11:57:30.723 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2023-12-17T11:57:30.723 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2023-12-17 11:57:18.260065760 +0000 2023-12-17T11:57:30.723 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2023-12-17 11:48:44.992042489 +0000 2023-12-17T11:57:30.723 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2023-12-17 11:48:44.992042489 +0000 2023-12-17T11:57:30.723 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2023-12-17 11:48:44.967043135 +0000 2023-12-17T11:57:30.724 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-17T11:57:30.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:30 smithi186 ceph-mon[41182]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi008=x;smithi100=y;smithi186=z", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:57:30.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:30 smithi186 ceph-mon[41182]: Saving service mgr spec with placement smithi008=x;smithi100=y;smithi186=z;count:3 2023-12-17T11:57:30.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:30 smithi186 ceph-mon[41182]: Reconfiguring mon.c (monmap changed)... 2023-12-17T11:57:30.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:30 smithi186 ceph-mon[41182]: Reconfiguring daemon mon.c on smithi186 2023-12-17T11:57:30.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:30 smithi186 ceph-mon[41182]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:30.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:30 smithi008 ceph-mon[36830]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi008=x;smithi100=y;smithi186=z", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:57:30.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:30 smithi008 ceph-mon[36830]: Saving service mgr spec with placement smithi008=x;smithi100=y;smithi186=z;count:3 2023-12-17T11:57:30.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:30 smithi008 ceph-mon[36830]: Reconfiguring mon.c (monmap changed)... 2023-12-17T11:57:30.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:30 smithi008 ceph-mon[36830]: Reconfiguring daemon mon.c on smithi186 2023-12-17T11:57:30.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:30 smithi008 ceph-mon[36830]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:30.784 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:30 smithi100 ceph-mon[41266]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi008=x;smithi100=y;smithi186=z", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:57:30.784 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:30 smithi100 ceph-mon[41266]: Saving service mgr spec with placement smithi008=x;smithi100=y;smithi186=z;count:3 2023-12-17T11:57:30.784 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:30 smithi100 ceph-mon[41266]: Reconfiguring mon.c (monmap changed)... 2023-12-17T11:57:30.784 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:30 smithi100 ceph-mon[41266]: Reconfiguring daemon mon.c on smithi186 2023-12-17T11:57:30.784 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:30 smithi100 ceph-mon[41266]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:30.791 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2023-12-17T11:57:30.791 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2023-12-17T11:57:30.791 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000306545 s, 1.7 MB/s 2023-12-17T11:57:30.793 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-17T11:57:30.838 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_2 2023-12-17T11:57:30.923 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-17T11:57:30.924 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-17T11:57:30.924 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 457 Links: 1 2023-12-17T11:57:30.924 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-17T11:57:30.924 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2023-12-17T11:57:30.924 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2023-12-17 11:57:18.260065760 +0000 2023-12-17T11:57:30.924 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2023-12-17 11:48:45.813021290 +0000 2023-12-17T11:57:30.924 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2023-12-17 11:48:45.813021290 +0000 2023-12-17T11:57:30.924 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2023-12-17 11:48:45.786021988 +0000 2023-12-17T11:57:30.924 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-17T11:57:31.029 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2023-12-17T11:57:31.029 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2023-12-17T11:57:31.029 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000339054 s, 1.5 MB/s 2023-12-17T11:57:31.032 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-17T11:57:31.077 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_3 2023-12-17T11:57:31.161 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-17T11:57:31.161 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-17T11:57:31.161 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 463 Links: 1 2023-12-17T11:57:31.161 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-17T11:57:31.161 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2023-12-17T11:57:31.161 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2023-12-17 11:57:18.260065760 +0000 2023-12-17T11:57:31.162 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2023-12-17 11:48:46.674999033 +0000 2023-12-17T11:57:31.162 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2023-12-17 11:48:46.674999033 +0000 2023-12-17T11:57:31.162 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2023-12-17 11:48:46.646999756 +0000 2023-12-17T11:57:31.162 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-17T11:57:31.265 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2023-12-17T11:57:31.266 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2023-12-17T11:57:31.266 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000302226 s, 1.7 MB/s 2023-12-17T11:57:31.268 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-17T11:57:31.314 DEBUG:teuthology.orchestra.run.smithi100:> stat /dev/vg_nvme/lv_4 2023-12-17T11:57:31.398 INFO:teuthology.orchestra.run.smithi100.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-17T11:57:31.398 INFO:teuthology.orchestra.run.smithi100.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-17T11:57:31.398 INFO:teuthology.orchestra.run.smithi100.stdout:Device: 5h/5d Inode: 469 Links: 1 2023-12-17T11:57:31.399 INFO:teuthology.orchestra.run.smithi100.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-17T11:57:31.399 INFO:teuthology.orchestra.run.smithi100.stdout:Context: system_u:object_r:device_t:s0 2023-12-17T11:57:31.399 INFO:teuthology.orchestra.run.smithi100.stdout:Access: 2023-12-17 11:57:18.260065760 +0000 2023-12-17T11:57:31.399 INFO:teuthology.orchestra.run.smithi100.stdout:Modify: 2023-12-17 11:48:47.524977086 +0000 2023-12-17T11:57:31.399 INFO:teuthology.orchestra.run.smithi100.stdout:Change: 2023-12-17 11:48:47.524977086 +0000 2023-12-17T11:57:31.399 INFO:teuthology.orchestra.run.smithi100.stdout: Birth: 2023-12-17 11:48:47.498977757 +0000 2023-12-17T11:57:31.399 DEBUG:teuthology.orchestra.run.smithi100:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-17T11:57:31.504 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records in 2023-12-17T11:57:31.504 INFO:teuthology.orchestra.run.smithi100.stderr:1+0 records out 2023-12-17T11:57:31.504 INFO:teuthology.orchestra.run.smithi100.stderr:512 bytes copied, 0.000301832 s, 1.7 MB/s 2023-12-17T11:57:31.506 DEBUG:teuthology.orchestra.run.smithi100:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-17T11:57:31.553 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2023-12-17T11:57:31.553 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/scratch_devs of=/dev/stdout 2023-12-17T11:57:31.597 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-17T11:57:31.598 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_1 2023-12-17T11:57:31.683 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-17T11:57:31.683 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-17T11:57:31.683 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 5h/5d Inode: 451 Links: 1 2023-12-17T11:57:31.683 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-17T11:57:31.683 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2023-12-17T11:57:31.684 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2023-12-17 11:57:09.472434424 +0000 2023-12-17T11:57:31.684 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2023-12-17 11:49:00.474163081 +0000 2023-12-17T11:57:31.684 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2023-12-17 11:49:00.474163081 +0000 2023-12-17T11:57:31.684 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: 2023-12-17 11:49:00.447163556 +0000 2023-12-17T11:57:31.684 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-17T11:57:31.786 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:31 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:31.786 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:31 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:31.786 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:31 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:57:31.786 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:31 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:31.786 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:31 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:57:31.786 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:31 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:31.786 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:31 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-17T11:57:31.786 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:31 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-17T11:57:31.786 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:31 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-17T11:57:31.786 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:31 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:31.787 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:31 smithi186 ceph-mon[41182]: Deploying daemon mgr.z on smithi186 2023-12-17T11:57:31.787 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:31 smithi186 ceph-mon[41182]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:31.793 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2023-12-17T11:57:31.793 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2023-12-17T11:57:31.793 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000296887 s, 1.7 MB/s 2023-12-17T11:57:31.797 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-17T11:57:31.844 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_2 2023-12-17T11:57:31.891 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-17T11:57:31.891 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-17T11:57:31.891 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 5h/5d Inode: 457 Links: 1 2023-12-17T11:57:31.892 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-17T11:57:31.892 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2023-12-17T11:57:31.892 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2023-12-17 11:57:09.472434424 +0000 2023-12-17T11:57:31.892 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2023-12-17 11:49:01.303148519 +0000 2023-12-17T11:57:31.892 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2023-12-17 11:49:01.303148519 +0000 2023-12-17T11:57:31.892 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: 2023-12-17 11:49:01.278148958 +0000 2023-12-17T11:57:31.892 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-17T11:57:31.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:31 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:31.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:31 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:31.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:31 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:57:31.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:31 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:31.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:31 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:57:31.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:31 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:31.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:31 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-17T11:57:31.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:31 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-17T11:57:31.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:31 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-17T11:57:31.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:31 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:31.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:31 smithi100 ceph-mon[41266]: Deploying daemon mgr.z on smithi186 2023-12-17T11:57:31.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:31 smithi100 ceph-mon[41266]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:31.960 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2023-12-17T11:57:31.960 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2023-12-17T11:57:31.960 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000383915 s, 1.3 MB/s 2023-12-17T11:57:31.963 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-17T11:57:31.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:31 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:31.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:31 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:31.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:31 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:57:31.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:31 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:31.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:31 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:57:31.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:31 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:31.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:31 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-17T11:57:31.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:31 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-17T11:57:31.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:31 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-17T11:57:31.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:31 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:31.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:31 smithi008 ceph-mon[36830]: Deploying daemon mgr.z on smithi186 2023-12-17T11:57:31.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:31 smithi008 ceph-mon[36830]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:32.009 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_3 2023-12-17T11:57:32.098 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-17T11:57:32.098 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-17T11:57:32.098 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 5h/5d Inode: 463 Links: 1 2023-12-17T11:57:32.098 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-17T11:57:32.098 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2023-12-17T11:57:32.098 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2023-12-17 11:57:09.472434424 +0000 2023-12-17T11:57:32.098 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2023-12-17 11:49:02.135133903 +0000 2023-12-17T11:57:32.098 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2023-12-17 11:49:02.135133903 +0000 2023-12-17T11:57:32.098 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: 2023-12-17 11:49:02.108134378 +0000 2023-12-17T11:57:32.099 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-17T11:57:32.205 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2023-12-17T11:57:32.205 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2023-12-17T11:57:32.205 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000302179 s, 1.7 MB/s 2023-12-17T11:57:32.208 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-17T11:57:32.255 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_4 2023-12-17T11:57:32.340 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-17T11:57:32.340 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-17T11:57:32.340 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 5h/5d Inode: 469 Links: 1 2023-12-17T11:57:32.340 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-17T11:57:32.340 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2023-12-17T11:57:32.340 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2023-12-17 11:57:09.472434424 +0000 2023-12-17T11:57:32.340 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2023-12-17 11:49:02.963119358 +0000 2023-12-17T11:57:32.340 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2023-12-17 11:49:02.963119358 +0000 2023-12-17T11:57:32.340 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: 2023-12-17 11:49:02.939119780 +0000 2023-12-17T11:57:32.341 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-17T11:57:32.454 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2023-12-17T11:57:32.454 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2023-12-17T11:57:32.454 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.00523263 s, 97.8 kB/s 2023-12-17T11:57:32.457 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-17T11:57:32.502 INFO:tasks.cephadm:Deploying osd.0 on smithi008 with /dev/vg_nvme/lv_4... 2023-12-17T11:57:32.502 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-17T11:57:32.918 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T11:57:33.291 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Dec 17 11:57:33 smithi186 systemd[1]: Starting Ceph mgr.z for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T11:57:34.225 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Dec 17 11:57:33 smithi186 bash[43280]: 4b8d0ec22400902387455b83c60c236e48659e680123bd6a8a5dd8d1cc9cf960 2023-12-17T11:57:34.226 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Dec 17 11:57:33 smithi186 systemd[1]: Started Ceph mgr.z for f43f508a-9cd2-11ee-95a5-87774f69a715. 2023-12-17T11:57:34.226 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Dec 17 11:57:33 smithi186 ceph-mgr[43318]: -- 172.21.15.186:0/990156526 <== mon.1 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556243cbb520 con 0x556243c92800 2023-12-17T11:57:34.620 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-17T11:57:34.620 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-17T11:57:34.620 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 10+0 records in 2023-12-17T11:57:34.620 INFO:teuthology.orchestra.run.smithi008.stderr:10+0 records out 2023-12-17T11:57:34.620 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0307998 s, 340 MB/s 2023-12-17T11:57:34.620 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping successful for: 2023-12-17T11:57:34.651 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Dec 17 11:57:34 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-z[43295]: 2023-12-17T11:57:34.302+0000 7fa80a46c200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-17T11:57:34.651 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Dec 17 11:57:34 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-z[43295]: 2023-12-17T11:57:34.422+0000 7fa80a46c200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-17T11:57:34.651 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Dec 17 11:57:34 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-z[43295]: 2023-12-17T11:57:34.537+0000 7fa80a46c200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-17T11:57:34.651 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:34 smithi186 ceph-mon[41182]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:34.651 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:34 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:34.651 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:34 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:34.651 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:34 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:34.651 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:34 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-17T11:57:34.651 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:34 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-17T11:57:34.651 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:34 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-17T11:57:34.651 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:34 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:34.689 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:34 smithi100 ceph-mon[41266]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:34.689 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:34 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:34.689 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:34 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:34.689 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:34 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:34.689 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:34 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-17T11:57:34.689 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:34 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-17T11:57:34.689 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:34 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-17T11:57:34.689 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:34 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:34.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:34 smithi008 ceph-mon[36830]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:34.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:34 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:34.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:34 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:34.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:34 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:34.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:34 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-17T11:57:34.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:34 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-12-17T11:57:34.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:34 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-17T11:57:34.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:34 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:34.975 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Dec 17 11:57:34 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-z[43295]: 2023-12-17T11:57:34.647+0000 7fa80a46c200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-17T11:57:35.007 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi008:vg_nvme/lv_4 2023-12-17T11:57:35.419 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T11:57:35.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:35 smithi186 ceph-mon[41182]: Deploying daemon mgr.y on smithi100 2023-12-17T11:57:35.726 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Dec 17 11:57:35 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-z[43295]: 2023-12-17T11:57:35.498+0000 7fa80a46c200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-17T11:57:35.740 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:35 smithi100 ceph-mon[41266]: Deploying daemon mgr.y on smithi100 2023-12-17T11:57:35.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:35 smithi008 ceph-mon[36830]: Deploying daemon mgr.y on smithi100 2023-12-17T11:57:36.149 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Dec 17 11:57:35 smithi100 systemd[1]: Starting Ceph mgr.y for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T11:57:36.225 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Dec 17 11:57:35 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-z[43295]: 2023-12-17T11:57:35.798+0000 7fa80a46c200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-17T11:57:36.226 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Dec 17 11:57:35 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-z[43295]: 2023-12-17T11:57:35.909+0000 7fa80a46c200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-17T11:57:36.226 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Dec 17 11:57:36 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-z[43295]: 2023-12-17T11:57:36.047+0000 7fa80a46c200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-17T11:57:36.533 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Dec 17 11:57:36 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-z[43295]: 2023-12-17T11:57:36.243+0000 7fa80a46c200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-17T11:57:36.533 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Dec 17 11:57:36 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-z[43295]: 2023-12-17T11:57:36.415+0000 7fa80a46c200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-17T11:57:36.533 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:36 smithi186 ceph-mon[41182]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:36.533 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:36 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:36.533 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:36 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:36.533 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:36 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:36.533 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:36 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:36.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.574+0000 7f01eec36700 1 -- 172.21.15.8:0/965491560 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01e81031c0 msgr2=0x7f01e8109a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:36.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.574+0000 7f01eec36700 1 --2- 172.21.15.8:0/965491560 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01e81031c0 0x7f01e8109a70 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f01e000b0d0 tx=0x7f01e000b3e0 comp rx=0 tx=0).stop 2023-12-17T11:57:36.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.575+0000 7f01eec36700 1 -- 172.21.15.8:0/965491560 shutdown_connections 2023-12-17T11:57:36.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.575+0000 7f01eec36700 1 --2- 172.21.15.8:0/965491560 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01e81031c0 0x7f01e8109a70 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:36.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.575+0000 7f01eec36700 1 --2- 172.21.15.8:0/965491560 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f01e8101620 0x7f01e8101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:36.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.575+0000 7f01eec36700 1 --2- 172.21.15.8:0/965491560 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01e8102820 0x7f01e8102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:36.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.575+0000 7f01eec36700 1 -- 172.21.15.8:0/965491560 >> 172.21.15.8:0/965491560 conn(0x7f01e80fcbe0 msgr2=0x7f01e80ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:36.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.575+0000 7f01eec36700 1 -- 172.21.15.8:0/965491560 shutdown_connections 2023-12-17T11:57:36.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.575+0000 7f01eec36700 1 -- 172.21.15.8:0/965491560 wait complete. 2023-12-17T11:57:36.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.576+0000 7f01eec36700 1 Processor -- start 2023-12-17T11:57:36.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.576+0000 7f01eec36700 1 -- start start 2023-12-17T11:57:36.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.576+0000 7f01eec36700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01e8101620 0x7f01e8075320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:36.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.576+0000 7f01eec36700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f01e8102820 0x7f01e80739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:36.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.576+0000 7f01eec36700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01e81031c0 0x7f01e8073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:36.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.576+0000 7f01eec36700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e80746a0 con 0x7f01e81031c0 2023-12-17T11:57:36.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.576+0000 7f01eec36700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e8074810 con 0x7f01e8101620 2023-12-17T11:57:36.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.576+0000 7f01eec36700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e81a1570 con 0x7f01e8102820 2023-12-17T11:57:36.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.577+0000 7f01ec9d2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01e8101620 0x7f01e8075320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:36.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.577+0000 7f01ed1d3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01e81031c0 0x7f01e8073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:36.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.577+0000 7f01e7fff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f01e8102820 0x7f01e80739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:36.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.577+0000 7f01ed1d3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01e81031c0 0x7f01e8073f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:47602/0 (socket says 172.21.15.8:47602) 2023-12-17T11:57:36.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.577+0000 7f01ec9d2700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01e8101620 0x7f01e8075320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.8:37228/0 (socket says 172.21.15.8:37228) 2023-12-17T11:57:36.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.577+0000 7f01ed1d3700 1 -- 172.21.15.8:0/1485867010 learned_addr learned my addr 172.21.15.8:0/1485867010 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:57:36.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.577+0000 7f01e7fff700 1 -- 172.21.15.8:0/1485867010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01e8101620 msgr2=0x7f01e8075320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:36.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.577+0000 7f01e7fff700 1 --2- 172.21.15.8:0/1485867010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01e8101620 0x7f01e8075320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:36.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.577+0000 7f01e7fff700 1 -- 172.21.15.8:0/1485867010 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01e81031c0 msgr2=0x7f01e8073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:36.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.577+0000 7f01e7fff700 1 --2- 172.21.15.8:0/1485867010 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01e81031c0 0x7f01e8073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:36.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.577+0000 7f01e7fff700 1 -- 172.21.15.8:0/1485867010 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e0009d00 con 0x7f01e8102820 2023-12-17T11:57:36.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.577+0000 7f01ed1d3700 1 --2- 172.21.15.8:0/1485867010 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01e81031c0 0x7f01e8073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T11:57:36.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.577+0000 7f01e7fff700 1 --2- 172.21.15.8:0/1485867010 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f01e8102820 0x7f01e80739c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f01d400e9f0 tx=0x7f01d400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:36.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.578+0000 7f01e5ffb700 1 -- 172.21.15.8:0/1485867010 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d400c9c0 con 0x7f01e8102820 2023-12-17T11:57:36.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.578+0000 7f01e5ffb700 1 -- 172.21.15.8:0/1485867010 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f01d4010430 con 0x7f01e8102820 2023-12-17T11:57:36.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.578+0000 7f01e5ffb700 1 -- 172.21.15.8:0/1485867010 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d4018680 con 0x7f01e8102820 2023-12-17T11:57:36.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.578+0000 7f01eec36700 1 -- 172.21.15.8:0/1485867010 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01e81a1800 con 0x7f01e8102820 2023-12-17T11:57:36.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.578+0000 7f01eec36700 1 -- 172.21.15.8:0/1485867010 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01e81a1d00 con 0x7f01e8102820 2023-12-17T11:57:36.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.579+0000 7f01eec36700 1 -- 172.21.15.8:0/1485867010 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01e8108a80 con 0x7f01e8102820 2023-12-17T11:57:36.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.579+0000 7f01e5ffb700 1 -- 172.21.15.8:0/1485867010 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 13) v1 ==== 45635+0+0 (secure 0 0 0) 0x7f01d40105a0 con 0x7f01e8102820 2023-12-17T11:57:36.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.579+0000 7f01e5ffb700 1 --2- 172.21.15.8:0/1485867010 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f01d8038af0 0x7f01d803afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:36.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.579+0000 7f01e5ffb700 1 -- 172.21.15.8:0/1485867010 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f01d4014070 con 0x7f01e8102820 2023-12-17T11:57:36.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.580+0000 7f01ec9d2700 1 --2- 172.21.15.8:0/1485867010 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f01d8038af0 0x7f01d803afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:36.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.580+0000 7f01ec9d2700 1 --2- 172.21.15.8:0/1485867010 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f01d8038af0 0x7f01d803afb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f01e8102680 tx=0x7f01dc009260 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:36.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.585+0000 7f01e5ffb700 1 -- 172.21.15.8:0/1485867010 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f01d401f910 con 0x7f01e8102820 2023-12-17T11:57:36.665 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:36 smithi100 ceph-mon[41266]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:36.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:36 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:36.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:36 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:36.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:36 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:36.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:36 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:36.666 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Dec 17 11:57:36 smithi100 bash[42693]: a6a95f0d40b9d144b58709e745c3fc078566bb838a6841e01beefa03c21f2886 2023-12-17T11:57:36.666 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Dec 17 11:57:36 smithi100 systemd[1]: Started Ceph mgr.y for f43f508a-9cd2-11ee-95a5-87774f69a715. 2023-12-17T11:57:36.666 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Dec 17 11:57:36 smithi100 ceph-mgr[42731]: -- 172.21.15.100:0/3082892156 <== mon.1 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55ed6903b520 con 0x55ed69012c00 2023-12-17T11:57:36.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:36 smithi008 ceph-mon[36830]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:36.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:36 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:36.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:36 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:36.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:36 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:36.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:36 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:36.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:36.806+0000 7f01eec36700 1 -- 172.21.15.8:0/1485867010 --> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f01e802d3b0 con 0x7f01d8038af0 2023-12-17T11:57:36.975 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Dec 17 11:57:36 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-z[43295]: 2023-12-17T11:57:36.529+0000 7fa80a46c200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-17T11:57:37.155 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Dec 17 11:57:36 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-y[42708]: 2023-12-17T11:57:36.792+0000 7f23c175d200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-17T11:57:37.156 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Dec 17 11:57:36 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-y[42708]: 2023-12-17T11:57:36.922+0000 7f23c175d200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-17T11:57:37.156 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Dec 17 11:57:37 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-y[42708]: 2023-12-17T11:57:37.039+0000 7f23c175d200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-17T11:57:37.415 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Dec 17 11:57:37 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-y[42708]: 2023-12-17T11:57:37.153+0000 7f23c175d200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-17T11:57:37.440 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Dec 17 11:57:37 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-z[43295]: 2023-12-17T11:57:37.040+0000 7fa80a46c200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-17T11:57:37.725 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Dec 17 11:57:37 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-z[43295]: 2023-12-17T11:57:37.438+0000 7fa80a46c200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-17T11:57:37.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:37 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:57:37.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:37 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T11:57:37.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:37 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T11:57:37.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:37 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:37.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:37 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:57:37.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:37 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T11:57:37.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:37 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T11:57:37.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:37 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:37.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:37 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:57:37.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:37 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T11:57:37.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:37 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T11:57:37.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:37 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:38.225 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Dec 17 11:57:37 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-z[43295]: 2023-12-17T11:57:37.814+0000 7fa80a46c200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-17T11:57:38.225 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Dec 17 11:57:37 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-z[43295]: 2023-12-17T11:57:37.947+0000 7fa80a46c200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-17T11:57:38.415 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Dec 17 11:57:38 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-y[42708]: 2023-12-17T11:57:38.113+0000 7f23c175d200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-17T11:57:38.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:38 smithi008 ceph-mon[36830]: from='client.24118 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:57:38.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:38 smithi008 ceph-mon[36830]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:38.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:38 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:38.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:38 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:38.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:38 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:38.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:38 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:38.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:38 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:38.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:38 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:38.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:38 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:57:38.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:38 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:38.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:38 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-17T11:57:38.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:38 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-17T11:57:38.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:38 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:38.674 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Dec 17 11:57:38 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-y[42708]: 2023-12-17T11:57:38.417+0000 7f23c175d200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-17T11:57:38.674 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Dec 17 11:57:38 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-y[42708]: 2023-12-17T11:57:38.531+0000 7f23c175d200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-17T11:57:38.674 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:38 smithi100 ceph-mon[41266]: from='client.24118 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:57:38.674 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:38 smithi100 ceph-mon[41266]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:38.674 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:38 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:38.675 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:38 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:38.675 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:38 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:38.675 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:38 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:38.675 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:38 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:38.675 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:38 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:38.675 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:38 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:57:38.675 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:38 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:38.675 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:38 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-17T11:57:38.675 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:38 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-17T11:57:38.675 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:38 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:38.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:38 smithi186 ceph-mon[41182]: from='client.24118 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:57:38.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:38 smithi186 ceph-mon[41182]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:38.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:38 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:38.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:38 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:38.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:38 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:38.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:38 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:38.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:38 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:38.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:38 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:38.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:38 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:57:38.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:38 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:38.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:38 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-12-17T11:57:38.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:38 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-12-17T11:57:38.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:38 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:39.041 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Dec 17 11:57:38 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-y[42708]: 2023-12-17T11:57:38.671+0000 7f23c175d200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-17T11:57:39.041 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Dec 17 11:57:38 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-y[42708]: 2023-12-17T11:57:38.870+0000 7f23c175d200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-17T11:57:39.225 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Dec 17 11:57:38 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-z[43295]: 2023-12-17T11:57:38.925+0000 7fa80a46c200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-17T11:57:39.225 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Dec 17 11:57:39 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-z[43295]: 2023-12-17T11:57:39.050+0000 7fa80a46c200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-17T11:57:39.415 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Dec 17 11:57:39 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-y[42708]: 2023-12-17T11:57:39.038+0000 7f23c175d200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-17T11:57:39.416 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Dec 17 11:57:39 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-y[42708]: 2023-12-17T11:57:39.152+0000 7f23c175d200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-17T11:57:39.725 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Dec 17 11:57:39 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-z[43295]: 2023-12-17T11:57:39.249+0000 7fa80a46c200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-17T11:57:39.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:39 smithi186 ceph-mon[41182]: Reconfiguring mgr.x (unknown last config time)... 2023-12-17T11:57:39.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:39 smithi186 ceph-mon[41182]: Reconfiguring daemon mgr.x on smithi008 2023-12-17T11:57:39.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:39 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/2331032712' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1f8acaf-a47b-4b74-a78d-e0b6be49a10e"}]: dispatch 2023-12-17T11:57:39.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:39 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/2331032712' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1f8acaf-a47b-4b74-a78d-e0b6be49a10e"}]': finished 2023-12-17T11:57:39.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:39 smithi186 ceph-mon[41182]: osdmap e5: 1 total, 0 up, 1 in 2023-12-17T11:57:39.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:39 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-17T11:57:39.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:39 smithi008 ceph-mon[36830]: Reconfiguring mgr.x (unknown last config time)... 2023-12-17T11:57:39.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:39 smithi008 ceph-mon[36830]: Reconfiguring daemon mgr.x on smithi008 2023-12-17T11:57:39.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:39 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/2331032712' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1f8acaf-a47b-4b74-a78d-e0b6be49a10e"}]: dispatch 2023-12-17T11:57:39.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:39 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/2331032712' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1f8acaf-a47b-4b74-a78d-e0b6be49a10e"}]': finished 2023-12-17T11:57:39.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:39 smithi008 ceph-mon[36830]: osdmap e5: 1 total, 0 up, 1 in 2023-12-17T11:57:39.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:39 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-17T11:57:39.916 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Dec 17 11:57:39 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-y[42708]: 2023-12-17T11:57:39.627+0000 7f23c175d200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-17T11:57:39.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:39 smithi100 ceph-mon[41266]: Reconfiguring mgr.x (unknown last config time)... 2023-12-17T11:57:39.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:39 smithi100 ceph-mon[41266]: Reconfiguring daemon mgr.x on smithi008 2023-12-17T11:57:39.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:39 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/2331032712' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c1f8acaf-a47b-4b74-a78d-e0b6be49a10e"}]: dispatch 2023-12-17T11:57:39.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:39 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/2331032712' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c1f8acaf-a47b-4b74-a78d-e0b6be49a10e"}]': finished 2023-12-17T11:57:39.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:39 smithi100 ceph-mon[41266]: osdmap e5: 1 total, 0 up, 1 in 2023-12-17T11:57:39.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:39 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-17T11:57:40.342 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Dec 17 11:57:39 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-y[42708]: 2023-12-17T11:57:39.973+0000 7f23c175d200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-17T11:57:40.444 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Dec 17 11:57:40 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-z[43295]: 2023-12-17T11:57:40.073+0000 7fa80a46c200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-17T11:57:40.444 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Dec 17 11:57:40 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-z[43295]: 2023-12-17T11:57:40.311+0000 7fa80a46c200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-17T11:57:40.665 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:40 smithi100 ceph-mon[41266]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:40.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:40 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/3432123336' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T11:57:40.666 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Dec 17 11:57:40 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-y[42708]: 2023-12-17T11:57:40.340+0000 7f23c175d200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-17T11:57:40.666 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Dec 17 11:57:40 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-y[42708]: 2023-12-17T11:57:40.465+0000 7f23c175d200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-17T11:57:40.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:40 smithi186 ceph-mon[41182]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:40.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:40 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/3432123336' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T11:57:40.726 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Dec 17 11:57:40 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-z[43295]: 2023-12-17T11:57:40.566+0000 7fa80a46c200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-17T11:57:40.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:40 smithi008 ceph-mon[36830]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:40.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:40 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/3432123336' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T11:57:41.732 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Dec 17 11:57:41 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-y[42708]: 2023-12-17T11:57:41.415+0000 7f23c175d200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-17T11:57:41.732 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Dec 17 11:57:41 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-y[42708]: 2023-12-17T11:57:41.539+0000 7f23c175d200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-17T11:57:41.975 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Dec 17 11:57:41 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-z[43295]: 2023-12-17T11:57:41.707+0000 7fa80a46c200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-17T11:57:42.166 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Dec 17 11:57:41 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-y[42708]: 2023-12-17T11:57:41.730+0000 7f23c175d200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-17T11:57:42.432 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Dec 17 11:57:42 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-z[43295]: 2023-12-17T11:57:42.059+0000 7fa80a46c200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-17T11:57:42.432 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Dec 17 11:57:42 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-z[43295]: 2023-12-17T11:57:42.177+0000 7fa80a46c200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-17T11:57:42.456 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:42.454+0000 7f01e5ffb700 1 -- 172.21.15.8:0/1485867010 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mgrmap(e 14) v1 ==== 90792+0+0 (secure 0 0 0) 0x7f01d40187e0 con 0x7f01e8102820 2023-12-17T11:57:42.726 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Dec 17 11:57:42 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-z[43295]: 2023-12-17T11:57:42.430+0000 7fa80a46c200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-17T11:57:42.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:42 smithi186 ceph-mon[41182]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:42.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:42 smithi186 ceph-mon[41182]: Standby manager daemon z started 2023-12-17T11:57:42.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:42 smithi186 ceph-mon[41182]: from='mgr.? 172.21.15.186:0/1147834255' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-12-17T11:57:42.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:42 smithi186 ceph-mon[41182]: from='mgr.? 172.21.15.186:0/1147834255' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-17T11:57:42.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:42 smithi186 ceph-mon[41182]: from='mgr.? 172.21.15.186:0/1147834255' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-12-17T11:57:42.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:42 smithi186 ceph-mon[41182]: from='mgr.? 172.21.15.186:0/1147834255' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-17T11:57:42.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:42 smithi008 ceph-mon[36830]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:42.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:42 smithi008 ceph-mon[36830]: Standby manager daemon z started 2023-12-17T11:57:42.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:42 smithi008 ceph-mon[36830]: from='mgr.? 172.21.15.186:0/1147834255' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-12-17T11:57:42.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:42 smithi008 ceph-mon[36830]: from='mgr.? 172.21.15.186:0/1147834255' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-17T11:57:42.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:42 smithi008 ceph-mon[36830]: from='mgr.? 172.21.15.186:0/1147834255' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-12-17T11:57:42.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:42 smithi008 ceph-mon[36830]: from='mgr.? 172.21.15.186:0/1147834255' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-17T11:57:42.780 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Dec 17 11:57:42 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-y[42708]: 2023-12-17T11:57:42.546+0000 7f23c175d200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-17T11:57:42.780 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:42 smithi100 ceph-mon[41266]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:42.780 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:42 smithi100 ceph-mon[41266]: Standby manager daemon z started 2023-12-17T11:57:42.780 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:42 smithi100 ceph-mon[41266]: from='mgr.? 172.21.15.186:0/1147834255' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-12-17T11:57:42.780 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:42 smithi100 ceph-mon[41266]: from='mgr.? 172.21.15.186:0/1147834255' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-17T11:57:42.780 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:42 smithi100 ceph-mon[41266]: from='mgr.? 172.21.15.186:0/1147834255' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-12-17T11:57:42.780 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:42 smithi100 ceph-mon[41266]: from='mgr.? 172.21.15.186:0/1147834255' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-17T11:57:43.030 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Dec 17 11:57:42 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-y[42708]: 2023-12-17T11:57:42.777+0000 7f23c175d200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-17T11:57:43.415 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Dec 17 11:57:43 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-y[42708]: 2023-12-17T11:57:43.028+0000 7f23c175d200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-17T11:57:43.654 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:43 smithi008 ceph-mon[36830]: mgrmap e14: x(active, since 75s), standbys: z 2023-12-17T11:57:43.655 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:43 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-12-17T11:57:43.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:43 smithi186 ceph-mon[41182]: mgrmap e14: x(active, since 75s), standbys: z 2023-12-17T11:57:43.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:43 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-12-17T11:57:43.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:43 smithi100 ceph-mon[41266]: mgrmap e14: x(active, since 75s), standbys: z 2023-12-17T11:57:43.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:43 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-12-17T11:57:44.415 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Dec 17 11:57:44 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-y[42708]: 2023-12-17T11:57:44.146+0000 7f23c175d200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-17T11:57:44.606 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:44 smithi008 ceph-mon[36830]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:44.606 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:44 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:44.606 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:44 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:44.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:44 smithi186 ceph-mon[41182]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:44.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:44 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:44.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:44 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:44.864 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:44 smithi100 ceph-mon[41266]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:44.864 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:44 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:44.864 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:44 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:44.865 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Dec 17 11:57:44 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-y[42708]: 2023-12-17T11:57:44.497+0000 7f23c175d200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-17T11:57:44.865 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Dec 17 11:57:44 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-y[42708]: 2023-12-17T11:57:44.610+0000 7f23c175d200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-17T11:57:45.166 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Dec 17 11:57:44 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-y[42708]: 2023-12-17T11:57:44.861+0000 7f23c175d200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-17T11:57:45.487 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:45.484+0000 7f01e5ffb700 1 -- 172.21.15.8:0/1485867010 <== mon.1 v2:172.21.15.186:3300/0 8 ==== mgrmap(e 15) v1 ==== 135949+0+0 (secure 0 0 0) 0x7f01d400cb20 con 0x7f01e8102820 2023-12-17T11:57:45.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:45 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:57:45.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:45 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:45.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:45 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:57:45.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:45 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:45.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:45 smithi186 ceph-mon[41182]: Standby manager daemon y started 2023-12-17T11:57:45.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:45 smithi186 ceph-mon[41182]: from='mgr.? 172.21.15.100:0/711518494' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-12-17T11:57:45.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:45 smithi186 ceph-mon[41182]: from='mgr.? 172.21.15.100:0/711518494' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-17T11:57:45.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:45 smithi186 ceph-mon[41182]: from='mgr.? 172.21.15.100:0/711518494' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-12-17T11:57:45.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:45 smithi186 ceph-mon[41182]: from='mgr.? 172.21.15.100:0/711518494' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-17T11:57:45.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:45 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:57:45.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:45 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:45.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:45 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:57:45.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:45 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:45.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:45 smithi008 ceph-mon[36830]: Standby manager daemon y started 2023-12-17T11:57:45.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:45 smithi008 ceph-mon[36830]: from='mgr.? 172.21.15.100:0/711518494' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-12-17T11:57:45.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:45 smithi008 ceph-mon[36830]: from='mgr.? 172.21.15.100:0/711518494' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-17T11:57:45.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:45 smithi008 ceph-mon[36830]: from='mgr.? 172.21.15.100:0/711518494' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-12-17T11:57:45.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:45 smithi008 ceph-mon[36830]: from='mgr.? 172.21.15.100:0/711518494' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-17T11:57:45.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:45 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:57:45.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:45 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:45.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:45 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:57:45.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:45 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:45.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:45 smithi100 ceph-mon[41266]: Standby manager daemon y started 2023-12-17T11:57:45.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:45 smithi100 ceph-mon[41266]: from='mgr.? 172.21.15.100:0/711518494' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-12-17T11:57:45.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:45 smithi100 ceph-mon[41266]: from='mgr.? 172.21.15.100:0/711518494' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-12-17T11:57:45.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:45 smithi100 ceph-mon[41266]: from='mgr.? 172.21.15.100:0/711518494' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-12-17T11:57:45.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:45 smithi100 ceph-mon[41266]: from='mgr.? 172.21.15.100:0/711518494' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-12-17T11:57:46.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:46 smithi008 ceph-mon[36830]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:46.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:46 smithi008 ceph-mon[36830]: mgrmap e15: x(active, since 78s), standbys: z, y 2023-12-17T11:57:46.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:46 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-12-17T11:57:46.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:46 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-17T11:57:46.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:46 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:46.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:46 smithi100 ceph-mon[41266]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:46.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:46 smithi100 ceph-mon[41266]: mgrmap e15: x(active, since 78s), standbys: z, y 2023-12-17T11:57:46.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:46 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-12-17T11:57:46.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:46 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-17T11:57:46.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:46 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:46.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:46 smithi186 ceph-mon[41182]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:46.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:46 smithi186 ceph-mon[41182]: mgrmap e15: x(active, since 78s), standbys: z, y 2023-12-17T11:57:46.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:46 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-12-17T11:57:46.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:46 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-12-17T11:57:46.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:46 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:47.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:47 smithi008 ceph-mon[36830]: Deploying daemon osd.0 on smithi008 2023-12-17T11:57:47.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:47 smithi100 ceph-mon[41266]: Deploying daemon osd.0 on smithi008 2023-12-17T11:57:47.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:47 smithi186 ceph-mon[41182]: Deploying daemon osd.0 on smithi008 2023-12-17T11:57:48.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:48 smithi008 ceph-mon[36830]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:48.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:48 smithi100 ceph-mon[41266]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:48.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:48 smithi186 ceph-mon[41182]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:50.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:50 smithi008 ceph-mon[36830]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:50.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:50 smithi100 ceph-mon[41266]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:50.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:50 smithi186 ceph-mon[41182]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:52.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:52 smithi008 ceph-mon[36830]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:52.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:52 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:52.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:52 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:52.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:52 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:57:52.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:52 smithi100 ceph-mon[41266]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:52.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:52 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:52.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:52 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:52.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:52 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:57:52.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:52 smithi186 ceph-mon[41182]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:52.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:52 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:52.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:52 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:52.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:52 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:57:53.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:53 smithi008 ceph-mon[36830]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:53.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:53 smithi100 ceph-mon[41266]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:53.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:53 smithi186 ceph-mon[41182]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:54.518 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:54.515+0000 7f01e5ffb700 1 -- 172.21.15.8:0/1485867010 <== mgr.14154 v2:172.21.15.8:6800/268548699 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f01e802d3b0 con 0x7f01d8038af0 2023-12-17T11:57:54.518 INFO:teuthology.orchestra.run.smithi008.stdout:Created osd(s) 0 on host 'smithi008' 2023-12-17T11:57:54.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:54.517+0000 7f01eec36700 1 -- 172.21.15.8:0/1485867010 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f01d8038af0 msgr2=0x7f01d803afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:54.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:54.517+0000 7f01eec36700 1 --2- 172.21.15.8:0/1485867010 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f01d8038af0 0x7f01d803afb0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f01e8102680 tx=0x7f01dc009260 comp rx=0 tx=0).stop 2023-12-17T11:57:54.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:54.517+0000 7f01eec36700 1 -- 172.21.15.8:0/1485867010 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f01e8102820 msgr2=0x7f01e80739c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:54.520 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:54.517+0000 7f01eec36700 1 --2- 172.21.15.8:0/1485867010 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f01e8102820 0x7f01e80739c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f01d400e9f0 tx=0x7f01d400ed00 comp rx=0 tx=0).stop 2023-12-17T11:57:54.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:54.517+0000 7f01eec36700 1 -- 172.21.15.8:0/1485867010 shutdown_connections 2023-12-17T11:57:54.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:54.517+0000 7f01eec36700 1 --2- 172.21.15.8:0/1485867010 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f01d8038af0 0x7f01d803afb0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:54.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:54.517+0000 7f01eec36700 1 --2- 172.21.15.8:0/1485867010 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f01e81031c0 0x7f01e8073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:54.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:54.517+0000 7f01eec36700 1 --2- 172.21.15.8:0/1485867010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f01e8101620 0x7f01e8075320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:54.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:54.517+0000 7f01eec36700 1 --2- 172.21.15.8:0/1485867010 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f01e8102820 0x7f01e80739c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:54.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:54.517+0000 7f01eec36700 1 -- 172.21.15.8:0/1485867010 >> 172.21.15.8:0/1485867010 conn(0x7f01e80fcbe0 msgr2=0x7f01e8105bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:54.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:54.518+0000 7f01eec36700 1 -- 172.21.15.8:0/1485867010 shutdown_connections 2023-12-17T11:57:54.521 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:57:54.518+0000 7f01eec36700 1 -- 172.21.15.8:0/1485867010 wait complete. 2023-12-17T11:57:54.731 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:54 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:54.731 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:54 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:54.731 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:54 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:54.731 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:54 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:57:54.731 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:54 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:54.731 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:54 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:54.731 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:54 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:54.731 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:54 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:57:54.918 DEBUG:teuthology.orchestra.run.smithi008:osd.0> sudo journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.0.service 2023-12-17T11:57:54.925 INFO:tasks.cephadm:Deploying osd.1 on smithi100 with /dev/vg_nvme/lv_4... 2023-12-17T11:57:54.925 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-17T11:57:54.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:54 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:54.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:54 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:54.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:54 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:54.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:54 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:57:54.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:54 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:54.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:54 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:54.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:54 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:54.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:54 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:57:54.993 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:54 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:54.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:54 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:54.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:54 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:54.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:54 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:57:54.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:54 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:54.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:54 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:54.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:54 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:54.994 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:54 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:57:55.001 INFO:journalctl@ceph.osd.0.smithi008.stdout:-- Logs begin at Sun 2023-12-17 11:40:41 UTC. -- 2023-12-17T11:57:55.329 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.b/config 2023-12-17T11:57:56.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:55 smithi100 ceph-mon[41266]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:56.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:55 smithi186 ceph-mon[41182]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:56.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:55 smithi008 ceph-mon[36830]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:56.246 INFO:journalctl@ceph.osd.0.smithi008.stdout:Dec 17 11:57:55 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-0[54555]: 2023-12-17T11:57:55.913+0000 7f5cd464a640 -1 osd.0 0 log_to_monitors true 2023-12-17T11:57:57.058 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-17T11:57:57.059 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-17T11:57:57.059 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 10+0 records in 2023-12-17T11:57:57.059 INFO:teuthology.orchestra.run.smithi100.stderr:10+0 records out 2023-12-17T11:57:57.059 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0542726 s, 193 MB/s 2023-12-17T11:57:57.059 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping successful for: 2023-12-17T11:57:57.165 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:56 smithi100 ceph-mon[41266]: from='osd.0 [v2:172.21.15.8:6802/297519189,v1:172.21.15.8:6803/297519189]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-17T11:57:57.225 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:56 smithi186 ceph-mon[41182]: from='osd.0 [v2:172.21.15.8:6802/297519189,v1:172.21.15.8:6803/297519189]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-17T11:57:57.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:56 smithi008 ceph-mon[36830]: from='osd.0 [v2:172.21.15.8:6802/297519189,v1:172.21.15.8:6803/297519189]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-12-17T11:57:57.472 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi100:vg_nvme/lv_4 2023-12-17T11:57:57.870 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.b/config 2023-12-17T11:57:57.911 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:57 smithi008 ceph-mon[36830]: from='osd.0 [v2:172.21.15.8:6802/297519189,v1:172.21.15.8:6803/297519189]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-17T11:57:57.911 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:57 smithi008 ceph-mon[36830]: osdmap e6: 1 total, 0 up, 1 in 2023-12-17T11:57:57.911 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:57 smithi008 ceph-mon[36830]: from='osd.0 [v2:172.21.15.8:6802/297519189,v1:172.21.15.8:6803/297519189]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-12-17T11:57:57.911 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:57 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-17T11:57:57.911 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:57 smithi008 ceph-mon[36830]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:58.163 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:57 smithi100 ceph-mon[41266]: from='osd.0 [v2:172.21.15.8:6802/297519189,v1:172.21.15.8:6803/297519189]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-17T11:57:58.163 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:57 smithi100 ceph-mon[41266]: osdmap e6: 1 total, 0 up, 1 in 2023-12-17T11:57:58.164 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:57 smithi100 ceph-mon[41266]: from='osd.0 [v2:172.21.15.8:6802/297519189,v1:172.21.15.8:6803/297519189]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-12-17T11:57:58.164 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:57 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-17T11:57:58.164 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:57 smithi100 ceph-mon[41266]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:58.225 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:57 smithi186 ceph-mon[41182]: from='osd.0 [v2:172.21.15.8:6802/297519189,v1:172.21.15.8:6803/297519189]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-12-17T11:57:58.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:57 smithi186 ceph-mon[41182]: osdmap e6: 1 total, 0 up, 1 in 2023-12-17T11:57:58.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:57 smithi186 ceph-mon[41182]: from='osd.0 [v2:172.21.15.8:6802/297519189,v1:172.21.15.8:6803/297519189]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-12-17T11:57:58.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:57 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-17T11:57:58.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:57 smithi186 ceph-mon[41182]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:57:58.246 INFO:journalctl@ceph.osd.0.smithi008.stdout:Dec 17 11:57:57 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-0[54555]: 2023-12-17T11:57:57.925+0000 7f5cc9cc1700 -1 osd.0 0 waiting for initial osdmap 2023-12-17T11:57:58.246 INFO:journalctl@ceph.osd.0.smithi008.stdout:Dec 17 11:57:57 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-0[54555]: 2023-12-17T11:57:57.929+0000 7f5cc1ab3700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-17T11:57:58.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.979+0000 7fbfacfae700 1 -- 172.21.15.100:0/3650775532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfa81020a0 msgr2=0x7fbfa8104490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:58.981 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.979+0000 7fbfacfae700 1 --2- 172.21.15.100:0/3650775532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfa81020a0 0x7fbfa8104490 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fbf98009990 tx=0x7fbf98009ca0 comp rx=0 tx=0).stop 2023-12-17T11:57:58.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.979+0000 7fbfacfae700 1 -- 172.21.15.100:0/3650775532 shutdown_connections 2023-12-17T11:57:58.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.979+0000 7fbfacfae700 1 --2- 172.21.15.100:0/3650775532 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbfa8107300 0x7fbfa8109770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:58.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.979+0000 7fbfacfae700 1 --2- 172.21.15.100:0/3650775532 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfa81020a0 0x7fbfa8104490 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:58.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.979+0000 7fbfacfae700 1 --2- 172.21.15.100:0/3650775532 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbfa81049d0 0x7fbfa8106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:58.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.979+0000 7fbfacfae700 1 -- 172.21.15.100:0/3650775532 >> 172.21.15.100:0/3650775532 conn(0x7fbfa80fbad0 msgr2=0x7fbfa80fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:57:58.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.979+0000 7fbfacfae700 1 -- 172.21.15.100:0/3650775532 shutdown_connections 2023-12-17T11:57:58.982 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.979+0000 7fbfacfae700 1 -- 172.21.15.100:0/3650775532 wait complete. 2023-12-17T11:57:58.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.980+0000 7fbfacfae700 1 Processor -- start 2023-12-17T11:57:58.983 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.981+0000 7fbfacfae700 1 -- start start 2023-12-17T11:57:58.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.981+0000 7fbfacfae700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbfa81020a0 0x7fbfa8197470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:58.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.981+0000 7fbfacfae700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfa81049d0 0x7fbfa81979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:58.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.981+0000 7fbfacfae700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbfa8107300 0x7fbfa819e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:58.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.981+0000 7fbfacfae700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa819efb0 con 0x7fbfa8107300 2023-12-17T11:57:58.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.981+0000 7fbfacfae700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa819f0f0 con 0x7fbfa81049d0 2023-12-17T11:57:58.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.981+0000 7fbfacfae700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa819f280 con 0x7fbfa81020a0 2023-12-17T11:57:58.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.981+0000 7fbfa5d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfa81049d0 0x7fbfa81979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:58.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.981+0000 7fbfa5d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfa81049d0 0x7fbfa81979b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52766/0 (socket says 172.21.15.100:52766) 2023-12-17T11:57:58.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.981+0000 7fbfa5d9b700 1 -- 172.21.15.100:0/1490540875 learned_addr learned my addr 172.21.15.100:0/1490540875 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-17T11:57:58.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.982+0000 7fbfa659c700 1 --2- 172.21.15.100:0/1490540875 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbfa81020a0 0x7fbfa8197470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:58.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.982+0000 7fbfa5d9b700 1 -- 172.21.15.100:0/1490540875 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbfa81020a0 msgr2=0x7fbfa8197470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:58.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.982+0000 7fbfa5d9b700 1 --2- 172.21.15.100:0/1490540875 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbfa81020a0 0x7fbfa8197470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:58.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.982+0000 7fbfa5d9b700 1 -- 172.21.15.100:0/1490540875 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbfa8107300 msgr2=0x7fbfa819e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:57:58.984 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.982+0000 7fbfa6d9d700 1 --2- 172.21.15.100:0/1490540875 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbfa8107300 0x7fbfa819e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:58.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.982+0000 7fbfa5d9b700 1 --2- 172.21.15.100:0/1490540875 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbfa8107300 0x7fbfa819e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:57:58.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.982+0000 7fbfa5d9b700 1 -- 172.21.15.100:0/1490540875 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf980095f0 con 0x7fbfa81049d0 2023-12-17T11:57:58.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.982+0000 7fbfa659c700 1 --2- 172.21.15.100:0/1490540875 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbfa81020a0 0x7fbfa8197470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:57:58.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.982+0000 7fbfa6d9d700 1 --2- 172.21.15.100:0/1490540875 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbfa8107300 0x7fbfa819e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T11:57:58.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.982+0000 7fbfa5d9b700 1 --2- 172.21.15.100:0/1490540875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfa81049d0 0x7fbfa81979b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c00d980 tx=0x7fbf9c00dd40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:58.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.982+0000 7fbf977fe700 1 -- 172.21.15.100:0/1490540875 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c00bb60 con 0x7fbfa81049d0 2023-12-17T11:57:58.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.982+0000 7fbf977fe700 1 -- 172.21.15.100:0/1490540875 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbf9c007640 con 0x7fbfa81049d0 2023-12-17T11:57:58.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.982+0000 7fbf977fe700 1 -- 172.21.15.100:0/1490540875 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c004d60 con 0x7fbfa81049d0 2023-12-17T11:57:58.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.982+0000 7fbfacfae700 1 -- 172.21.15.100:0/1490540875 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfa819f560 con 0x7fbfa81049d0 2023-12-17T11:57:58.985 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.982+0000 7fbfacfae700 1 -- 172.21.15.100:0/1490540875 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfa819fa10 con 0x7fbfa81049d0 2023-12-17T11:57:58.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.983+0000 7fbfacfae700 1 -- 172.21.15.100:0/1490540875 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfa80fd650 con 0x7fbfa81049d0 2023-12-17T11:57:58.986 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.985+0000 7fbf977fe700 1 -- 172.21.15.100:0/1490540875 <== mon.2 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 15) v1 ==== 135949+0+0 (secure 0 0 0) 0x7fbf9c004020 con 0x7fbfa81049d0 2023-12-17T11:57:58.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.987+0000 7fbf977fe700 1 --2- 172.21.15.100:0/1490540875 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fbf900a1470 0x7fbf900a3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:57:58.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.987+0000 7fbf977fe700 1 -- 172.21.15.100:0/1490540875 <== mon.2 v2:172.21.15.100:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1767+0+0 (secure 0 0 0) 0x7fbf9c0cb6d0 con 0x7fbfa81049d0 2023-12-17T11:57:58.988 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.987+0000 7fbfa659c700 1 --2- 172.21.15.100:0/1490540875 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fbf900a1470 0x7fbf900a3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:57:58.989 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.988+0000 7fbfa659c700 1 --2- 172.21.15.100:0/1490540875 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fbf900a1470 0x7fbf900a3930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbf98000c00 tx=0x7fbf98005fb0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:57:58.991 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:58.990+0000 7fbf977fe700 1 -- 172.21.15.100:0/1490540875 <== mon.2 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fbf9c096700 con 0x7fbfa81049d0 2023-12-17T11:57:59.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:58 smithi100 ceph-mon[41266]: from='osd.0 [v2:172.21.15.8:6802/297519189,v1:172.21.15.8:6803/297519189]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-12-17T11:57:59.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:58 smithi100 ceph-mon[41266]: osdmap e7: 1 total, 0 up, 1 in 2023-12-17T11:57:59.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:58 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-17T11:57:59.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:58 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-17T11:57:59.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:58 smithi100 ceph-mon[41266]: Detected new or changed devices on smithi008 2023-12-17T11:57:59.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:58 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:59.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:58 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:59.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:58 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:57:59.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:58 smithi100 ceph-mon[41266]: Adjusting osd_memory_target on smithi008 to 17276M 2023-12-17T11:57:59.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:58 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:59.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:58 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:59.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:58 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:57:59.167 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:58 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:59.196 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:57:59.195+0000 7fbfacfae700 1 -- 172.21.15.100:0/1490540875 --> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fbfa802d420 con 0x7fbf900a1470 2023-12-17T11:57:59.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:58 smithi186 ceph-mon[41182]: from='osd.0 [v2:172.21.15.8:6802/297519189,v1:172.21.15.8:6803/297519189]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-12-17T11:57:59.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:58 smithi186 ceph-mon[41182]: osdmap e7: 1 total, 0 up, 1 in 2023-12-17T11:57:59.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:58 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-17T11:57:59.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:58 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-17T11:57:59.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:58 smithi186 ceph-mon[41182]: Detected new or changed devices on smithi008 2023-12-17T11:57:59.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:58 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:59.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:58 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:59.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:58 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:57:59.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:58 smithi186 ceph-mon[41182]: Adjusting osd_memory_target on smithi008 to 17276M 2023-12-17T11:57:59.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:58 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:59.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:58 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:59.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:58 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:57:59.227 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:58 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:59.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:58 smithi008 ceph-mon[36830]: from='osd.0 [v2:172.21.15.8:6802/297519189,v1:172.21.15.8:6803/297519189]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-12-17T11:57:59.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:58 smithi008 ceph-mon[36830]: osdmap e7: 1 total, 0 up, 1 in 2023-12-17T11:57:59.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:58 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-17T11:57:59.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:58 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-17T11:57:59.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:58 smithi008 ceph-mon[36830]: Detected new or changed devices on smithi008 2023-12-17T11:57:59.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:58 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:59.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:58 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:59.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:58 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:57:59.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:58 smithi008 ceph-mon[36830]: Adjusting osd_memory_target on smithi008 to 17276M 2023-12-17T11:57:59.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:58 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:57:59.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:58 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:57:59.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:58 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:57:59.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:58 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:00.159 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:59 smithi100 ceph-mon[41266]: purged_snaps scrub starts 2023-12-17T11:58:00.159 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:59 smithi100 ceph-mon[41266]: purged_snaps scrub ok 2023-12-17T11:58:00.159 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:59 smithi100 ceph-mon[41266]: osd.0 [v2:172.21.15.8:6802/297519189,v1:172.21.15.8:6803/297519189] boot 2023-12-17T11:58:00.159 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:59 smithi100 ceph-mon[41266]: osdmap e8: 1 total, 1 up, 1 in 2023-12-17T11:58:00.160 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:59 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-17T11:58:00.160 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:59 smithi100 ceph-mon[41266]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:58:00.160 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:59 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T11:58:00.160 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:59 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T11:58:00.160 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:59 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:00.160 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:57:59 smithi100 ceph-mon[41266]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:58:00.225 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:59 smithi186 ceph-mon[41182]: purged_snaps scrub starts 2023-12-17T11:58:00.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:59 smithi186 ceph-mon[41182]: purged_snaps scrub ok 2023-12-17T11:58:00.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:59 smithi186 ceph-mon[41182]: osd.0 [v2:172.21.15.8:6802/297519189,v1:172.21.15.8:6803/297519189] boot 2023-12-17T11:58:00.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:59 smithi186 ceph-mon[41182]: osdmap e8: 1 total, 1 up, 1 in 2023-12-17T11:58:00.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:59 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-17T11:58:00.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:59 smithi186 ceph-mon[41182]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:58:00.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:59 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T11:58:00.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:59 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T11:58:00.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:59 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:00.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:57:59 smithi186 ceph-mon[41182]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:58:00.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:59 smithi008 ceph-mon[36830]: purged_snaps scrub starts 2023-12-17T11:58:00.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:59 smithi008 ceph-mon[36830]: purged_snaps scrub ok 2023-12-17T11:58:00.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:59 smithi008 ceph-mon[36830]: osd.0 [v2:172.21.15.8:6802/297519189,v1:172.21.15.8:6803/297519189] boot 2023-12-17T11:58:00.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:59 smithi008 ceph-mon[36830]: osdmap e8: 1 total, 1 up, 1 in 2023-12-17T11:58:00.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:59 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-12-17T11:58:00.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:59 smithi008 ceph-mon[36830]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:58:00.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:59 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T11:58:00.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:59 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T11:58:00.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:59 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:00.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:57:59 smithi008 ceph-mon[36830]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-12-17T11:58:01.225 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:00 smithi186 ceph-mon[41182]: osdmap e9: 1 total, 1 up, 1 in 2023-12-17T11:58:01.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:00 smithi008 ceph-mon[36830]: osdmap e9: 1 total, 1 up, 1 in 2023-12-17T11:58:01.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:00 smithi100 ceph-mon[41266]: osdmap e9: 1 total, 1 up, 1 in 2023-12-17T11:58:02.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:01 smithi186 ceph-mon[41182]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:58:02.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:01 smithi186 ceph-mon[41182]: from='client.? 172.21.15.100:0/1287320065' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d7138889-77de-43ba-b36b-7628f6f66bee"}]: dispatch 2023-12-17T11:58:02.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:01 smithi186 ceph-mon[41182]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d7138889-77de-43ba-b36b-7628f6f66bee"}]: dispatch 2023-12-17T11:58:02.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:01 smithi186 ceph-mon[41182]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d7138889-77de-43ba-b36b-7628f6f66bee"}]': finished 2023-12-17T11:58:02.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:01 smithi186 ceph-mon[41182]: osdmap e10: 2 total, 1 up, 2 in 2023-12-17T11:58:02.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:01 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-17T11:58:02.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:01 smithi008 ceph-mon[36830]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:58:02.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:01 smithi008 ceph-mon[36830]: from='client.? 172.21.15.100:0/1287320065' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d7138889-77de-43ba-b36b-7628f6f66bee"}]: dispatch 2023-12-17T11:58:02.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:01 smithi008 ceph-mon[36830]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d7138889-77de-43ba-b36b-7628f6f66bee"}]: dispatch 2023-12-17T11:58:02.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:01 smithi008 ceph-mon[36830]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d7138889-77de-43ba-b36b-7628f6f66bee"}]': finished 2023-12-17T11:58:02.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:01 smithi008 ceph-mon[36830]: osdmap e10: 2 total, 1 up, 2 in 2023-12-17T11:58:02.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:01 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-17T11:58:02.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:01 smithi100 ceph-mon[41266]: pgmap v46: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:58:02.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:01 smithi100 ceph-mon[41266]: from='client.? 172.21.15.100:0/1287320065' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d7138889-77de-43ba-b36b-7628f6f66bee"}]: dispatch 2023-12-17T11:58:02.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:01 smithi100 ceph-mon[41266]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d7138889-77de-43ba-b36b-7628f6f66bee"}]: dispatch 2023-12-17T11:58:02.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:01 smithi100 ceph-mon[41266]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d7138889-77de-43ba-b36b-7628f6f66bee"}]': finished 2023-12-17T11:58:02.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:01 smithi100 ceph-mon[41266]: osdmap e10: 2 total, 1 up, 2 in 2023-12-17T11:58:02.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:01 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-17T11:58:03.225 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:02 smithi186 ceph-mon[41182]: from='client.? 172.21.15.100:0/2770420931' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T11:58:03.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:02 smithi008 ceph-mon[36830]: from='client.? 172.21.15.100:0/2770420931' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T11:58:03.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:02 smithi100 ceph-mon[41266]: from='client.? 172.21.15.100:0/2770420931' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T11:58:04.225 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:03 smithi186 ceph-mon[41182]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:58:04.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:03 smithi008 ceph-mon[36830]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:58:04.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:03 smithi100 ceph-mon[41266]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:58:06.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:05 smithi100 ceph-mon[41266]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:58:06.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:05 smithi186 ceph-mon[41182]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:58:06.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:05 smithi008 ceph-mon[36830]: pgmap v49: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:58:08.665 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:08 smithi100 ceph-mon[41266]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:58:08.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:08 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-17T11:58:08.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:08 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:08.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:08 smithi186 ceph-mon[41182]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:58:08.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:08 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-17T11:58:08.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:08 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:08.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:08 smithi008 ceph-mon[36830]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:58:08.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:08 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-12-17T11:58:08.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:08 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:09.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:09 smithi100 ceph-mon[41266]: Deploying daemon osd.1 on smithi100 2023-12-17T11:58:09.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:09 smithi186 ceph-mon[41182]: Deploying daemon osd.1 on smithi100 2023-12-17T11:58:09.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:09 smithi008 ceph-mon[36830]: Deploying daemon osd.1 on smithi100 2023-12-17T11:58:10.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:10 smithi186 ceph-mon[41182]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:58:10.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:10 smithi008 ceph-mon[36830]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:58:10.779 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:10 smithi100 ceph-mon[41266]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:58:12.705 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:12 smithi100 ceph-mon[41266]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:58:12.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:12 smithi186 ceph-mon[41182]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:58:12.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:12 smithi008 ceph-mon[36830]: pgmap v52: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:58:14.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:14 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:14.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:14 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:14.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:14 smithi100 ceph-mon[41266]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:58:14.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:14 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:58:14.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:14 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:14.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:14 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:14.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:14 smithi186 ceph-mon[41182]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:58:14.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:14 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:58:14.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:14 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:14.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:14 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:14.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:14 smithi008 ceph-mon[36830]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:58:14.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:14 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:58:16.164 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:58:16.162+0000 7fbf977fe700 1 -- 172.21.15.100:0/1490540875 <== mgr.14154 v2:172.21.15.8:6800/268548699 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fbfa802d420 con 0x7fbf900a1470 2023-12-17T11:58:16.165 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 1 on host 'smithi100' 2023-12-17T11:58:16.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:58:16.164+0000 7fbfacfae700 1 -- 172.21.15.100:0/1490540875 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fbf900a1470 msgr2=0x7fbf900a3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:16.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:58:16.164+0000 7fbfacfae700 1 --2- 172.21.15.100:0/1490540875 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fbf900a1470 0x7fbf900a3930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbf98000c00 tx=0x7fbf98005fb0 comp rx=0 tx=0).stop 2023-12-17T11:58:16.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:58:16.164+0000 7fbfacfae700 1 -- 172.21.15.100:0/1490540875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfa81049d0 msgr2=0x7fbfa81979b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:16.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:58:16.164+0000 7fbfacfae700 1 --2- 172.21.15.100:0/1490540875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfa81049d0 0x7fbfa81979b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c00d980 tx=0x7fbf9c00dd40 comp rx=0 tx=0).stop 2023-12-17T11:58:16.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:58:16.164+0000 7fbfacfae700 1 -- 172.21.15.100:0/1490540875 shutdown_connections 2023-12-17T11:58:16.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:58:16.164+0000 7fbfacfae700 1 --2- 172.21.15.100:0/1490540875 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fbf900a1470 0x7fbf900a3930 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:16.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:58:16.164+0000 7fbfacfae700 1 --2- 172.21.15.100:0/1490540875 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbfa8107300 0x7fbfa819e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:16.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:58:16.164+0000 7fbfacfae700 1 --2- 172.21.15.100:0/1490540875 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbfa81020a0 0x7fbfa8197470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:16.167 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:58:16.164+0000 7fbfacfae700 1 --2- 172.21.15.100:0/1490540875 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbfa81049d0 0x7fbfa81979b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:16.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:58:16.164+0000 7fbfacfae700 1 -- 172.21.15.100:0/1490540875 >> 172.21.15.100:0/1490540875 conn(0x7fbfa80fbad0 msgr2=0x7fbfa8103f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:58:16.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:58:16.165+0000 7fbfacfae700 1 -- 172.21.15.100:0/1490540875 shutdown_connections 2023-12-17T11:58:16.168 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:58:16.165+0000 7fbfacfae700 1 -- 172.21.15.100:0/1490540875 wait complete. 2023-12-17T11:58:16.365 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:16 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:16.365 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:16 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:16.365 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:16 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:16.365 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:16 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:58:16.365 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:16 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:16.365 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:16 smithi100 ceph-mon[41266]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:58:16.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:16 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:16.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:16 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:16.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:16 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:16.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:16 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:58:16.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:16 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:16.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:16 smithi186 ceph-mon[41182]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:58:16.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:16 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:16.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:16 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:16.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:16 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:16.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:16 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:58:16.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:16 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:16.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:16 smithi008 ceph-mon[36830]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:58:16.552 DEBUG:teuthology.orchestra.run.smithi100:osd.1> sudo journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.1.service 2023-12-17T11:58:16.556 INFO:tasks.cephadm:Deploying osd.2 on smithi186 with /dev/vg_nvme/lv_4... 2023-12-17T11:58:16.557 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-12-17T11:58:16.637 INFO:journalctl@ceph.osd.1.smithi100.stdout:-- Logs begin at Sun 2023-12-17 11:35:53 UTC. -- 2023-12-17T11:58:16.963 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.c/config 2023-12-17T11:58:17.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:17 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:17.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:17 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:17.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:17 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:58:17.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:17 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:17.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:17 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:17.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:17 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:58:17.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:17 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:17.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:17 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:17.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:17 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:58:17.622 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 17 11:58:17 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-1[46308]: 2023-12-17T11:58:17.394+0000 7f3cb2e61640 -1 osd.1 0 log_to_monitors true 2023-12-17T11:58:18.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:18 smithi186 ceph-mon[41182]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:58:18.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:18 smithi186 ceph-mon[41182]: from='osd.1 [v2:172.21.15.100:6800/2496516573,v1:172.21.15.100:6801/2496516573]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-17T11:58:18.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:18 smithi186 ceph-mon[41182]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-17T11:58:18.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:18 smithi100 ceph-mon[41266]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:58:18.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:18 smithi100 ceph-mon[41266]: from='osd.1 [v2:172.21.15.100:6800/2496516573,v1:172.21.15.100:6801/2496516573]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-17T11:58:18.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:18 smithi100 ceph-mon[41266]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-17T11:58:18.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:18 smithi008 ceph-mon[36830]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:58:18.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:18 smithi008 ceph-mon[36830]: from='osd.1 [v2:172.21.15.100:6800/2496516573,v1:172.21.15.100:6801/2496516573]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-17T11:58:18.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:18 smithi008 ceph-mon[36830]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-12-17T11:58:18.752 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-12-17T11:58:18.752 INFO:teuthology.orchestra.run.smithi186.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-12-17T11:58:18.752 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10+0 records in 2023-12-17T11:58:18.752 INFO:teuthology.orchestra.run.smithi186.stderr:10+0 records out 2023-12-17T11:58:18.752 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0305334 s, 343 MB/s 2023-12-17T11:58:18.753 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping successful for: 2023-12-17T11:58:19.184 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi186:vg_nvme/lv_4 2023-12-17T11:58:19.256 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 17 11:58:19 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-1[46308]: 2023-12-17T11:58:19.159+0000 7f3ca84d8700 -1 osd.1 0 waiting for initial osdmap 2023-12-17T11:58:19.256 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 17 11:58:19 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-1[46308]: 2023-12-17T11:58:19.163+0000 7f3ca1acd700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-17T11:58:19.257 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:19 smithi100 ceph-mon[41266]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-17T11:58:19.257 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:19 smithi100 ceph-mon[41266]: from='osd.1 [v2:172.21.15.100:6800/2496516573,v1:172.21.15.100:6801/2496516573]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2023-12-17T11:58:19.257 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:19 smithi100 ceph-mon[41266]: osdmap e11: 2 total, 1 up, 2 in 2023-12-17T11:58:19.257 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:19 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-17T11:58:19.257 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:19 smithi100 ceph-mon[41266]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2023-12-17T11:58:19.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:19 smithi186 ceph-mon[41182]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-17T11:58:19.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:19 smithi186 ceph-mon[41182]: from='osd.1 [v2:172.21.15.100:6800/2496516573,v1:172.21.15.100:6801/2496516573]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2023-12-17T11:58:19.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:19 smithi186 ceph-mon[41182]: osdmap e11: 2 total, 1 up, 2 in 2023-12-17T11:58:19.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:19 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-17T11:58:19.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:19 smithi186 ceph-mon[41182]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2023-12-17T11:58:19.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:19 smithi008 ceph-mon[36830]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-12-17T11:58:19.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:19 smithi008 ceph-mon[36830]: from='osd.1 [v2:172.21.15.100:6800/2496516573,v1:172.21.15.100:6801/2496516573]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2023-12-17T11:58:19.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:19 smithi008 ceph-mon[36830]: osdmap e11: 2 total, 1 up, 2 in 2023-12-17T11:58:19.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:19 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-17T11:58:19.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:19 smithi008 ceph-mon[36830]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2023-12-17T11:58:19.587 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.c/config 2023-12-17T11:58:20.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:20 smithi100 ceph-mon[41266]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2023-12-17T11:58:20.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:20 smithi100 ceph-mon[41266]: osdmap e12: 2 total, 1 up, 2 in 2023-12-17T11:58:20.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:20 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-17T11:58:20.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:20 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-17T11:58:20.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:20 smithi100 ceph-mon[41266]: Detected new or changed devices on smithi100 2023-12-17T11:58:20.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:20 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:20.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:20 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:20.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:20 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:58:20.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:20 smithi100 ceph-mon[41266]: Adjusting osd_memory_target on smithi100 to 17271M 2023-12-17T11:58:20.417 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:20 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:20.417 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:20 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:20.417 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:20 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:58:20.417 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:20 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:20.417 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:20 smithi100 ceph-mon[41266]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:58:20.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:20 smithi186 ceph-mon[41182]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2023-12-17T11:58:20.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:20 smithi186 ceph-mon[41182]: osdmap e12: 2 total, 1 up, 2 in 2023-12-17T11:58:20.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:20 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-17T11:58:20.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:20 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-17T11:58:20.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:20 smithi186 ceph-mon[41182]: Detected new or changed devices on smithi100 2023-12-17T11:58:20.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:20 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:20.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:20 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:20.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:20 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:58:20.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:20 smithi186 ceph-mon[41182]: Adjusting osd_memory_target on smithi100 to 17271M 2023-12-17T11:58:20.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:20 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:20.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:20 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:20.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:20 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:58:20.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:20 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:20.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:20 smithi186 ceph-mon[41182]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:58:20.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:20 smithi008 ceph-mon[36830]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2023-12-17T11:58:20.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:20 smithi008 ceph-mon[36830]: osdmap e12: 2 total, 1 up, 2 in 2023-12-17T11:58:20.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:20 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-17T11:58:20.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:20 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-17T11:58:20.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:20 smithi008 ceph-mon[36830]: Detected new or changed devices on smithi100 2023-12-17T11:58:20.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:20 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:20.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:20 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:20.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:20 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:58:20.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:20 smithi008 ceph-mon[36830]: Adjusting osd_memory_target on smithi100 to 17271M 2023-12-17T11:58:20.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:20 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:20.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:20 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:20.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:20 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:58:20.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:20 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:20.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:20 smithi008 ceph-mon[36830]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-12-17T11:58:20.843 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.840+0000 7fe50acfc700 1 -- 172.21.15.186:0/262909578 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe504101620 msgr2=0x7fe504101a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:20.843 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.840+0000 7fe50acfc700 1 --2- 172.21.15.186:0/262909578 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe504101620 0x7fe504101a40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe4f8009990 tx=0x7fe4f8009ca0 comp rx=0 tx=0).stop 2023-12-17T11:58:20.843 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.840+0000 7fe50acfc700 1 -- 172.21.15.186:0/262909578 shutdown_connections 2023-12-17T11:58:20.843 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.840+0000 7fe50acfc700 1 --2- 172.21.15.186:0/262909578 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5041031c0 0x7fe504109a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:20.843 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.840+0000 7fe50acfc700 1 --2- 172.21.15.186:0/262909578 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe504101620 0x7fe504101a40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:20.843 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.840+0000 7fe50acfc700 1 --2- 172.21.15.186:0/262909578 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe504102820 0x7fe504102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:20.843 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.840+0000 7fe50acfc700 1 -- 172.21.15.186:0/262909578 >> 172.21.15.186:0/262909578 conn(0x7fe5040fcbe0 msgr2=0x7fe5040ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:58:20.843 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.841+0000 7fe50acfc700 1 -- 172.21.15.186:0/262909578 shutdown_connections 2023-12-17T11:58:20.843 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.841+0000 7fe50acfc700 1 -- 172.21.15.186:0/262909578 wait complete. 2023-12-17T11:58:20.846 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.842+0000 7fe50acfc700 1 Processor -- start 2023-12-17T11:58:20.846 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.842+0000 7fe50acfc700 1 -- start start 2023-12-17T11:58:20.846 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.842+0000 7fe50acfc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe504101620 0x7fe5041974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:58:20.846 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.842+0000 7fe50acfc700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe504102820 0x7fe504197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:58:20.846 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.842+0000 7fe50acfc700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5041031c0 0x7fe50419ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:58:20.846 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.842+0000 7fe50acfc700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50419efe0 con 0x7fe504101620 2023-12-17T11:58:20.846 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.842+0000 7fe50acfc700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50419f120 con 0x7fe5041031c0 2023-12-17T11:58:20.846 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.842+0000 7fe50acfc700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50419f2b0 con 0x7fe504102820 2023-12-17T11:58:20.846 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.843+0000 7fe503fff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe504102820 0x7fe504197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:58:20.846 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.843+0000 7fe503fff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe504102820 0x7fe504197a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:44734/0 (socket says 172.21.15.186:44734) 2023-12-17T11:58:20.846 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.843+0000 7fe503fff700 1 -- 172.21.15.186:0/3992640872 learned_addr learned my addr 172.21.15.186:0/3992640872 (peer_addr_for_me v2:172.21.15.186:0/0) 2023-12-17T11:58:20.846 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.843+0000 7fe508a98700 1 --2- 172.21.15.186:0/3992640872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe504101620 0x7fe5041974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:58:20.847 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.843+0000 7fe509299700 1 --2- 172.21.15.186:0/3992640872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5041031c0 0x7fe50419ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:58:20.847 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.843+0000 7fe503fff700 1 -- 172.21.15.186:0/3992640872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5041031c0 msgr2=0x7fe50419ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:20.847 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.843+0000 7fe503fff700 1 --2- 172.21.15.186:0/3992640872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5041031c0 0x7fe50419ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:20.847 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.843+0000 7fe503fff700 1 -- 172.21.15.186:0/3992640872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe504101620 msgr2=0x7fe5041974f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:20.847 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.843+0000 7fe503fff700 1 --2- 172.21.15.186:0/3992640872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe504101620 0x7fe5041974f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:20.847 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.843+0000 7fe503fff700 1 -- 172.21.15.186:0/3992640872 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4f80095f0 con 0x7fe504102820 2023-12-17T11:58:20.847 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.843+0000 7fe509299700 1 --2- 172.21.15.186:0/3992640872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5041031c0 0x7fe50419ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T11:58:20.847 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.843+0000 7fe503fff700 1 --2- 172.21.15.186:0/3992640872 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe504102820 0x7fe504197a30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe4f000d980 tx=0x7fe4f000dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:58:20.847 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.844+0000 7fe501ffb700 1 -- 172.21.15.186:0/3992640872 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f0009b40 con 0x7fe504102820 2023-12-17T11:58:20.847 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.844+0000 7fe50acfc700 1 -- 172.21.15.186:0/3992640872 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe50419f590 con 0x7fe504102820 2023-12-17T11:58:20.847 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.844+0000 7fe501ffb700 1 -- 172.21.15.186:0/3992640872 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe4f000b6e0 con 0x7fe504102820 2023-12-17T11:58:20.847 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.844+0000 7fe501ffb700 1 -- 172.21.15.186:0/3992640872 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f000f3c0 con 0x7fe504102820 2023-12-17T11:58:20.848 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.844+0000 7fe50acfc700 1 -- 172.21.15.186:0/3992640872 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe50419fae0 con 0x7fe504102820 2023-12-17T11:58:20.848 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.845+0000 7fe50acfc700 1 -- 172.21.15.186:0/3992640872 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe504108ba0 con 0x7fe504102820 2023-12-17T11:58:20.849 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.847+0000 7fe501ffb700 1 -- 172.21.15.186:0/3992640872 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 15) v1 ==== 135949+0+0 (secure 0 0 0) 0x7fe4f0010460 con 0x7fe504102820 2023-12-17T11:58:20.850 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.848+0000 7fe501ffb700 1 --2- 172.21.15.186:0/3992640872 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fe4f40a14f0 0x7fe4f40a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:58:20.850 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.848+0000 7fe501ffb700 1 -- 172.21.15.186:0/3992640872 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2309+0+0 (secure 0 0 0) 0x7fe4f00cb350 con 0x7fe504102820 2023-12-17T11:58:20.851 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.849+0000 7fe508a98700 1 --2- 172.21.15.186:0/3992640872 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fe4f40a14f0 0x7fe4f40a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:58:20.851 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.849+0000 7fe508a98700 1 --2- 172.21.15.186:0/3992640872 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fe4f40a14f0 0x7fe4f40a39b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe4f800b5c0 tx=0x7fe4f8005fd0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:58:20.855 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:20.853+0000 7fe501ffb700 1 -- 172.21.15.186:0/3992640872 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe4f0096160 con 0x7fe504102820 2023-12-17T11:58:21.061 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:21.059+0000 7fe50acfc700 1 -- 172.21.15.186:0/3992640872 --> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fe504061a10 con 0x7fe4f40a14f0 2023-12-17T11:58:21.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:21 smithi100 ceph-mon[41266]: purged_snaps scrub starts 2023-12-17T11:58:21.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:21 smithi100 ceph-mon[41266]: purged_snaps scrub ok 2023-12-17T11:58:21.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:21 smithi100 ceph-mon[41266]: osd.1 [v2:172.21.15.100:6800/2496516573,v1:172.21.15.100:6801/2496516573] boot 2023-12-17T11:58:21.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:21 smithi100 ceph-mon[41266]: osdmap e13: 2 total, 2 up, 2 in 2023-12-17T11:58:21.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:21 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-17T11:58:21.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:21 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T11:58:21.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:21 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T11:58:21.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:21 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:21.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:21 smithi186 ceph-mon[41182]: purged_snaps scrub starts 2023-12-17T11:58:21.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:21 smithi186 ceph-mon[41182]: purged_snaps scrub ok 2023-12-17T11:58:21.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:21 smithi186 ceph-mon[41182]: osd.1 [v2:172.21.15.100:6800/2496516573,v1:172.21.15.100:6801/2496516573] boot 2023-12-17T11:58:21.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:21 smithi186 ceph-mon[41182]: osdmap e13: 2 total, 2 up, 2 in 2023-12-17T11:58:21.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:21 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-17T11:58:21.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:21 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T11:58:21.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:21 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T11:58:21.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:21 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:21.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:21 smithi008 ceph-mon[36830]: purged_snaps scrub starts 2023-12-17T11:58:21.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:21 smithi008 ceph-mon[36830]: purged_snaps scrub ok 2023-12-17T11:58:21.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:21 smithi008 ceph-mon[36830]: osd.1 [v2:172.21.15.100:6800/2496516573,v1:172.21.15.100:6801/2496516573] boot 2023-12-17T11:58:21.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:21 smithi008 ceph-mon[36830]: osdmap e13: 2 total, 2 up, 2 in 2023-12-17T11:58:21.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:21 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-12-17T11:58:21.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:21 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T11:58:21.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:21 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T11:58:21.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:21 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:22.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:22 smithi100 ceph-mon[41266]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:58:22.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:22 smithi100 ceph-mon[41266]: osdmap e14: 2 total, 2 up, 2 in 2023-12-17T11:58:22.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:22 smithi100 ceph-mon[41266]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-17T11:58:22.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:22 smithi186 ceph-mon[41182]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:58:22.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:22 smithi186 ceph-mon[41182]: osdmap e14: 2 total, 2 up, 2 in 2023-12-17T11:58:22.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:22 smithi186 ceph-mon[41182]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-17T11:58:22.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:22 smithi008 ceph-mon[36830]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:58:22.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:22 smithi008 ceph-mon[36830]: osdmap e14: 2 total, 2 up, 2 in 2023-12-17T11:58:22.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:22 smithi008 ceph-mon[36830]: pgmap v61: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-17T11:58:24.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:24 smithi186 ceph-mon[41182]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-17T11:58:24.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:24 smithi186 ceph-mon[41182]: from='client.? 172.21.15.186:0/637924143' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff452a6b-a11e-47be-9eaf-ec1001b51447"}]: dispatch 2023-12-17T11:58:24.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:24 smithi186 ceph-mon[41182]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff452a6b-a11e-47be-9eaf-ec1001b51447"}]: dispatch 2023-12-17T11:58:24.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:24 smithi186 ceph-mon[41182]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ff452a6b-a11e-47be-9eaf-ec1001b51447"}]': finished 2023-12-17T11:58:24.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:24 smithi186 ceph-mon[41182]: osdmap e15: 3 total, 2 up, 3 in 2023-12-17T11:58:24.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:24 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-17T11:58:24.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:24 smithi186 ceph-mon[41182]: from='client.? 172.21.15.186:0/1609574731' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T11:58:24.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:24 smithi008 ceph-mon[36830]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-17T11:58:24.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:24 smithi008 ceph-mon[36830]: from='client.? 172.21.15.186:0/637924143' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff452a6b-a11e-47be-9eaf-ec1001b51447"}]: dispatch 2023-12-17T11:58:24.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:24 smithi008 ceph-mon[36830]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff452a6b-a11e-47be-9eaf-ec1001b51447"}]: dispatch 2023-12-17T11:58:24.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:24 smithi008 ceph-mon[36830]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ff452a6b-a11e-47be-9eaf-ec1001b51447"}]': finished 2023-12-17T11:58:24.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:24 smithi008 ceph-mon[36830]: osdmap e15: 3 total, 2 up, 3 in 2023-12-17T11:58:24.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:24 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-17T11:58:24.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:24 smithi008 ceph-mon[36830]: from='client.? 172.21.15.186:0/1609574731' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T11:58:24.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:24 smithi100 ceph-mon[41266]: pgmap v62: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-17T11:58:24.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:24 smithi100 ceph-mon[41266]: from='client.? 172.21.15.186:0/637924143' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff452a6b-a11e-47be-9eaf-ec1001b51447"}]: dispatch 2023-12-17T11:58:24.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:24 smithi100 ceph-mon[41266]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ff452a6b-a11e-47be-9eaf-ec1001b51447"}]: dispatch 2023-12-17T11:58:24.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:24 smithi100 ceph-mon[41266]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ff452a6b-a11e-47be-9eaf-ec1001b51447"}]': finished 2023-12-17T11:58:24.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:24 smithi100 ceph-mon[41266]: osdmap e15: 3 total, 2 up, 3 in 2023-12-17T11:58:24.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:24 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-17T11:58:24.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:24 smithi100 ceph-mon[41266]: from='client.? 172.21.15.186:0/1609574731' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T11:58:26.165 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:25 smithi100 ceph-mon[41266]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-17T11:58:26.225 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:25 smithi186 ceph-mon[41182]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-17T11:58:26.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:25 smithi008 ceph-mon[36830]: pgmap v64: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-17T11:58:28.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:28 smithi186 ceph-mon[41182]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-17T11:58:28.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:28 smithi008 ceph-mon[36830]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-17T11:58:28.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:28 smithi100 ceph-mon[41266]: pgmap v65: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-17T11:58:30.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:30 smithi186 ceph-mon[41182]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-17T11:58:30.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:30 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-17T11:58:30.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:30 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:30.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:30 smithi008 ceph-mon[36830]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-17T11:58:30.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:30 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-17T11:58:30.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:30 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:30.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:30 smithi100 ceph-mon[41266]: pgmap v66: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-17T11:58:30.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:30 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-12-17T11:58:30.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:30 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:31.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:31 smithi186 ceph-mon[41182]: Deploying daemon osd.2 on smithi186 2023-12-17T11:58:31.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:31 smithi008 ceph-mon[36830]: Deploying daemon osd.2 on smithi186 2023-12-17T11:58:31.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:31 smithi100 ceph-mon[41266]: Deploying daemon osd.2 on smithi186 2023-12-17T11:58:32.528 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:32 smithi186 ceph-mon[41182]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-17T11:58:32.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:32 smithi008 ceph-mon[36830]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-17T11:58:32.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:32 smithi100 ceph-mon[41266]: pgmap v67: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-17T11:58:34.711 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:34 smithi186 ceph-mon[41182]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-17T11:58:34.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:34 smithi008 ceph-mon[36830]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-17T11:58:34.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:34 smithi100 ceph-mon[41266]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-17T11:58:36.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:35 smithi100 ceph-mon[41266]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-17T11:58:36.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:35 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:36.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:35 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:36.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:35 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:58:36.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:35 smithi186 ceph-mon[41182]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-17T11:58:36.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:35 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:36.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:35 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:36.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:35 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:58:36.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:35 smithi008 ceph-mon[36830]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-17T11:58:36.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:35 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:36.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:35 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:36.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:35 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:58:38.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:38 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:38.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:38 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:38.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:38 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:38.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:38 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:58:38.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:38 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:38.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:38 smithi186 ceph-mon[41182]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-17T11:58:38.634 INFO:teuthology.orchestra.run.smithi186.stdout:Created osd(s) 2 on host 'smithi186' 2023-12-17T11:58:38.635 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:38.632+0000 7fe501ffb700 1 -- 172.21.15.186:0/3992640872 <== mgr.14154 v2:172.21.15.8:6800/268548699 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe504061a10 con 0x7fe4f40a14f0 2023-12-17T11:58:38.637 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:38.634+0000 7fe50acfc700 1 -- 172.21.15.186:0/3992640872 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fe4f40a14f0 msgr2=0x7fe4f40a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:38.637 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:38.634+0000 7fe50acfc700 1 --2- 172.21.15.186:0/3992640872 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fe4f40a14f0 0x7fe4f40a39b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe4f800b5c0 tx=0x7fe4f8005fd0 comp rx=0 tx=0).stop 2023-12-17T11:58:38.637 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:38.634+0000 7fe50acfc700 1 -- 172.21.15.186:0/3992640872 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe504102820 msgr2=0x7fe504197a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:38.637 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:38.634+0000 7fe50acfc700 1 --2- 172.21.15.186:0/3992640872 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe504102820 0x7fe504197a30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe4f000d980 tx=0x7fe4f000dc90 comp rx=0 tx=0).stop 2023-12-17T11:58:38.637 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:38.634+0000 7fe50acfc700 1 -- 172.21.15.186:0/3992640872 shutdown_connections 2023-12-17T11:58:38.637 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:38.634+0000 7fe50acfc700 1 --2- 172.21.15.186:0/3992640872 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fe4f40a14f0 0x7fe4f40a39b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:38.637 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:38.634+0000 7fe50acfc700 1 --2- 172.21.15.186:0/3992640872 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5041031c0 0x7fe50419ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:38.637 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:38.634+0000 7fe50acfc700 1 --2- 172.21.15.186:0/3992640872 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe504101620 0x7fe5041974f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:38.637 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:38.634+0000 7fe50acfc700 1 --2- 172.21.15.186:0/3992640872 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe504102820 0x7fe504197a30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:38.637 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:38.634+0000 7fe50acfc700 1 -- 172.21.15.186:0/3992640872 >> 172.21.15.186:0/3992640872 conn(0x7fe5040fcbe0 msgr2=0x7fe504105ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:58:38.637 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:38.635+0000 7fe50acfc700 1 -- 172.21.15.186:0/3992640872 shutdown_connections 2023-12-17T11:58:38.638 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:58:38.635+0000 7fe50acfc700 1 -- 172.21.15.186:0/3992640872 wait complete. 2023-12-17T11:58:38.665 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:38 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:38.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:38 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:38.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:38 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:38.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:38 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:58:38.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:38 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:38.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:38 smithi100 ceph-mon[41266]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-17T11:58:38.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:38 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:38.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:38 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:38.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:38 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:38.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:38 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:58:38.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:38 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:38.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:38 smithi008 ceph-mon[36830]: pgmap v70: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-17T11:58:39.054 DEBUG:teuthology.orchestra.run.smithi186:osd.2> sudo journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.2.service 2023-12-17T11:58:39.059 INFO:tasks.cephadm:Deploying osd.3 on smithi008 with /dev/vg_nvme/lv_3... 2023-12-17T11:58:39.059 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-17T11:58:39.136 INFO:journalctl@ceph.osd.2.smithi186.stdout:-- Logs begin at Sun 2023-12-17 11:40:47 UTC. -- 2023-12-17T11:58:39.483 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T11:58:39.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:39 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:39.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:39 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:39.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:39 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:58:39.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:39 smithi186 ceph-mon[41182]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-17T11:58:39.726 INFO:journalctl@ceph.osd.2.smithi186.stdout:Dec 17 11:58:39 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-2[46920]: 2023-12-17T11:58:39.616+0000 7f8658fb5640 -1 osd.2 0 log_to_monitors true 2023-12-17T11:58:39.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:39 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:39.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:39 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:39.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:39 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:58:39.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:39 smithi100 ceph-mon[41266]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-17T11:58:39.987 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:39 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:39.988 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:39 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:39.988 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:39 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:58:39.988 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:39 smithi008 ceph-mon[36830]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-17T11:58:40.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:40 smithi008 ceph-mon[36830]: from='osd.2 [v2:172.21.15.186:6800/2454925270,v1:172.21.15.186:6801/2454925270]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-17T11:58:40.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:40 smithi008 ceph-mon[36830]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-17T11:58:40.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:40 smithi100 ceph-mon[41266]: from='osd.2 [v2:172.21.15.186:6800/2454925270,v1:172.21.15.186:6801/2454925270]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-17T11:58:40.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:40 smithi100 ceph-mon[41266]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-17T11:58:40.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:40 smithi186 ceph-mon[41182]: from='osd.2 [v2:172.21.15.186:6800/2454925270,v1:172.21.15.186:6801/2454925270]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-17T11:58:40.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:40 smithi186 ceph-mon[41182]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-12-17T11:58:41.245 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-17T11:58:41.246 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-17T11:58:41.246 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 10+0 records in 2023-12-17T11:58:41.246 INFO:teuthology.orchestra.run.smithi008.stderr:10+0 records out 2023-12-17T11:58:41.246 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0310425 s, 338 MB/s 2023-12-17T11:58:41.246 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping successful for: 2023-12-17T11:58:41.654 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi008:vg_nvme/lv_3 2023-12-17T11:58:41.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:41 smithi100 ceph-mon[41266]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-17T11:58:41.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:41 smithi100 ceph-mon[41266]: from='osd.2 [v2:172.21.15.186:6800/2454925270,v1:172.21.15.186:6801/2454925270]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-12-17T11:58:41.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:41 smithi100 ceph-mon[41266]: osdmap e16: 3 total, 2 up, 3 in 2023-12-17T11:58:41.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:41 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-17T11:58:41.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:41 smithi100 ceph-mon[41266]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-12-17T11:58:41.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:41 smithi100 ceph-mon[41266]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-17T11:58:41.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:41 smithi100 ceph-mon[41266]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2023-12-17T11:58:41.976 INFO:journalctl@ceph.osd.2.smithi186.stdout:Dec 17 11:58:41 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-2[46920]: 2023-12-17T11:58:41.631+0000 7f864e62c700 -1 osd.2 0 waiting for initial osdmap 2023-12-17T11:58:41.976 INFO:journalctl@ceph.osd.2.smithi186.stdout:Dec 17 11:58:41 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-2[46920]: 2023-12-17T11:58:41.636+0000 7f8647420700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-17T11:58:41.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:41 smithi186 ceph-mon[41182]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-17T11:58:41.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:41 smithi186 ceph-mon[41182]: from='osd.2 [v2:172.21.15.186:6800/2454925270,v1:172.21.15.186:6801/2454925270]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-12-17T11:58:41.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:41 smithi186 ceph-mon[41182]: osdmap e16: 3 total, 2 up, 3 in 2023-12-17T11:58:41.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:41 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-17T11:58:41.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:41 smithi186 ceph-mon[41182]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-12-17T11:58:41.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:41 smithi186 ceph-mon[41182]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-17T11:58:41.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:41 smithi186 ceph-mon[41182]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2023-12-17T11:58:41.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:41 smithi008 ceph-mon[36830]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-12-17T11:58:41.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:41 smithi008 ceph-mon[36830]: from='osd.2 [v2:172.21.15.186:6800/2454925270,v1:172.21.15.186:6801/2454925270]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-12-17T11:58:41.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:41 smithi008 ceph-mon[36830]: osdmap e16: 3 total, 2 up, 3 in 2023-12-17T11:58:41.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:41 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-17T11:58:41.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:41 smithi008 ceph-mon[36830]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-12-17T11:58:41.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:41 smithi008 ceph-mon[36830]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-17T11:58:41.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:41 smithi008 ceph-mon[36830]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2023-12-17T11:58:42.069 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T11:58:42.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:42 smithi100 ceph-mon[41266]: purged_snaps scrub starts 2023-12-17T11:58:42.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:42 smithi100 ceph-mon[41266]: purged_snaps scrub ok 2023-12-17T11:58:42.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:42 smithi100 ceph-mon[41266]: osdmap e17: 3 total, 2 up, 3 in 2023-12-17T11:58:42.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:42 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-17T11:58:42.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:42 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-17T11:58:42.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:42 smithi100 ceph-mon[41266]: Detected new or changed devices on smithi186 2023-12-17T11:58:42.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:42 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:42.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:42 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:42.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:42 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:58:42.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:42 smithi100 ceph-mon[41266]: Adjusting osd_memory_target on smithi186 to 17271M 2023-12-17T11:58:42.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:42 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:42.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:42 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:42.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:42 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:58:42.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:42 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:42.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:42 smithi186 ceph-mon[41182]: purged_snaps scrub starts 2023-12-17T11:58:42.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:42 smithi186 ceph-mon[41182]: purged_snaps scrub ok 2023-12-17T11:58:42.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:42 smithi186 ceph-mon[41182]: osdmap e17: 3 total, 2 up, 3 in 2023-12-17T11:58:42.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:42 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-17T11:58:42.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:42 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-17T11:58:42.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:42 smithi186 ceph-mon[41182]: Detected new or changed devices on smithi186 2023-12-17T11:58:42.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:42 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:42.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:42 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:42.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:42 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:58:42.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:42 smithi186 ceph-mon[41182]: Adjusting osd_memory_target on smithi186 to 17271M 2023-12-17T11:58:42.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:42 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:42.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:42 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:42.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:42 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:58:42.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:42 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:42.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:42 smithi008 ceph-mon[36830]: purged_snaps scrub starts 2023-12-17T11:58:42.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:42 smithi008 ceph-mon[36830]: purged_snaps scrub ok 2023-12-17T11:58:42.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:42 smithi008 ceph-mon[36830]: osdmap e17: 3 total, 2 up, 3 in 2023-12-17T11:58:42.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:42 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-17T11:58:42.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:42 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-17T11:58:42.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:42 smithi008 ceph-mon[36830]: Detected new or changed devices on smithi186 2023-12-17T11:58:42.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:42 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:42.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:42 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:42.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:42 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:58:42.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:42 smithi008 ceph-mon[36830]: Adjusting osd_memory_target on smithi186 to 17271M 2023-12-17T11:58:42.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:42 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:42.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:42 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:42.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:42 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:58:42.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:42 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:43.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.325+0000 7f4db7dab700 1 -- 172.21.15.8:0/3003211662 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4db01094f0 msgr2=0x7f4db010b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:43.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.325+0000 7f4db7dab700 1 --2- 172.21.15.8:0/3003211662 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4db01094f0 0x7f4db010b980 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f4da800b0a0 tx=0x7f4da800b3b0 comp rx=0 tx=0).stop 2023-12-17T11:58:43.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.325+0000 7f4db7dab700 1 -- 172.21.15.8:0/3003211662 shutdown_connections 2023-12-17T11:58:43.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.325+0000 7f4db7dab700 1 --2- 172.21.15.8:0/3003211662 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4db01094f0 0x7f4db010b980 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:43.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.325+0000 7f4db7dab700 1 --2- 172.21.15.8:0/3003211662 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4db0075600 0x7f4db0073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:43.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.325+0000 7f4db7dab700 1 --2- 172.21.15.8:0/3003211662 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4db0074030 0x7f4db00744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:43.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.325+0000 7f4db7dab700 1 -- 172.21.15.8:0/3003211662 >> 172.21.15.8:0/3003211662 conn(0x7f4db00fcbe0 msgr2=0x7f4db00ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:58:43.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.325+0000 7f4db7dab700 1 -- 172.21.15.8:0/3003211662 shutdown_connections 2023-12-17T11:58:43.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.325+0000 7f4db7dab700 1 -- 172.21.15.8:0/3003211662 wait complete. 2023-12-17T11:58:43.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.326+0000 7f4db7dab700 1 Processor -- start 2023-12-17T11:58:43.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.326+0000 7f4db7dab700 1 -- start start 2023-12-17T11:58:43.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.327+0000 7f4db7dab700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4db0074030 0x7f4db01997c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:58:43.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.327+0000 7f4db7dab700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4db0075600 0x7f4db0199d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:58:43.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.327+0000 7f4db7dab700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4db01094f0 0x7f4db01a0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:58:43.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.327+0000 7f4db7dab700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db01a12b0 con 0x7f4db0075600 2023-12-17T11:58:43.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.327+0000 7f4db7dab700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db01a13f0 con 0x7f4db0074030 2023-12-17T11:58:43.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.327+0000 7f4db7dab700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db01a1580 con 0x7f4db01094f0 2023-12-17T11:58:43.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.327+0000 7f4db5346700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4db0075600 0x7f4db0199d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:58:43.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.327+0000 7f4db5346700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4db0075600 0x7f4db0199d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:46796/0 (socket says 172.21.15.8:46796) 2023-12-17T11:58:43.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.327+0000 7f4db5346700 1 -- 172.21.15.8:0/2616870445 learned_addr learned my addr 172.21.15.8:0/2616870445 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:58:43.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.327+0000 7f4db6348700 1 --2- 172.21.15.8:0/2616870445 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4db01094f0 0x7f4db01a0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:58:43.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.327+0000 7f4db5b47700 1 --2- 172.21.15.8:0/2616870445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4db0074030 0x7f4db01997c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:58:43.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.327+0000 7f4db5346700 1 -- 172.21.15.8:0/2616870445 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4db01094f0 msgr2=0x7f4db01a0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:43.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.327+0000 7f4db5346700 1 --2- 172.21.15.8:0/2616870445 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4db01094f0 0x7f4db01a0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:43.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.327+0000 7f4db5346700 1 -- 172.21.15.8:0/2616870445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4db0074030 msgr2=0x7f4db01997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:58:43.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.327+0000 7f4db5346700 1 --2- 172.21.15.8:0/2616870445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4db0074030 0x7f4db01997c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:58:43.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.327+0000 7f4db5346700 1 -- 172.21.15.8:0/2616870445 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da8009d00 con 0x7f4db0075600 2023-12-17T11:58:43.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.328+0000 7f4db5346700 1 --2- 172.21.15.8:0/2616870445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4db0075600 0x7f4db0199d00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4da000e9a0 tx=0x7f4da000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:58:43.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.328+0000 7f4da6ffd700 1 -- 172.21.15.8:0/2616870445 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da0009790 con 0x7f4db0075600 2023-12-17T11:58:43.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.328+0000 7f4da6ffd700 1 -- 172.21.15.8:0/2616870445 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4da00044b0 con 0x7f4db0075600 2023-12-17T11:58:43.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.328+0000 7f4db7dab700 1 -- 172.21.15.8:0/2616870445 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4db01a1860 con 0x7f4db0075600 2023-12-17T11:58:43.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.328+0000 7f4da6ffd700 1 -- 172.21.15.8:0/2616870445 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da0003c60 con 0x7f4db0075600 2023-12-17T11:58:43.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.328+0000 7f4db7dab700 1 -- 172.21.15.8:0/2616870445 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db01a1d60 con 0x7f4db0075600 2023-12-17T11:58:43.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.329+0000 7f4db7dab700 1 -- 172.21.15.8:0/2616870445 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4db01082b0 con 0x7f4db0075600 2023-12-17T11:58:43.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.331+0000 7f4da6ffd700 1 -- 172.21.15.8:0/2616870445 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 15) v1 ==== 135949+0+0 (secure 0 0 0) 0x7f4da0003dc0 con 0x7f4db0075600 2023-12-17T11:58:43.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.332+0000 7f4da6ffd700 1 --2- 172.21.15.8:0/2616870445 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4d9c0a13f0 0x7f4d9c0a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:58:43.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.333+0000 7f4da6ffd700 1 -- 172.21.15.8:0/2616870445 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 2851+0+0 (secure 0 0 0) 0x7f4da0014070 con 0x7f4db0075600 2023-12-17T11:58:43.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.333+0000 7f4db5b47700 1 --2- 172.21.15.8:0/2616870445 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4d9c0a13f0 0x7f4d9c0a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:58:43.335 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.333+0000 7f4db5b47700 1 --2- 172.21.15.8:0/2616870445 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4d9c0a13f0 0x7f4d9c0a38b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4db00759e0 tx=0x7f4dac009260 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:58:43.337 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.335+0000 7f4da6ffd700 1 -- 172.21.15.8:0/2616870445 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4da0096770 con 0x7f4db0075600 2023-12-17T11:58:43.557 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:43.555+0000 7f4db7dab700 1 -- 172.21.15.8:0/2616870445 --> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f4db0061a10 con 0x7f4d9c0a13f0 2023-12-17T11:58:44.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:43 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-17T11:58:44.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:43 smithi008 ceph-mon[36830]: osd.2 [v2:172.21.15.186:6800/2454925270,v1:172.21.15.186:6801/2454925270] boot 2023-12-17T11:58:44.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:43 smithi008 ceph-mon[36830]: osdmap e18: 3 total, 3 up, 3 in 2023-12-17T11:58:44.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:43 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-17T11:58:44.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:43 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-17T11:58:44.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:43 smithi100 ceph-mon[41266]: osd.2 [v2:172.21.15.186:6800/2454925270,v1:172.21.15.186:6801/2454925270] boot 2023-12-17T11:58:44.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:43 smithi100 ceph-mon[41266]: osdmap e18: 3 total, 3 up, 3 in 2023-12-17T11:58:44.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:43 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-17T11:58:44.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:43 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-17T11:58:44.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:43 smithi186 ceph-mon[41182]: osd.2 [v2:172.21.15.186:6800/2454925270,v1:172.21.15.186:6801/2454925270] boot 2023-12-17T11:58:44.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:43 smithi186 ceph-mon[41182]: osdmap e18: 3 total, 3 up, 3 in 2023-12-17T11:58:44.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:43 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-12-17T11:58:45.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:44 smithi008 ceph-mon[36830]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-17T11:58:45.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:44 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-12-17T11:58:45.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:44 smithi008 ceph-mon[36830]: from='client.14310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:58:45.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:44 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T11:58:45.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:44 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T11:58:45.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:44 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:45.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:44 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-12-17T11:58:45.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:44 smithi008 ceph-mon[36830]: osdmap e19: 3 total, 3 up, 3 in 2023-12-17T11:58:45.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:44 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-17T11:58:45.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:44 smithi100 ceph-mon[41266]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-17T11:58:45.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:44 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-12-17T11:58:45.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:44 smithi100 ceph-mon[41266]: from='client.14310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:58:45.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:44 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T11:58:45.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:44 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T11:58:45.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:44 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:45.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:44 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-12-17T11:58:45.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:44 smithi100 ceph-mon[41266]: osdmap e19: 3 total, 3 up, 3 in 2023-12-17T11:58:45.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:44 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-17T11:58:45.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:44 smithi186 ceph-mon[41182]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-12-17T11:58:45.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:44 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-12-17T11:58:45.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:44 smithi186 ceph-mon[41182]: from='client.14310 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:58:45.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:44 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T11:58:45.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:44 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T11:58:45.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:44 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:45.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:44 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-12-17T11:58:45.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:44 smithi186 ceph-mon[41182]: osdmap e19: 3 total, 3 up, 3 in 2023-12-17T11:58:45.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:44 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-12-17T11:58:45.996 INFO:journalctl@ceph.osd.0.smithi008.stdout:Dec 17 11:58:45 smithi008 sudo[60645]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-17T11:58:45.996 INFO:journalctl@ceph.osd.0.smithi008.stdout:Dec 17 11:58:45 smithi008 sudo[60645]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-17T11:58:45.996 INFO:journalctl@ceph.osd.0.smithi008.stdout:Dec 17 11:58:45 smithi008 sudo[60645]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-17T11:58:45.996 INFO:journalctl@ceph.osd.0.smithi008.stdout:Dec 17 11:58:45 smithi008 sudo[60645]: pam_unix(sudo:session): session closed for user root 2023-12-17T11:58:46.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:58:46.043+0000 7f4da6ffd700 1 -- 172.21.15.8:0/2616870445 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7f4da0096b40 con 0x7f4db0075600 2023-12-17T11:58:46.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:46 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-17T11:58:46.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:46 smithi100 ceph-mon[41266]: osdmap e20: 3 total, 3 up, 3 in 2023-12-17T11:58:46.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:46 smithi100 ceph-mon[41266]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-12-17T11:58:46.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:46 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-17T11:58:46.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:46 smithi186 ceph-mon[41182]: osdmap e20: 3 total, 3 up, 3 in 2023-12-17T11:58:46.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:46 smithi186 ceph-mon[41182]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-12-17T11:58:46.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:46 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-12-17T11:58:46.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:46 smithi008 ceph-mon[36830]: osdmap e20: 3 total, 3 up, 3 in 2023-12-17T11:58:46.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:46 smithi008 ceph-mon[36830]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 80 MiB used, 268 GiB / 268 GiB avail 2023-12-17T11:58:46.496 INFO:journalctl@ceph.osd.0.smithi008.stdout:Dec 17 11:58:46 smithi008 sudo[60688]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-17T11:58:46.496 INFO:journalctl@ceph.osd.0.smithi008.stdout:Dec 17 11:58:46 smithi008 sudo[60688]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-17T11:58:46.496 INFO:journalctl@ceph.osd.0.smithi008.stdout:Dec 17 11:58:46 smithi008 sudo[60688]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-17T11:58:46.496 INFO:journalctl@ceph.osd.0.smithi008.stdout:Dec 17 11:58:46 smithi008 sudo[60688]: pam_unix(sudo:session): session closed for user root 2023-12-17T11:58:47.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:47 smithi100 ceph-mon[41266]: osdmap e21: 3 total, 3 up, 3 in 2023-12-17T11:58:47.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:47 smithi100 ceph-mon[41266]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-12-17T11:58:47.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:47 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:47.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:47 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/3962210591' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d19ab765-df7b-48c7-9012-8a3ac7d81aca"}]: dispatch 2023-12-17T11:58:47.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:47 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/3962210591' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d19ab765-df7b-48c7-9012-8a3ac7d81aca"}]': finished 2023-12-17T11:58:47.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:47 smithi100 ceph-mon[41266]: osdmap e22: 4 total, 3 up, 4 in 2023-12-17T11:58:47.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:47 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-17T11:58:47.166 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 17 11:58:46 smithi100 sudo[51064]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-17T11:58:47.166 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 17 11:58:46 smithi100 sudo[51064]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-17T11:58:47.166 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 17 11:58:46 smithi100 sudo[51064]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-17T11:58:47.167 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 17 11:58:46 smithi100 sudo[51064]: pam_unix(sudo:session): session closed for user root 2023-12-17T11:58:47.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:47 smithi186 ceph-mon[41182]: osdmap e21: 3 total, 3 up, 3 in 2023-12-17T11:58:47.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:47 smithi186 ceph-mon[41182]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-12-17T11:58:47.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:47 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:47.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:47 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/3962210591' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d19ab765-df7b-48c7-9012-8a3ac7d81aca"}]: dispatch 2023-12-17T11:58:47.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:47 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/3962210591' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d19ab765-df7b-48c7-9012-8a3ac7d81aca"}]': finished 2023-12-17T11:58:47.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:47 smithi186 ceph-mon[41182]: osdmap e22: 4 total, 3 up, 4 in 2023-12-17T11:58:47.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:47 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-17T11:58:47.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:47 smithi008 ceph-mon[36830]: osdmap e21: 3 total, 3 up, 3 in 2023-12-17T11:58:47.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:47 smithi008 ceph-mon[36830]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-12-17T11:58:47.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:47 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:47.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:47 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/3962210591' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d19ab765-df7b-48c7-9012-8a3ac7d81aca"}]: dispatch 2023-12-17T11:58:47.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:47 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/3962210591' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d19ab765-df7b-48c7-9012-8a3ac7d81aca"}]': finished 2023-12-17T11:58:47.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:47 smithi008 ceph-mon[36830]: osdmap e22: 4 total, 3 up, 4 in 2023-12-17T11:58:47.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:47 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-17T11:58:47.666 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 17 11:58:47 smithi100 sudo[51067]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-17T11:58:47.666 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 17 11:58:47 smithi100 sudo[51067]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-17T11:58:47.666 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 17 11:58:47 smithi100 sudo[51067]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-17T11:58:47.666 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 17 11:58:47 smithi100 sudo[51067]: pam_unix(sudo:session): session closed for user root 2023-12-17T11:58:48.225 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:48 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/1480252233' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T11:58:48.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:48 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:48.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:48 smithi186 ceph-mon[41182]: pgmap v82: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-12-17T11:58:48.226 INFO:journalctl@ceph.osd.2.smithi186.stdout:Dec 17 11:58:47 smithi186 sudo[52148]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-17T11:58:48.226 INFO:journalctl@ceph.osd.2.smithi186.stdout:Dec 17 11:58:47 smithi186 sudo[52148]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-17T11:58:48.226 INFO:journalctl@ceph.osd.2.smithi186.stdout:Dec 17 11:58:47 smithi186 sudo[52148]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-17T11:58:48.226 INFO:journalctl@ceph.osd.2.smithi186.stdout:Dec 17 11:58:47 smithi186 sudo[52148]: pam_unix(sudo:session): session closed for user root 2023-12-17T11:58:48.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:48 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/1480252233' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T11:58:48.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:48 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:48.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:48 smithi100 ceph-mon[41266]: pgmap v82: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-12-17T11:58:48.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:48 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/1480252233' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T11:58:48.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:48 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:48.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:48 smithi008 ceph-mon[36830]: pgmap v82: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-12-17T11:58:48.725 INFO:journalctl@ceph.osd.2.smithi186.stdout:Dec 17 11:58:48 smithi186 sudo[52151]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-17T11:58:48.726 INFO:journalctl@ceph.osd.2.smithi186.stdout:Dec 17 11:58:48 smithi186 sudo[52151]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-17T11:58:48.726 INFO:journalctl@ceph.osd.2.smithi186.stdout:Dec 17 11:58:48 smithi186 sudo[52151]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-17T11:58:48.726 INFO:journalctl@ceph.osd.2.smithi186.stdout:Dec 17 11:58:48 smithi186 sudo[52151]: pam_unix(sudo:session): session closed for user root 2023-12-17T11:58:49.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:48 smithi008 sudo[61522]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-17T11:58:49.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:48 smithi008 sudo[61522]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-17T11:58:49.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:48 smithi008 sudo[61522]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-17T11:58:49.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:49 smithi008 sudo[61522]: pam_unix(sudo:session): session closed for user root 2023-12-17T11:58:49.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:49 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:49.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:49 smithi100 ceph-mon[41266]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-17T11:58:49.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:49 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:49.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:49 smithi186 ceph-mon[41182]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-17T11:58:49.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:49 smithi008 sudo[61713]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-17T11:58:49.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:49 smithi008 sudo[61713]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-17T11:58:49.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:49 smithi008 sudo[61713]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-17T11:58:49.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:49 smithi008 sudo[61713]: pam_unix(sudo:session): session closed for user root 2023-12-17T11:58:49.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:49 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:49.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:49 smithi008 ceph-mon[36830]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-17T11:58:50.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:50 smithi186 sudo[52154]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-17T11:58:50.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:50 smithi186 sudo[52154]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-17T11:58:50.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:50 smithi186 sudo[52154]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-17T11:58:50.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:50 smithi186 sudo[52154]: pam_unix(sudo:session): session closed for user root 2023-12-17T11:58:50.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:50 smithi186 sudo[52157]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-17T11:58:50.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:50 smithi186 sudo[52157]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-17T11:58:50.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:50 smithi186 sudo[52157]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-17T11:58:50.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:50 smithi186 sudo[52157]: pam_unix(sudo:session): session closed for user root 2023-12-17T11:58:51.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:51 smithi100 sudo[51070]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-12-17T11:58:51.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:51 smithi100 sudo[51070]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-17T11:58:51.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:51 smithi100 sudo[51070]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-17T11:58:51.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:51 smithi100 sudo[51070]: pam_unix(sudo:session): session closed for user root 2023-12-17T11:58:51.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:51 smithi008 ceph-mon[36830]: pgmap v83: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-12-17T11:58:51.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:51 smithi008 ceph-mon[36830]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-17T11:58:51.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:51 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-17T11:58:51.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:51 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-17T11:58:51.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:51 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-17T11:58:51.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:51 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-17T11:58:51.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:51 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-17T11:58:51.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:51 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-17T11:58:51.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:51 smithi100 sudo[51073]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-12-17T11:58:51.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:51 smithi100 sudo[51073]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-12-17T11:58:51.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:51 smithi100 sudo[51073]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-12-17T11:58:51.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:51 smithi100 sudo[51073]: pam_unix(sudo:session): session closed for user root 2023-12-17T11:58:51.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:51 smithi100 ceph-mon[41266]: pgmap v83: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-12-17T11:58:51.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:51 smithi100 ceph-mon[41266]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-17T11:58:51.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:51 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-17T11:58:51.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:51 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-17T11:58:51.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:51 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-17T11:58:51.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:51 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-17T11:58:51.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:51 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-17T11:58:51.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:51 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-17T11:58:51.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:51 smithi186 ceph-mon[41182]: pgmap v83: 1 pgs: 1 active+clean; 449 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-12-17T11:58:51.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:51 smithi186 ceph-mon[41182]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-17T11:58:51.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:51 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-17T11:58:51.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:51 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-17T11:58:51.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:51 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-17T11:58:51.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:51 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-17T11:58:51.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:51 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-17T11:58:51.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:51 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-17T11:58:52.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:52 smithi100 ceph-mon[41266]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-17T11:58:52.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:52 smithi100 ceph-mon[41266]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-17T11:58:52.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:52 smithi100 ceph-mon[41266]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-17T11:58:52.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:52 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-17T11:58:52.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:52 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-17T11:58:52.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:52 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-17T11:58:52.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:52 smithi100 ceph-mon[41266]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 318 KiB/s wr, 19 op/s 2023-12-17T11:58:52.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:52 smithi100 ceph-mon[41266]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-17T11:58:52.945 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:52 smithi008 ceph-mon[36830]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-17T11:58:52.945 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:52 smithi008 ceph-mon[36830]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-17T11:58:52.945 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:52 smithi008 ceph-mon[36830]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-17T11:58:52.945 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:52 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-17T11:58:52.945 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:52 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-17T11:58:52.946 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:52 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-17T11:58:52.946 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:52 smithi008 ceph-mon[36830]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 318 KiB/s wr, 19 op/s 2023-12-17T11:58:52.946 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:52 smithi008 ceph-mon[36830]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-17T11:58:52.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:52 smithi186 ceph-mon[41182]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-17T11:58:52.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:52 smithi186 ceph-mon[41182]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-17T11:58:52.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:52 smithi186 ceph-mon[41182]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-12-17T11:58:52.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:52 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-12-17T11:58:52.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:52 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-12-17T11:58:52.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:52 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-12-17T11:58:52.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:52 smithi186 ceph-mon[41182]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 5.5 KiB/s rd, 318 KiB/s wr, 19 op/s 2023-12-17T11:58:52.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:52 smithi186 ceph-mon[41182]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-12-17T11:58:53.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:53 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-17T11:58:53.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:53 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:53.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:53 smithi100 ceph-mon[41266]: Deploying daemon osd.3 on smithi008 2023-12-17T11:58:53.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:53 smithi100 ceph-mon[41266]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 226 KiB/s wr, 14 op/s 2023-12-17T11:58:53.956 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:53 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-17T11:58:53.957 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:53 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:53.957 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:53 smithi008 ceph-mon[36830]: Deploying daemon osd.3 on smithi008 2023-12-17T11:58:53.957 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:53 smithi008 ceph-mon[36830]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 226 KiB/s wr, 14 op/s 2023-12-17T11:58:53.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:53 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-12-17T11:58:53.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:53 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:58:53.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:53 smithi186 ceph-mon[41182]: Deploying daemon osd.3 on smithi008 2023-12-17T11:58:53.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:53 smithi186 ceph-mon[41182]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.9 KiB/s rd, 226 KiB/s wr, 14 op/s 2023-12-17T11:58:56.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:55 smithi100 ceph-mon[41266]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 176 KiB/s wr, 10 op/s 2023-12-17T11:58:56.175 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:55 smithi008 ceph-mon[36830]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 176 KiB/s wr, 10 op/s 2023-12-17T11:58:56.225 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:55 smithi186 ceph-mon[41182]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 176 KiB/s wr, 10 op/s 2023-12-17T11:58:58.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:58 smithi186 ceph-mon[41182]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 167 KiB/s wr, 11 op/s 2023-12-17T11:58:58.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:58 smithi008 ceph-mon[36830]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 167 KiB/s wr, 11 op/s 2023-12-17T11:58:58.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:58 smithi100 ceph-mon[41266]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.3 KiB/s rd, 167 KiB/s wr, 11 op/s 2023-12-17T11:58:59.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:59 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:59.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:59 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:59.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:59 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:58:59.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:58:59 smithi008 ceph-mon[36830]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 152 KiB/s wr, 10 op/s 2023-12-17T11:58:59.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:59 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:59.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:59 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:59.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:59 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:58:59.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:58:59 smithi100 ceph-mon[41266]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 152 KiB/s wr, 10 op/s 2023-12-17T11:58:59.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:59 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:59.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:59 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:58:59.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:59 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:58:59.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:58:59 smithi186 ceph-mon[41182]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 152 KiB/s wr, 10 op/s 2023-12-17T11:59:01.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:01.778+0000 7f4da6ffd700 1 -- 172.21.15.8:0/2616870445 <== mgr.14154 v2:172.21.15.8:6800/268548699 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f4db0061a10 con 0x7f4d9c0a13f0 2023-12-17T11:59:01.781 INFO:teuthology.orchestra.run.smithi008.stdout:Created osd(s) 3 on host 'smithi008' 2023-12-17T11:59:01.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:01.781+0000 7f4db7dab700 1 -- 172.21.15.8:0/2616870445 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4d9c0a13f0 msgr2=0x7f4d9c0a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:01.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:01.781+0000 7f4db7dab700 1 --2- 172.21.15.8:0/2616870445 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4d9c0a13f0 0x7f4d9c0a38b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4db00759e0 tx=0x7f4dac009260 comp rx=0 tx=0).stop 2023-12-17T11:59:01.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:01.781+0000 7f4db7dab700 1 -- 172.21.15.8:0/2616870445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4db0075600 msgr2=0x7f4db0199d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:01.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:01.781+0000 7f4db7dab700 1 --2- 172.21.15.8:0/2616870445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4db0075600 0x7f4db0199d00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4da000e9a0 tx=0x7f4da000ecb0 comp rx=0 tx=0).stop 2023-12-17T11:59:01.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:01.781+0000 7f4db7dab700 1 -- 172.21.15.8:0/2616870445 shutdown_connections 2023-12-17T11:59:01.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:01.781+0000 7f4db7dab700 1 --2- 172.21.15.8:0/2616870445 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4d9c0a13f0 0x7f4d9c0a38b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:01.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:01.781+0000 7f4db7dab700 1 --2- 172.21.15.8:0/2616870445 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4db01094f0 0x7f4db01a0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:01.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:01.781+0000 7f4db7dab700 1 --2- 172.21.15.8:0/2616870445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4db0074030 0x7f4db01997c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:01.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:01.781+0000 7f4db7dab700 1 --2- 172.21.15.8:0/2616870445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4db0075600 0x7f4db0199d00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:01.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:01.781+0000 7f4db7dab700 1 -- 172.21.15.8:0/2616870445 >> 172.21.15.8:0/2616870445 conn(0x7f4db00fcbe0 msgr2=0x7f4db01053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:59:01.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:01.782+0000 7f4db7dab700 1 -- 172.21.15.8:0/2616870445 shutdown_connections 2023-12-17T11:59:01.784 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:01.782+0000 7f4db7dab700 1 -- 172.21.15.8:0/2616870445 wait complete. 2023-12-17T11:59:01.812 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:01 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:01.812 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:01 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:01.812 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:01 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:59:01.812 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:01 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:59:01.812 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:01 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:01.813 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:01 smithi008 ceph-mon[36830]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 152 KiB/s wr, 10 op/s 2023-12-17T11:59:01.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:01 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:01.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:01 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:01.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:01 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:59:01.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:01 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:59:01.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:01 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:01.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:01 smithi100 ceph-mon[41266]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 152 KiB/s wr, 10 op/s 2023-12-17T11:59:01.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:01 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:01.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:01 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:01.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:01 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:59:01.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:01 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:59:01.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:01 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:01.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:01 smithi186 ceph-mon[41182]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 152 KiB/s wr, 10 op/s 2023-12-17T11:59:02.217 DEBUG:teuthology.orchestra.run.smithi008:osd.3> sudo journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.3.service 2023-12-17T11:59:02.222 INFO:tasks.cephadm:Deploying osd.4 on smithi100 with /dev/vg_nvme/lv_3... 2023-12-17T11:59:02.222 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-17T11:59:02.329 INFO:journalctl@ceph.osd.3.smithi008.stdout:-- Logs begin at Sun 2023-12-17 11:40:41 UTC. -- 2023-12-17T11:59:02.648 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.b/config 2023-12-17T11:59:02.745 INFO:journalctl@ceph.osd.3.smithi008.stdout:Dec 17 11:59:02 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-3[62943]: 2023-12-17T11:59:02.616+0000 7ff806be3640 -1 osd.3 0 log_to_monitors true 2023-12-17T11:59:03.107 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:02 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:03.107 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:02 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:03.107 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:02 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:59:03.107 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:02 smithi100 ceph-mon[41266]: from='osd.3 [v2:172.21.15.8:6810/1141622701,v1:172.21.15.8:6811/1141622701]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-17T11:59:03.225 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:02 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:03.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:02 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:03.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:02 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:59:03.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:02 smithi186 ceph-mon[41182]: from='osd.3 [v2:172.21.15.8:6810/1141622701,v1:172.21.15.8:6811/1141622701]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-17T11:59:03.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:02 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:03.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:02 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:03.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:02 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:59:03.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:02 smithi008 ceph-mon[36830]: from='osd.3 [v2:172.21.15.8:6810/1141622701,v1:172.21.15.8:6811/1141622701]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-12-17T11:59:03.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:03 smithi100 ceph-mon[41266]: from='osd.3 [v2:172.21.15.8:6810/1141622701,v1:172.21.15.8:6811/1141622701]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-17T11:59:03.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:03 smithi100 ceph-mon[41266]: osdmap e23: 4 total, 3 up, 4 in 2023-12-17T11:59:03.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:03 smithi100 ceph-mon[41266]: from='osd.3 [v2:172.21.15.8:6810/1141622701,v1:172.21.15.8:6811/1141622701]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-12-17T11:59:03.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:03 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-17T11:59:03.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:03 smithi100 ceph-mon[41266]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2023-12-17T11:59:04.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:03 smithi186 ceph-mon[41182]: from='osd.3 [v2:172.21.15.8:6810/1141622701,v1:172.21.15.8:6811/1141622701]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-17T11:59:04.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:03 smithi186 ceph-mon[41182]: osdmap e23: 4 total, 3 up, 4 in 2023-12-17T11:59:04.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:03 smithi186 ceph-mon[41182]: from='osd.3 [v2:172.21.15.8:6810/1141622701,v1:172.21.15.8:6811/1141622701]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-12-17T11:59:04.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:03 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-17T11:59:04.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:03 smithi186 ceph-mon[41182]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2023-12-17T11:59:04.246 INFO:journalctl@ceph.osd.3.smithi008.stdout:Dec 17 11:59:03 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-3[62943]: 2023-12-17T11:59:03.787+0000 7ff7fc25a700 -1 osd.3 0 waiting for initial osdmap 2023-12-17T11:59:04.246 INFO:journalctl@ceph.osd.3.smithi008.stdout:Dec 17 11:59:03 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-3[62943]: 2023-12-17T11:59:03.793+0000 7ff7f404c700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-17T11:59:04.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:03 smithi008 ceph-mon[36830]: from='osd.3 [v2:172.21.15.8:6810/1141622701,v1:172.21.15.8:6811/1141622701]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-12-17T11:59:04.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:03 smithi008 ceph-mon[36830]: osdmap e23: 4 total, 3 up, 4 in 2023-12-17T11:59:04.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:03 smithi008 ceph-mon[36830]: from='osd.3 [v2:172.21.15.8:6810/1141622701,v1:172.21.15.8:6811/1141622701]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-12-17T11:59:04.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:03 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-17T11:59:04.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:03 smithi008 ceph-mon[36830]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 921 B/s rd, 26 KiB/s wr, 2 op/s 2023-12-17T11:59:04.333 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-17T11:59:04.333 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-17T11:59:04.333 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 10+0 records in 2023-12-17T11:59:04.333 INFO:teuthology.orchestra.run.smithi100.stderr:10+0 records out 2023-12-17T11:59:04.333 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0368943 s, 284 MB/s 2023-12-17T11:59:04.333 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping successful for: 2023-12-17T11:59:04.746 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi100:vg_nvme/lv_3 2023-12-17T11:59:05.078 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:04 smithi008 ceph-mon[36830]: from='osd.3 [v2:172.21.15.8:6810/1141622701,v1:172.21.15.8:6811/1141622701]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-12-17T11:59:05.078 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:04 smithi008 ceph-mon[36830]: osdmap e24: 4 total, 3 up, 4 in 2023-12-17T11:59:05.078 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:04 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-17T11:59:05.078 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:04 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-17T11:59:05.149 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.b/config 2023-12-17T11:59:05.165 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:04 smithi100 ceph-mon[41266]: from='osd.3 [v2:172.21.15.8:6810/1141622701,v1:172.21.15.8:6811/1141622701]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-12-17T11:59:05.165 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:04 smithi100 ceph-mon[41266]: osdmap e24: 4 total, 3 up, 4 in 2023-12-17T11:59:05.165 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:04 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-17T11:59:05.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:04 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-17T11:59:05.225 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:04 smithi186 ceph-mon[41182]: from='osd.3 [v2:172.21.15.8:6810/1141622701,v1:172.21.15.8:6811/1141622701]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-12-17T11:59:05.225 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:04 smithi186 ceph-mon[41182]: osdmap e24: 4 total, 3 up, 4 in 2023-12-17T11:59:05.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:04 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-17T11:59:05.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:04 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-17T11:59:05.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:05 smithi100 ceph-mon[41266]: purged_snaps scrub starts 2023-12-17T11:59:05.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:05 smithi100 ceph-mon[41266]: purged_snaps scrub ok 2023-12-17T11:59:05.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:05 smithi100 ceph-mon[41266]: osd.3 [v2:172.21.15.8:6810/1141622701,v1:172.21.15.8:6811/1141622701] boot 2023-12-17T11:59:05.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:05 smithi100 ceph-mon[41266]: osdmap e25: 4 total, 4 up, 4 in 2023-12-17T11:59:05.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:05 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-17T11:59:05.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:05 smithi100 ceph-mon[41266]: osdmap e26: 4 total, 4 up, 4 in 2023-12-17T11:59:05.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:05 smithi100 ceph-mon[41266]: Detected new or changed devices on smithi008 2023-12-17T11:59:05.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:05 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:05.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:05 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:05.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:05 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:59:05.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:05 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:59:05.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:05 smithi100 ceph-mon[41266]: Adjusting osd_memory_target on smithi008 to 8638M 2023-12-17T11:59:05.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:05 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:05.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:05 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:59:05.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:05 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:59:05.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:05 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:05.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:05 smithi100 ceph-mon[41266]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-17T11:59:06.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:05 smithi186 ceph-mon[41182]: purged_snaps scrub starts 2023-12-17T11:59:06.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:05 smithi186 ceph-mon[41182]: purged_snaps scrub ok 2023-12-17T11:59:06.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:05 smithi186 ceph-mon[41182]: osd.3 [v2:172.21.15.8:6810/1141622701,v1:172.21.15.8:6811/1141622701] boot 2023-12-17T11:59:06.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:05 smithi186 ceph-mon[41182]: osdmap e25: 4 total, 4 up, 4 in 2023-12-17T11:59:06.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:05 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-17T11:59:06.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:05 smithi186 ceph-mon[41182]: osdmap e26: 4 total, 4 up, 4 in 2023-12-17T11:59:06.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:05 smithi186 ceph-mon[41182]: Detected new or changed devices on smithi008 2023-12-17T11:59:06.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:05 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:06.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:05 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:06.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:05 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:59:06.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:05 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:59:06.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:05 smithi186 ceph-mon[41182]: Adjusting osd_memory_target on smithi008 to 8638M 2023-12-17T11:59:06.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:05 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:06.227 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:05 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:59:06.227 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:05 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:59:06.227 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:05 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:06.227 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:05 smithi186 ceph-mon[41182]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-17T11:59:06.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:05 smithi008 ceph-mon[36830]: purged_snaps scrub starts 2023-12-17T11:59:06.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:05 smithi008 ceph-mon[36830]: purged_snaps scrub ok 2023-12-17T11:59:06.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:05 smithi008 ceph-mon[36830]: osd.3 [v2:172.21.15.8:6810/1141622701,v1:172.21.15.8:6811/1141622701] boot 2023-12-17T11:59:06.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:05 smithi008 ceph-mon[36830]: osdmap e25: 4 total, 4 up, 4 in 2023-12-17T11:59:06.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:05 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-12-17T11:59:06.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:05 smithi008 ceph-mon[36830]: osdmap e26: 4 total, 4 up, 4 in 2023-12-17T11:59:06.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:05 smithi008 ceph-mon[36830]: Detected new or changed devices on smithi008 2023-12-17T11:59:06.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:05 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:06.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:05 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:06.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:05 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:59:06.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:05 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:59:06.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:05 smithi008 ceph-mon[36830]: Adjusting osd_memory_target on smithi008 to 8638M 2023-12-17T11:59:06.247 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:05 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:06.247 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:05 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:59:06.247 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:05 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:59:06.247 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:05 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:06.247 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:05 smithi008 ceph-mon[36830]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-17T11:59:06.300 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.297+0000 7f141bd53700 1 -- 172.21.15.100:0/3751737652 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14141031c0 msgr2=0x7f1414109a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:06.300 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.297+0000 7f141bd53700 1 --2- 172.21.15.100:0/3751737652 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14141031c0 0x7f1414109a70 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f140c00b0d0 tx=0x7f140c00b3e0 comp rx=0 tx=0).stop 2023-12-17T11:59:06.300 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.297+0000 7f141bd53700 1 -- 172.21.15.100:0/3751737652 shutdown_connections 2023-12-17T11:59:06.300 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.297+0000 7f141bd53700 1 --2- 172.21.15.100:0/3751737652 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14141031c0 0x7f1414109a70 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:06.300 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.297+0000 7f141bd53700 1 --2- 172.21.15.100:0/3751737652 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1414101620 0x7f1414101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:06.300 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.297+0000 7f141bd53700 1 --2- 172.21.15.100:0/3751737652 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1414102820 0x7f1414102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:06.300 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.297+0000 7f141bd53700 1 -- 172.21.15.100:0/3751737652 >> 172.21.15.100:0/3751737652 conn(0x7f14140fcbe0 msgr2=0x7f14140ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:59:06.300 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.297+0000 7f141bd53700 1 -- 172.21.15.100:0/3751737652 shutdown_connections 2023-12-17T11:59:06.300 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.297+0000 7f141bd53700 1 -- 172.21.15.100:0/3751737652 wait complete. 2023-12-17T11:59:06.302 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.298+0000 7f141bd53700 1 Processor -- start 2023-12-17T11:59:06.302 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.298+0000 7f141bd53700 1 -- start start 2023-12-17T11:59:06.302 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.298+0000 7f141bd53700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1414101620 0x7f1414199790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:59:06.302 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.298+0000 7f141bd53700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1414102820 0x7f1414199cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:59:06.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.298+0000 7f141bd53700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14141031c0 0x7f14141a0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:59:06.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.298+0000 7f141bd53700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14141a1280 con 0x7f1414101620 2023-12-17T11:59:06.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.298+0000 7f141bd53700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14141a13c0 con 0x7f14141031c0 2023-12-17T11:59:06.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.299+0000 7f141bd53700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14141a1550 con 0x7f1414102820 2023-12-17T11:59:06.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.299+0000 7f141a2f0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14141031c0 0x7f14141a0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:59:06.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.299+0000 7f141a2f0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14141031c0 0x7f14141a0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:52242/0 (socket says 172.21.15.100:52242) 2023-12-17T11:59:06.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.299+0000 7f141a2f0700 1 -- 172.21.15.100:0/40885736 learned_addr learned my addr 172.21.15.100:0/40885736 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-17T11:59:06.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.299+0000 7f14192ee700 1 --2- 172.21.15.100:0/40885736 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1414102820 0x7f1414199cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:59:06.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.299+0000 7f1419aef700 1 --2- 172.21.15.100:0/40885736 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1414101620 0x7f1414199790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:59:06.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.299+0000 7f141a2f0700 1 -- 172.21.15.100:0/40885736 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1414102820 msgr2=0x7f1414199cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:06.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.299+0000 7f141a2f0700 1 --2- 172.21.15.100:0/40885736 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1414102820 0x7f1414199cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:06.303 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.299+0000 7f141a2f0700 1 -- 172.21.15.100:0/40885736 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1414101620 msgr2=0x7f1414199790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:06.304 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.299+0000 7f141a2f0700 1 --2- 172.21.15.100:0/40885736 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1414101620 0x7f1414199790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:06.304 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.299+0000 7f141a2f0700 1 -- 172.21.15.100:0/40885736 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f140c009d00 con 0x7f14141031c0 2023-12-17T11:59:06.304 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.299+0000 7f141a2f0700 1 --2- 172.21.15.100:0/40885736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14141031c0 0x7f14141a0cb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f140c007af0 tx=0x7f140c007850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:59:06.304 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.300+0000 7f140affd700 1 -- 172.21.15.100:0/40885736 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c00e040 con 0x7f14141031c0 2023-12-17T11:59:06.304 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.300+0000 7f140affd700 1 -- 172.21.15.100:0/40885736 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f140c01db00 con 0x7f14141031c0 2023-12-17T11:59:06.304 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.300+0000 7f141bd53700 1 -- 172.21.15.100:0/40885736 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14141a17d0 con 0x7f14141031c0 2023-12-17T11:59:06.304 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.300+0000 7f140affd700 1 -- 172.21.15.100:0/40885736 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f140c01ba00 con 0x7f14141031c0 2023-12-17T11:59:06.304 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.300+0000 7f141bd53700 1 -- 172.21.15.100:0/40885736 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14141a1c90 con 0x7f14141031c0 2023-12-17T11:59:06.304 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.301+0000 7f141bd53700 1 -- 172.21.15.100:0/40885736 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f141404f290 con 0x7f14141031c0 2023-12-17T11:59:06.305 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.303+0000 7f140affd700 1 -- 172.21.15.100:0/40885736 <== mon.2 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7f140c01dc70 con 0x7f14141031c0 2023-12-17T11:59:06.307 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.304+0000 7f140affd700 1 --2- 172.21.15.100:0/40885736 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f14000a1500 0x7f14000a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:59:06.307 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.304+0000 7f140affd700 1 -- 172.21.15.100:0/40885736 <== mon.2 v2:172.21.15.100:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 3698+0+0 (secure 0 0 0) 0x7f140c0cd4a0 con 0x7f14141031c0 2023-12-17T11:59:06.307 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.305+0000 7f1419aef700 1 --2- 172.21.15.100:0/40885736 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f14000a1500 0x7f14000a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:59:06.307 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.305+0000 7f1419aef700 1 --2- 172.21.15.100:0/40885736 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f14000a1500 0x7f14000a39c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1410005950 tx=0x7f14100058e0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:59:06.310 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.308+0000 7f140affd700 1 -- 172.21.15.100:0/40885736 <== mon.2 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f140c097cf0 con 0x7f14141031c0 2023-12-17T11:59:06.516 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:06.513+0000 7f141bd53700 1 -- 172.21.15.100:0/40885736 --> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f1414109710 con 0x7f14000a1500 2023-12-17T11:59:07.184 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:06 smithi100 ceph-mon[41266]: osdmap e27: 4 total, 4 up, 4 in 2023-12-17T11:59:07.184 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:06 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T11:59:07.184 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:06 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T11:59:07.184 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:06 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:59:07.225 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:06 smithi186 ceph-mon[41182]: osdmap e27: 4 total, 4 up, 4 in 2023-12-17T11:59:07.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:06 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T11:59:07.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:06 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T11:59:07.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:06 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:59:07.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:06 smithi008 ceph-mon[36830]: osdmap e27: 4 total, 4 up, 4 in 2023-12-17T11:59:07.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:06 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T11:59:07.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:06 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T11:59:07.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:06 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:59:08.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:08 smithi186 ceph-mon[41182]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:59:08.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:08 smithi186 ceph-mon[41182]: osdmap e28: 4 total, 4 up, 4 in 2023-12-17T11:59:08.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:08 smithi186 ceph-mon[41182]: pgmap v98: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2023-12-17T11:59:08.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:08 smithi008 ceph-mon[36830]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:59:08.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:08 smithi008 ceph-mon[36830]: osdmap e28: 4 total, 4 up, 4 in 2023-12-17T11:59:08.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:08 smithi008 ceph-mon[36830]: pgmap v98: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2023-12-17T11:59:08.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:08 smithi100 ceph-mon[41266]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:59:08.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:08 smithi100 ceph-mon[41266]: osdmap e28: 4 total, 4 up, 4 in 2023-12-17T11:59:08.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:08 smithi100 ceph-mon[41266]: pgmap v98: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2023-12-17T11:59:09.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:09 smithi186 ceph-mon[41182]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-12-17T11:59:09.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:09 smithi186 ceph-mon[41182]: osdmap e29: 4 total, 4 up, 4 in 2023-12-17T11:59:09.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:09 smithi186 ceph-mon[41182]: from='client.? 172.21.15.100:0/2588768082' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ecc3a01-f19a-40a7-93a2-8870116afe6f"}]: dispatch 2023-12-17T11:59:09.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:09 smithi186 ceph-mon[41182]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ecc3a01-f19a-40a7-93a2-8870116afe6f"}]: dispatch 2023-12-17T11:59:09.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:09 smithi186 ceph-mon[41182]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ecc3a01-f19a-40a7-93a2-8870116afe6f"}]': finished 2023-12-17T11:59:09.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:09 smithi186 ceph-mon[41182]: osdmap e30: 5 total, 4 up, 5 in 2023-12-17T11:59:09.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:09 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-17T11:59:09.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:09 smithi008 ceph-mon[36830]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-12-17T11:59:09.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:09 smithi008 ceph-mon[36830]: osdmap e29: 4 total, 4 up, 4 in 2023-12-17T11:59:09.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:09 smithi008 ceph-mon[36830]: from='client.? 172.21.15.100:0/2588768082' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ecc3a01-f19a-40a7-93a2-8870116afe6f"}]: dispatch 2023-12-17T11:59:09.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:09 smithi008 ceph-mon[36830]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ecc3a01-f19a-40a7-93a2-8870116afe6f"}]: dispatch 2023-12-17T11:59:09.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:09 smithi008 ceph-mon[36830]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ecc3a01-f19a-40a7-93a2-8870116afe6f"}]': finished 2023-12-17T11:59:09.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:09 smithi008 ceph-mon[36830]: osdmap e30: 5 total, 4 up, 5 in 2023-12-17T11:59:09.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:09 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-17T11:59:09.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:09 smithi100 ceph-mon[41266]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2023-12-17T11:59:09.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:09 smithi100 ceph-mon[41266]: osdmap e29: 4 total, 4 up, 4 in 2023-12-17T11:59:09.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:09 smithi100 ceph-mon[41266]: from='client.? 172.21.15.100:0/2588768082' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ecc3a01-f19a-40a7-93a2-8870116afe6f"}]: dispatch 2023-12-17T11:59:09.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:09 smithi100 ceph-mon[41266]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ecc3a01-f19a-40a7-93a2-8870116afe6f"}]: dispatch 2023-12-17T11:59:09.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:09 smithi100 ceph-mon[41266]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ecc3a01-f19a-40a7-93a2-8870116afe6f"}]': finished 2023-12-17T11:59:09.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:09 smithi100 ceph-mon[41266]: osdmap e30: 5 total, 4 up, 5 in 2023-12-17T11:59:09.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:09 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-17T11:59:10.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:10 smithi186 ceph-mon[41182]: pgmap v101: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2023-12-17T11:59:10.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:10 smithi186 ceph-mon[41182]: from='client.? 172.21.15.100:0/2484896598' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T11:59:10.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:10 smithi008 ceph-mon[36830]: pgmap v101: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2023-12-17T11:59:10.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:10 smithi008 ceph-mon[36830]: from='client.? 172.21.15.100:0/2484896598' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T11:59:10.665 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:10 smithi100 ceph-mon[41266]: pgmap v101: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2023-12-17T11:59:10.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:10 smithi100 ceph-mon[41266]: from='client.? 172.21.15.100:0/2484896598' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T11:59:11.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:11 smithi100 ceph-mon[41266]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2023-12-17T11:59:11.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:11 smithi100 ceph-mon[41266]: Cluster is now healthy 2023-12-17T11:59:11.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:11 smithi186 ceph-mon[41182]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2023-12-17T11:59:11.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:11 smithi186 ceph-mon[41182]: Cluster is now healthy 2023-12-17T11:59:11.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:11 smithi008 ceph-mon[36830]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2023-12-17T11:59:11.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:11 smithi008 ceph-mon[36830]: Cluster is now healthy 2023-12-17T11:59:12.819 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:12 smithi100 ceph-mon[41266]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 105 KiB/s, 0 objects/s recovering 2023-12-17T11:59:12.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:12 smithi186 ceph-mon[41182]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 105 KiB/s, 0 objects/s recovering 2023-12-17T11:59:12.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:12 smithi008 ceph-mon[36830]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 105 KiB/s, 0 objects/s recovering 2023-12-17T11:59:14.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:14 smithi100 ceph-mon[41266]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 93 KiB/s, 0 objects/s recovering 2023-12-17T11:59:14.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:14 smithi186 ceph-mon[41182]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 93 KiB/s, 0 objects/s recovering 2023-12-17T11:59:14.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:14 smithi008 ceph-mon[36830]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 93 KiB/s, 0 objects/s recovering 2023-12-17T11:59:16.225 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:15 smithi186 ceph-mon[41182]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-12-17T11:59:16.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:15 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-17T11:59:16.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:15 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:59:16.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:15 smithi186 ceph-mon[41182]: Deploying daemon osd.4 on smithi100 2023-12-17T11:59:16.232 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:15 smithi100 ceph-mon[41266]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-12-17T11:59:16.232 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:15 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-17T11:59:16.232 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:15 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:59:16.232 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:15 smithi100 ceph-mon[41266]: Deploying daemon osd.4 on smithi100 2023-12-17T11:59:16.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:15 smithi008 ceph-mon[36830]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-12-17T11:59:16.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:15 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-12-17T11:59:16.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:15 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:59:16.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:15 smithi008 ceph-mon[36830]: Deploying daemon osd.4 on smithi100 2023-12-17T11:59:18.486 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:18 smithi100 ceph-mon[41266]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2023-12-17T11:59:18.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:18 smithi186 ceph-mon[41182]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2023-12-17T11:59:18.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:18 smithi008 ceph-mon[36830]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 63 KiB/s, 0 objects/s recovering 2023-12-17T11:59:20.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:20 smithi186 ceph-mon[41182]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 55 KiB/s, 0 objects/s recovering 2023-12-17T11:59:20.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:20 smithi008 ceph-mon[36830]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 55 KiB/s, 0 objects/s recovering 2023-12-17T11:59:20.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:20 smithi100 ceph-mon[41266]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 55 KiB/s, 0 objects/s recovering 2023-12-17T11:59:21.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:21 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:21.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:21 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:21.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:21 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:59:21.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:21 smithi100 ceph-mon[41266]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-12-17T11:59:21.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:21 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:21.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:21 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:21.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:21 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:59:21.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:21 smithi186 ceph-mon[41182]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-12-17T11:59:21.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:21 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:21.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:21 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:21.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:21 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:59:21.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:21 smithi008 ceph-mon[36830]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-12-17T11:59:23.346 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:23 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:23.347 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:23 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:23.347 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:23 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:59:23.347 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:23 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:59:23.347 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:23 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:23.435 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:23.433+0000 7f140affd700 1 -- 172.21.15.100:0/40885736 <== mgr.14154 v2:172.21.15.8:6800/268548699 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f1414109710 con 0x7f14000a1500 2023-12-17T11:59:23.435 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 4 on host 'smithi100' 2023-12-17T11:59:23.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:23.436+0000 7f141bd53700 1 -- 172.21.15.100:0/40885736 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f14000a1500 msgr2=0x7f14000a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:23.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:23.436+0000 7f141bd53700 1 --2- 172.21.15.100:0/40885736 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f14000a1500 0x7f14000a39c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1410005950 tx=0x7f14100058e0 comp rx=0 tx=0).stop 2023-12-17T11:59:23.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:23.436+0000 7f141bd53700 1 -- 172.21.15.100:0/40885736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14141031c0 msgr2=0x7f14141a0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:23.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:23.436+0000 7f141bd53700 1 --2- 172.21.15.100:0/40885736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14141031c0 0x7f14141a0cb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f140c007af0 tx=0x7f140c007850 comp rx=0 tx=0).stop 2023-12-17T11:59:23.438 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:23.436+0000 7f141bd53700 1 -- 172.21.15.100:0/40885736 shutdown_connections 2023-12-17T11:59:23.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:23.436+0000 7f141bd53700 1 --2- 172.21.15.100:0/40885736 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f14000a1500 0x7f14000a39c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:23.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:23.436+0000 7f141bd53700 1 --2- 172.21.15.100:0/40885736 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f14141031c0 0x7f14141a0cb0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:23.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:23.436+0000 7f141bd53700 1 --2- 172.21.15.100:0/40885736 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1414101620 0x7f1414199790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:23.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:23.436+0000 7f141bd53700 1 --2- 172.21.15.100:0/40885736 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1414102820 0x7f1414199cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:23.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:23.436+0000 7f141bd53700 1 -- 172.21.15.100:0/40885736 >> 172.21.15.100:0/40885736 conn(0x7f14140fcbe0 msgr2=0x7f1414107ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:59:23.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:23.436+0000 7f141bd53700 1 -- 172.21.15.100:0/40885736 shutdown_connections 2023-12-17T11:59:23.439 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T11:59:23.436+0000 7f141bd53700 1 -- 172.21.15.100:0/40885736 wait complete. 2023-12-17T11:59:23.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:23 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:23.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:23 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:23.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:23 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:59:23.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:23 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:59:23.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:23 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:23.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:23 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:23.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:23 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:23.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:23 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:59:23.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:23 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:59:23.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:23 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:23.833 DEBUG:teuthology.orchestra.run.smithi100:osd.4> sudo journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.4.service 2023-12-17T11:59:23.838 INFO:tasks.cephadm:Deploying osd.5 on smithi186 with /dev/vg_nvme/lv_3... 2023-12-17T11:59:23.839 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-12-17T11:59:23.916 INFO:journalctl@ceph.osd.4.smithi100.stdout:-- Logs begin at Sun 2023-12-17 11:35:53 UTC. -- 2023-12-17T11:59:24.266 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.c/config 2023-12-17T11:59:24.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:24 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:59:24.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:24 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:24.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:24 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:24.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:24 smithi186 ceph-mon[41182]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-17T11:59:24.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:24 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:59:24.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:24 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:24.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:24 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:24.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:24 smithi008 ceph-mon[36830]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-17T11:59:24.539 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:24 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:59:24.539 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:24 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:24.539 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:24 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:24.539 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:24 smithi100 ceph-mon[41266]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-17T11:59:24.856 INFO:journalctl@ceph.osd.4.smithi100.stdout:Dec 17 11:59:24 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-4[54306]: 2023-12-17T11:59:24.535+0000 7f9690901640 -1 osd.4 0 log_to_monitors true 2023-12-17T11:59:25.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:25 smithi100 ceph-mon[41266]: from='osd.4 [v2:172.21.15.100:6808/1902152516,v1:172.21.15.100:6809/1902152516]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-17T11:59:25.667 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:25 smithi100 ceph-mon[41266]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-17T11:59:25.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:25 smithi186 ceph-mon[41182]: from='osd.4 [v2:172.21.15.100:6808/1902152516,v1:172.21.15.100:6809/1902152516]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-17T11:59:25.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:25 smithi186 ceph-mon[41182]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-17T11:59:25.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:25 smithi008 ceph-mon[36830]: from='osd.4 [v2:172.21.15.100:6808/1902152516,v1:172.21.15.100:6809/1902152516]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-17T11:59:25.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:25 smithi008 ceph-mon[36830]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-12-17T11:59:26.111 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-12-17T11:59:26.111 INFO:teuthology.orchestra.run.smithi186.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-12-17T11:59:26.111 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10+0 records in 2023-12-17T11:59:26.111 INFO:teuthology.orchestra.run.smithi186.stderr:10+0 records out 2023-12-17T11:59:26.111 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0426885 s, 246 MB/s 2023-12-17T11:59:26.111 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping successful for: 2023-12-17T11:59:26.528 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi186:vg_nvme/lv_3 2023-12-17T11:59:26.579 INFO:journalctl@ceph.osd.4.smithi100.stdout:Dec 17 11:59:26 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-4[54306]: 2023-12-17T11:59:26.437+0000 7f9685f78700 -1 osd.4 0 waiting for initial osdmap 2023-12-17T11:59:26.579 INFO:journalctl@ceph.osd.4.smithi100.stdout:Dec 17 11:59:26 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-4[54306]: 2023-12-17T11:59:26.444+0000 7f9680d70700 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-17T11:59:26.579 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:26 smithi100 ceph-mon[41266]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-17T11:59:26.579 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:26 smithi100 ceph-mon[41266]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-17T11:59:26.579 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:26 smithi100 ceph-mon[41266]: osdmap e31: 5 total, 4 up, 5 in 2023-12-17T11:59:26.579 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:26 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-17T11:59:26.580 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:26 smithi100 ceph-mon[41266]: from='osd.4 [v2:172.21.15.100:6808/1902152516,v1:172.21.15.100:6809/1902152516]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2023-12-17T11:59:26.580 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:26 smithi100 ceph-mon[41266]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2023-12-17T11:59:26.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:26 smithi186 ceph-mon[41182]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-17T11:59:26.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:26 smithi186 ceph-mon[41182]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-17T11:59:26.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:26 smithi186 ceph-mon[41182]: osdmap e31: 5 total, 4 up, 5 in 2023-12-17T11:59:26.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:26 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-17T11:59:26.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:26 smithi186 ceph-mon[41182]: from='osd.4 [v2:172.21.15.100:6808/1902152516,v1:172.21.15.100:6809/1902152516]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2023-12-17T11:59:26.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:26 smithi186 ceph-mon[41182]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2023-12-17T11:59:26.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:26 smithi008 ceph-mon[36830]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-17T11:59:26.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:26 smithi008 ceph-mon[36830]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-12-17T11:59:26.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:26 smithi008 ceph-mon[36830]: osdmap e31: 5 total, 4 up, 5 in 2023-12-17T11:59:26.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:26 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-17T11:59:26.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:26 smithi008 ceph-mon[36830]: from='osd.4 [v2:172.21.15.100:6808/1902152516,v1:172.21.15.100:6809/1902152516]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2023-12-17T11:59:26.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:26 smithi008 ceph-mon[36830]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2023-12-17T11:59:26.938 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.c/config 2023-12-17T11:59:27.665 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:27 smithi186 ceph-mon[41182]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2023-12-17T11:59:27.666 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:27 smithi186 ceph-mon[41182]: osdmap e32: 5 total, 4 up, 5 in 2023-12-17T11:59:27.666 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-17T11:59:27.666 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-17T11:59:27.666 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:27.666 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:27.666 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:59:27.666 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:59:27.666 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:27.666 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:59:27.666 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:59:27.666 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:27.667 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:27 smithi100 ceph-mon[41266]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2023-12-17T11:59:27.667 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:27 smithi100 ceph-mon[41266]: osdmap e32: 5 total, 4 up, 5 in 2023-12-17T11:59:27.667 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-17T11:59:27.667 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-17T11:59:27.667 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:27.667 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:27.667 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:59:27.667 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:59:27.667 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:27.667 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:59:27.667 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:59:27.667 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:27.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:27 smithi008 ceph-mon[36830]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2023-12-17T11:59:27.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:27 smithi008 ceph-mon[36830]: osdmap e32: 5 total, 4 up, 5 in 2023-12-17T11:59:27.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-17T11:59:27.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-17T11:59:27.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:27.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:27.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:59:27.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:59:27.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:27.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:59:27.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:59:27.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:28.172 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.169+0000 7f6939de6700 1 -- 172.21.15.186:0/3754274763 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6934101620 msgr2=0x7f6934101a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:28.173 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.169+0000 7f6939de6700 1 --2- 172.21.15.186:0/3754274763 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6934101620 0x7f6934101a40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6924009990 tx=0x7f6924009ca0 comp rx=0 tx=0).stop 2023-12-17T11:59:28.173 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.169+0000 7f6939de6700 1 -- 172.21.15.186:0/3754274763 shutdown_connections 2023-12-17T11:59:28.173 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.169+0000 7f6939de6700 1 --2- 172.21.15.186:0/3754274763 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69341031c0 0x7f6934109a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:28.173 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.169+0000 7f6939de6700 1 --2- 172.21.15.186:0/3754274763 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6934101620 0x7f6934101a40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:28.173 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.169+0000 7f6939de6700 1 --2- 172.21.15.186:0/3754274763 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6934102820 0x7f6934102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:28.173 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.169+0000 7f6939de6700 1 -- 172.21.15.186:0/3754274763 >> 172.21.15.186:0/3754274763 conn(0x7f69340fcbe0 msgr2=0x7f69340ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:59:28.173 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.169+0000 7f6939de6700 1 -- 172.21.15.186:0/3754274763 shutdown_connections 2023-12-17T11:59:28.173 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.169+0000 7f6939de6700 1 -- 172.21.15.186:0/3754274763 wait complete. 2023-12-17T11:59:28.175 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.170+0000 7f6939de6700 1 Processor -- start 2023-12-17T11:59:28.175 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.171+0000 7f6939de6700 1 -- start start 2023-12-17T11:59:28.175 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.171+0000 7f6939de6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6934101620 0x7f69340752d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:59:28.175 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.171+0000 7f6939de6700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6934102820 0x7f69340739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:59:28.175 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.171+0000 7f6939de6700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69341031c0 0x7f6934073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:59:28.175 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.171+0000 7f6939de6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69340745e0 con 0x7f6934101620 2023-12-17T11:59:28.175 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.171+0000 7f6939de6700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6934074750 con 0x7f6934102820 2023-12-17T11:59:28.175 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.171+0000 7f6939de6700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69341a15a0 con 0x7f69341031c0 2023-12-17T11:59:28.175 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.171+0000 7f69337fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6934101620 0x7f69340752d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:59:28.175 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.171+0000 7f6933fff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69341031c0 0x7f6934073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:59:28.176 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.171+0000 7f69337fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6934101620 0x7f69340752d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.186:60698/0 (socket says 172.21.15.186:60698) 2023-12-17T11:59:28.176 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.171+0000 7f69337fe700 1 -- 172.21.15.186:0/3947146131 learned_addr learned my addr 172.21.15.186:0/3947146131 (peer_addr_for_me v2:172.21.15.186:0/0) 2023-12-17T11:59:28.176 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.171+0000 7f6932ffd700 1 --2- 172.21.15.186:0/3947146131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6934102820 0x7f69340739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:59:28.176 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.172+0000 7f69337fe700 1 -- 172.21.15.186:0/3947146131 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69341031c0 msgr2=0x7f6934073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:28.176 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.172+0000 7f69337fe700 1 --2- 172.21.15.186:0/3947146131 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69341031c0 0x7f6934073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:28.176 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.172+0000 7f69337fe700 1 -- 172.21.15.186:0/3947146131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6934102820 msgr2=0x7f69340739c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:28.176 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.172+0000 7f69337fe700 1 --2- 172.21.15.186:0/3947146131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6934102820 0x7f69340739c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:28.176 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.172+0000 7f69337fe700 1 -- 172.21.15.186:0/3947146131 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69240095f0 con 0x7f6934101620 2023-12-17T11:59:28.176 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.172+0000 7f69337fe700 1 --2- 172.21.15.186:0/3947146131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6934101620 0x7f69340752d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f692400b710 tx=0x7f692400b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:59:28.177 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.172+0000 7f6930ff9700 1 -- 172.21.15.186:0/3947146131 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692401d070 con 0x7f6934101620 2023-12-17T11:59:28.177 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.172+0000 7f6939de6700 1 -- 172.21.15.186:0/3947146131 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69341a17a0 con 0x7f6934101620 2023-12-17T11:59:28.177 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.172+0000 7f6930ff9700 1 -- 172.21.15.186:0/3947146131 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6924003d20 con 0x7f6934101620 2023-12-17T11:59:28.177 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.172+0000 7f6930ff9700 1 -- 172.21.15.186:0/3947146131 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692400fde0 con 0x7f6934101620 2023-12-17T11:59:28.177 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.172+0000 7f6939de6700 1 -- 172.21.15.186:0/3947146131 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69341a1bc0 con 0x7f6934101620 2023-12-17T11:59:28.177 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.173+0000 7f6939de6700 1 -- 172.21.15.186:0/3947146131 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6934108ba0 con 0x7f6934101620 2023-12-17T11:59:28.179 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.176+0000 7f6930ff9700 1 -- 172.21.15.186:0/3947146131 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7f692400f560 con 0x7f6934101620 2023-12-17T11:59:28.180 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.177+0000 7f6930ff9700 1 --2- 172.21.15.186:0/3947146131 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f691c0a1480 0x7f691c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:59:28.180 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.177+0000 7f6930ff9700 1 -- 172.21.15.186:0/3947146131 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4101+0+0 (secure 0 0 0) 0x7f69240cd430 con 0x7f6934101620 2023-12-17T11:59:28.180 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.177+0000 7f6932ffd700 1 --2- 172.21.15.186:0/3947146131 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f691c0a1480 0x7f691c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:59:28.181 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.178+0000 7f6932ffd700 1 --2- 172.21.15.186:0/3947146131 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f691c0a1480 0x7f691c0a3940 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6928009c60 tx=0x7f6928009260 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:59:28.183 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.180+0000 7f6930ff9700 1 -- 172.21.15.186:0/3947146131 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f6924097af0 con 0x7f6934101620 2023-12-17T11:59:28.389 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:28.386+0000 7f6939de6700 1 -- 172.21.15.186:0/3947146131 --> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f6934061a10 con 0x7f691c0a1480 2023-12-17T11:59:28.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:28 smithi186 ceph-mon[41182]: purged_snaps scrub starts 2023-12-17T11:59:28.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:28 smithi186 ceph-mon[41182]: purged_snaps scrub ok 2023-12-17T11:59:28.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:28 smithi186 ceph-mon[41182]: Detected new or changed devices on smithi100 2023-12-17T11:59:28.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:28 smithi186 ceph-mon[41182]: Adjusting osd_memory_target on smithi100 to 8635M 2023-12-17T11:59:28.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:28 smithi186 ceph-mon[41182]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-17T11:59:28.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:28 smithi186 ceph-mon[41182]: osd.4 [v2:172.21.15.100:6808/1902152516,v1:172.21.15.100:6809/1902152516] boot 2023-12-17T11:59:28.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:28 smithi186 ceph-mon[41182]: osdmap e33: 5 total, 5 up, 5 in 2023-12-17T11:59:28.727 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:28 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-17T11:59:28.727 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:28 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T11:59:28.727 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:28 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T11:59:28.727 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:28 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:59:28.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:28 smithi008 ceph-mon[36830]: purged_snaps scrub starts 2023-12-17T11:59:28.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:28 smithi008 ceph-mon[36830]: purged_snaps scrub ok 2023-12-17T11:59:28.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:28 smithi008 ceph-mon[36830]: Detected new or changed devices on smithi100 2023-12-17T11:59:28.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:28 smithi008 ceph-mon[36830]: Adjusting osd_memory_target on smithi100 to 8635M 2023-12-17T11:59:28.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:28 smithi008 ceph-mon[36830]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-17T11:59:28.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:28 smithi008 ceph-mon[36830]: osd.4 [v2:172.21.15.100:6808/1902152516,v1:172.21.15.100:6809/1902152516] boot 2023-12-17T11:59:28.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:28 smithi008 ceph-mon[36830]: osdmap e33: 5 total, 5 up, 5 in 2023-12-17T11:59:28.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:28 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-17T11:59:28.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:28 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T11:59:28.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:28 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T11:59:28.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:28 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:59:28.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:28 smithi100 ceph-mon[41266]: purged_snaps scrub starts 2023-12-17T11:59:28.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:28 smithi100 ceph-mon[41266]: purged_snaps scrub ok 2023-12-17T11:59:28.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:28 smithi100 ceph-mon[41266]: Detected new or changed devices on smithi100 2023-12-17T11:59:28.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:28 smithi100 ceph-mon[41266]: Adjusting osd_memory_target on smithi100 to 8635M 2023-12-17T11:59:28.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:28 smithi100 ceph-mon[41266]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 107 MiB used, 358 GiB / 358 GiB avail 2023-12-17T11:59:28.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:28 smithi100 ceph-mon[41266]: osd.4 [v2:172.21.15.100:6808/1902152516,v1:172.21.15.100:6809/1902152516] boot 2023-12-17T11:59:28.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:28 smithi100 ceph-mon[41266]: osdmap e33: 5 total, 5 up, 5 in 2023-12-17T11:59:28.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:28 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-12-17T11:59:28.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:28 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T11:59:28.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:28 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T11:59:28.918 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:28 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:59:29.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:29 smithi186 ceph-mon[41182]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:59:29.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:29 smithi186 ceph-mon[41182]: osdmap e34: 5 total, 5 up, 5 in 2023-12-17T11:59:29.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:29 smithi008 ceph-mon[36830]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:59:29.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:29 smithi008 ceph-mon[36830]: osdmap e34: 5 total, 5 up, 5 in 2023-12-17T11:59:29.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:29 smithi100 ceph-mon[41266]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:59:29.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:29 smithi100 ceph-mon[41266]: osdmap e34: 5 total, 5 up, 5 in 2023-12-17T11:59:30.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:30 smithi186 ceph-mon[41182]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-17T11:59:30.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:30 smithi008 ceph-mon[36830]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-17T11:59:30.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:30 smithi100 ceph-mon[41266]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-17T11:59:31.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:31 smithi186 ceph-mon[41182]: from='client.? 172.21.15.186:0/2846193676' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac057cc9-2a27-4216-a7ae-fc60d9796eea"}]: dispatch 2023-12-17T11:59:31.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:31 smithi186 ceph-mon[41182]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac057cc9-2a27-4216-a7ae-fc60d9796eea"}]: dispatch 2023-12-17T11:59:31.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:31 smithi186 ceph-mon[41182]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ac057cc9-2a27-4216-a7ae-fc60d9796eea"}]': finished 2023-12-17T11:59:31.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:31 smithi186 ceph-mon[41182]: osdmap e35: 6 total, 5 up, 6 in 2023-12-17T11:59:31.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:31 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-17T11:59:31.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:31 smithi008 ceph-mon[36830]: from='client.? 172.21.15.186:0/2846193676' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac057cc9-2a27-4216-a7ae-fc60d9796eea"}]: dispatch 2023-12-17T11:59:31.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:31 smithi008 ceph-mon[36830]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac057cc9-2a27-4216-a7ae-fc60d9796eea"}]: dispatch 2023-12-17T11:59:31.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:31 smithi008 ceph-mon[36830]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ac057cc9-2a27-4216-a7ae-fc60d9796eea"}]': finished 2023-12-17T11:59:31.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:31 smithi008 ceph-mon[36830]: osdmap e35: 6 total, 5 up, 6 in 2023-12-17T11:59:31.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:31 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-17T11:59:31.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:31 smithi100 ceph-mon[41266]: from='client.? 172.21.15.186:0/2846193676' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac057cc9-2a27-4216-a7ae-fc60d9796eea"}]: dispatch 2023-12-17T11:59:31.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:31 smithi100 ceph-mon[41266]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ac057cc9-2a27-4216-a7ae-fc60d9796eea"}]: dispatch 2023-12-17T11:59:31.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:31 smithi100 ceph-mon[41266]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ac057cc9-2a27-4216-a7ae-fc60d9796eea"}]': finished 2023-12-17T11:59:31.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:31 smithi100 ceph-mon[41266]: osdmap e35: 6 total, 5 up, 6 in 2023-12-17T11:59:31.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:31 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-17T11:59:32.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:32 smithi186 ceph-mon[41182]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-17T11:59:32.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:32 smithi186 ceph-mon[41182]: from='client.? 172.21.15.186:0/2508853475' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T11:59:32.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:32 smithi008 ceph-mon[36830]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-17T11:59:32.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:32 smithi008 ceph-mon[36830]: from='client.? 172.21.15.186:0/2508853475' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T11:59:32.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:32 smithi100 ceph-mon[41266]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-17T11:59:32.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:32 smithi100 ceph-mon[41266]: from='client.? 172.21.15.186:0/2508853475' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T11:59:34.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:34 smithi186 ceph-mon[41182]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-17T11:59:34.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:34 smithi008 ceph-mon[36830]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-17T11:59:34.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:34 smithi100 ceph-mon[41266]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-12-17T11:59:36.225 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:35 smithi186 ceph-mon[41182]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-17T11:59:36.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:35 smithi008 ceph-mon[36830]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-17T11:59:36.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:35 smithi100 ceph-mon[41266]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-17T11:59:38.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:38 smithi186 ceph-mon[41182]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-17T11:59:38.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:38 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-17T11:59:38.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:38 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:59:38.749 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:38 smithi008 ceph-mon[36830]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-17T11:59:38.750 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:38 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-17T11:59:38.750 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:38 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:59:38.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:38 smithi100 ceph-mon[41266]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-17T11:59:38.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:38 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-12-17T11:59:38.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:38 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:59:39.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:39 smithi186 ceph-mon[41182]: Deploying daemon osd.5 on smithi186 2023-12-17T11:59:39.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:39 smithi008 ceph-mon[36830]: Deploying daemon osd.5 on smithi186 2023-12-17T11:59:39.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:39 smithi100 ceph-mon[41266]: Deploying daemon osd.5 on smithi186 2023-12-17T11:59:40.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:40 smithi186 ceph-mon[41182]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-17T11:59:40.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:40 smithi008 ceph-mon[36830]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-17T11:59:40.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:40 smithi100 ceph-mon[41266]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-17T11:59:42.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:42 smithi186 ceph-mon[41182]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-17T11:59:42.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:42 smithi008 ceph-mon[36830]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-17T11:59:42.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:42 smithi100 ceph-mon[41266]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-17T11:59:44.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:44 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:44.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:44 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:44.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:44 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:59:44.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:44 smithi186 ceph-mon[41182]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-17T11:59:44.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:44 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:44.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:44 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:44.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:44 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:59:44.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:44 smithi008 ceph-mon[36830]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-17T11:59:44.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:44 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:44.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:44 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:44.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:44 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:59:44.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:44 smithi100 ceph-mon[41266]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-17T11:59:46.214 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:46.212+0000 7f6930ff9700 1 -- 172.21.15.186:0/3947146131 <== mgr.14154 v2:172.21.15.8:6800/268548699 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f6934061a10 con 0x7f691c0a1480 2023-12-17T11:59:46.214 INFO:teuthology.orchestra.run.smithi186.stdout:Created osd(s) 5 on host 'smithi186' 2023-12-17T11:59:46.217 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:46.214+0000 7f6939de6700 1 -- 172.21.15.186:0/3947146131 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f691c0a1480 msgr2=0x7f691c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:46.217 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:46.214+0000 7f6939de6700 1 --2- 172.21.15.186:0/3947146131 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f691c0a1480 0x7f691c0a3940 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6928009c60 tx=0x7f6928009260 comp rx=0 tx=0).stop 2023-12-17T11:59:46.217 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:46.214+0000 7f6939de6700 1 -- 172.21.15.186:0/3947146131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6934101620 msgr2=0x7f69340752d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:46.217 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:46.214+0000 7f6939de6700 1 --2- 172.21.15.186:0/3947146131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6934101620 0x7f69340752d0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f692400b710 tx=0x7f692400b9c0 comp rx=0 tx=0).stop 2023-12-17T11:59:46.217 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:46.214+0000 7f6939de6700 1 -- 172.21.15.186:0/3947146131 shutdown_connections 2023-12-17T11:59:46.217 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:46.214+0000 7f6939de6700 1 --2- 172.21.15.186:0/3947146131 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f691c0a1480 0x7f691c0a3940 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:46.217 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:46.214+0000 7f6939de6700 1 --2- 172.21.15.186:0/3947146131 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69341031c0 0x7f6934073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:46.217 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:46.214+0000 7f6939de6700 1 --2- 172.21.15.186:0/3947146131 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6934101620 0x7f69340752d0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:46.217 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:46.214+0000 7f6939de6700 1 --2- 172.21.15.186:0/3947146131 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6934102820 0x7f69340739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:46.217 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:46.214+0000 7f6939de6700 1 -- 172.21.15.186:0/3947146131 >> 172.21.15.186:0/3947146131 conn(0x7f69340fcbe0 msgr2=0x7f6934105ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:59:46.217 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:46.214+0000 7f6939de6700 1 -- 172.21.15.186:0/3947146131 shutdown_connections 2023-12-17T11:59:46.217 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T11:59:46.214+0000 7f6939de6700 1 -- 172.21.15.186:0/3947146131 wait complete. 2023-12-17T11:59:46.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:46 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:46.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:46 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:46.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:46 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:59:46.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:46 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:59:46.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:46 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:46.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:46 smithi100 ceph-mon[41266]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-17T11:59:46.451 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:46 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:46.451 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:46 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:46.452 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:46 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:59:46.452 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:46 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:59:46.452 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:46 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:46.452 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:46 smithi186 ceph-mon[41182]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-17T11:59:46.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:46 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:46.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:46 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:46.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:46 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:59:46.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:46 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:59:46.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:46 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:46.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:46 smithi008 ceph-mon[36830]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-17T11:59:46.654 DEBUG:teuthology.orchestra.run.smithi186:osd.5> sudo journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.5.service 2023-12-17T11:59:46.658 INFO:tasks.cephadm:Deploying osd.6 on smithi008 with /dev/vg_nvme/lv_2... 2023-12-17T11:59:46.659 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-17T11:59:46.738 INFO:journalctl@ceph.osd.5.smithi186.stdout:-- Logs begin at Sun 2023-12-17 11:40:47 UTC. -- 2023-12-17T11:59:47.086 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T11:59:47.361 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:47 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:47.361 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:47 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:47.361 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:47 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:59:47.361 INFO:journalctl@ceph.osd.5.smithi186.stdout:Dec 17 11:59:47 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-5[55448]: 2023-12-17T11:59:47.203+0000 7fbc682a8640 -1 osd.5 0 log_to_monitors true 2023-12-17T11:59:47.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:47 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:47.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:47 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:47.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:47 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:59:47.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:47 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:47.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:47 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:47.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:47 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T11:59:48.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:48 smithi186 ceph-mon[41182]: from='osd.5 [v2:172.21.15.186:6808/648349934,v1:172.21.15.186:6809/648349934]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-17T11:59:48.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:48 smithi186 ceph-mon[41182]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-17T11:59:48.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:48 smithi008 ceph-mon[36830]: from='osd.5 [v2:172.21.15.186:6808/648349934,v1:172.21.15.186:6809/648349934]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-17T11:59:48.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:48 smithi008 ceph-mon[36830]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-17T11:59:48.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:48 smithi100 ceph-mon[41266]: from='osd.5 [v2:172.21.15.186:6808/648349934,v1:172.21.15.186:6809/648349934]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-12-17T11:59:48.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:48 smithi100 ceph-mon[41266]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-17T11:59:49.088 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-17T11:59:49.088 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-17T11:59:49.088 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 10+0 records in 2023-12-17T11:59:49.088 INFO:teuthology.orchestra.run.smithi008.stderr:10+0 records out 2023-12-17T11:59:49.088 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0310937 s, 337 MB/s 2023-12-17T11:59:49.088 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping successful for: 2023-12-17T11:59:49.435 INFO:journalctl@ceph.osd.5.smithi186.stdout:Dec 17 11:59:49 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-5[55448]: 2023-12-17T11:59:49.231+0000 7fbc5d91f700 -1 osd.5 0 waiting for initial osdmap 2023-12-17T11:59:49.435 INFO:journalctl@ceph.osd.5.smithi186.stdout:Dec 17 11:59:49 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-5[55448]: 2023-12-17T11:59:49.240+0000 7fbc57f16700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-17T11:59:49.436 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:49 smithi186 ceph-mon[41182]: from='osd.5 [v2:172.21.15.186:6808/648349934,v1:172.21.15.186:6809/648349934]' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-17T11:59:49.436 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:49 smithi186 ceph-mon[41182]: osdmap e36: 6 total, 5 up, 6 in 2023-12-17T11:59:49.436 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:49 smithi186 ceph-mon[41182]: from='osd.5 [v2:172.21.15.186:6808/648349934,v1:172.21.15.186:6809/648349934]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-12-17T11:59:49.436 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:49 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-17T11:59:49.482 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:49 smithi008 ceph-mon[36830]: from='osd.5 [v2:172.21.15.186:6808/648349934,v1:172.21.15.186:6809/648349934]' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-17T11:59:49.482 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:49 smithi008 ceph-mon[36830]: osdmap e36: 6 total, 5 up, 6 in 2023-12-17T11:59:49.482 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:49 smithi008 ceph-mon[36830]: from='osd.5 [v2:172.21.15.186:6808/648349934,v1:172.21.15.186:6809/648349934]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-12-17T11:59:49.482 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:49 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-17T11:59:49.518 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi008:vg_nvme/lv_2 2023-12-17T11:59:49.665 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:49 smithi100 ceph-mon[41266]: from='osd.5 [v2:172.21.15.186:6808/648349934,v1:172.21.15.186:6809/648349934]' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-12-17T11:59:49.665 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:49 smithi100 ceph-mon[41266]: osdmap e36: 6 total, 5 up, 6 in 2023-12-17T11:59:49.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:49 smithi100 ceph-mon[41266]: from='osd.5 [v2:172.21.15.186:6808/648349934,v1:172.21.15.186:6809/648349934]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-12-17T11:59:49.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:49 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-17T11:59:49.951 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T11:59:50.438 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:50 smithi008 ceph-mon[36830]: purged_snaps scrub starts 2023-12-17T11:59:50.438 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:50 smithi008 ceph-mon[36830]: purged_snaps scrub ok 2023-12-17T11:59:50.438 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:50 smithi008 ceph-mon[36830]: from='osd.5 [v2:172.21.15.186:6808/648349934,v1:172.21.15.186:6809/648349934]' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2023-12-17T11:59:50.438 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:50 smithi008 ceph-mon[36830]: osdmap e37: 6 total, 5 up, 6 in 2023-12-17T11:59:50.438 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:50 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-17T11:59:50.438 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:50 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-17T11:59:50.438 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:50 smithi008 ceph-mon[36830]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-17T11:59:50.438 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:50 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:50.438 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:50 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:50.438 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:50 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:59:50.438 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:50 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:59:50.438 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:50 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:50.439 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:50 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:59:50.439 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:50 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:59:50.439 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:50 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:50.439 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:50 smithi008 ceph-mon[36830]: osd.5 [v2:172.21.15.186:6808/648349934,v1:172.21.15.186:6809/648349934] boot 2023-12-17T11:59:50.439 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:50 smithi008 ceph-mon[36830]: osdmap e38: 6 total, 6 up, 6 in 2023-12-17T11:59:50.439 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:50 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-17T11:59:50.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:50 smithi186 ceph-mon[41182]: purged_snaps scrub starts 2023-12-17T11:59:50.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:50 smithi186 ceph-mon[41182]: purged_snaps scrub ok 2023-12-17T11:59:50.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:50 smithi186 ceph-mon[41182]: from='osd.5 [v2:172.21.15.186:6808/648349934,v1:172.21.15.186:6809/648349934]' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2023-12-17T11:59:50.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:50 smithi186 ceph-mon[41182]: osdmap e37: 6 total, 5 up, 6 in 2023-12-17T11:59:50.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:50 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-17T11:59:50.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:50 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-17T11:59:50.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:50 smithi186 ceph-mon[41182]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-17T11:59:50.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:50 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:50.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:50 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:50.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:50 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:59:50.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:50 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:59:50.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:50 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:50.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:50 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:59:50.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:50 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:59:50.477 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:50 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:50.477 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:50 smithi186 ceph-mon[41182]: osd.5 [v2:172.21.15.186:6808/648349934,v1:172.21.15.186:6809/648349934] boot 2023-12-17T11:59:50.477 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:50 smithi186 ceph-mon[41182]: osdmap e38: 6 total, 6 up, 6 in 2023-12-17T11:59:50.477 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:50 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-17T11:59:50.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:50 smithi100 ceph-mon[41266]: purged_snaps scrub starts 2023-12-17T11:59:50.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:50 smithi100 ceph-mon[41266]: purged_snaps scrub ok 2023-12-17T11:59:50.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:50 smithi100 ceph-mon[41266]: from='osd.5 [v2:172.21.15.186:6808/648349934,v1:172.21.15.186:6809/648349934]' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2023-12-17T11:59:50.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:50 smithi100 ceph-mon[41266]: osdmap e37: 6 total, 5 up, 6 in 2023-12-17T11:59:50.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:50 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-17T11:59:50.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:50 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-17T11:59:50.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:50 smithi100 ceph-mon[41266]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 134 MiB used, 447 GiB / 447 GiB avail 2023-12-17T11:59:50.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:50 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:50.667 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:50 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:50.667 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:50 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:59:50.667 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:50 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-17T11:59:50.667 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:50 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:50.667 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:50 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:59:50.667 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:50 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T11:59:50.667 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:50 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T11:59:50.667 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:50 smithi100 ceph-mon[41266]: osd.5 [v2:172.21.15.186:6808/648349934,v1:172.21.15.186:6809/648349934] boot 2023-12-17T11:59:50.667 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:50 smithi100 ceph-mon[41266]: osdmap e38: 6 total, 6 up, 6 in 2023-12-17T11:59:50.667 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:50 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-12-17T11:59:51.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.133+0000 7f5cc0340700 1 -- 172.21.15.8:0/2053617291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5cb8101710 msgr2=0x7f5cb8101b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:51.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.133+0000 7f5cc0340700 1 --2- 172.21.15.8:0/2053617291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5cb8101710 0x7f5cb8101b70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f5ca80099c0 tx=0x7f5ca8009cd0 comp rx=0 tx=0).stop 2023-12-17T11:59:51.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.133+0000 7f5cc0340700 1 -- 172.21.15.8:0/2053617291 shutdown_connections 2023-12-17T11:59:51.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.133+0000 7f5cc0340700 1 --2- 172.21.15.8:0/2053617291 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cb81020b0 0x7f5cb8108960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:51.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.133+0000 7f5cc0340700 1 --2- 172.21.15.8:0/2053617291 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5cb8100510 0x7f5cb8100930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:51.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.133+0000 7f5cc0340700 1 --2- 172.21.15.8:0/2053617291 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5cb8101710 0x7f5cb8101b70 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:51.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.133+0000 7f5cc0340700 1 -- 172.21.15.8:0/2053617291 >> 172.21.15.8:0/2053617291 conn(0x7f5cb80fbad0 msgr2=0x7f5cb80fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T11:59:51.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.134+0000 7f5cc0340700 1 -- 172.21.15.8:0/2053617291 shutdown_connections 2023-12-17T11:59:51.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.134+0000 7f5cc0340700 1 -- 172.21.15.8:0/2053617291 wait complete. 2023-12-17T11:59:51.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.134+0000 7f5cc0340700 1 Processor -- start 2023-12-17T11:59:51.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.135+0000 7f5cc0340700 1 -- start start 2023-12-17T11:59:51.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.135+0000 7f5cc0340700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cb8100510 0x7f5cb810c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:59:51.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.135+0000 7f5cc0340700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5cb8101710 0x7f5cb810ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:59:51.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.135+0000 7f5cc0340700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5cb81020b0 0x7f5cb810b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:59:51.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.135+0000 7f5cc0340700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb810b920 con 0x7f5cb8101710 2023-12-17T11:59:51.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.135+0000 7f5cc0340700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb810ba90 con 0x7f5cb8100510 2023-12-17T11:59:51.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.135+0000 7f5cc0340700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb81a1550 con 0x7f5cb81020b0 2023-12-17T11:59:51.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.135+0000 7f5cbd8db700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5cb8101710 0x7f5cb810ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:59:51.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.135+0000 7f5cbd8db700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5cb8101710 0x7f5cb810ac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:41370/0 (socket says 172.21.15.8:41370) 2023-12-17T11:59:51.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.135+0000 7f5cbd8db700 1 -- 172.21.15.8:0/639336757 learned_addr learned my addr 172.21.15.8:0/639336757 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T11:59:51.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.135+0000 7f5cbe8dd700 1 --2- 172.21.15.8:0/639336757 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5cb81020b0 0x7f5cb810b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:59:51.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.135+0000 7f5cbe0dc700 1 --2- 172.21.15.8:0/639336757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cb8100510 0x7f5cb810c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:59:51.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.136+0000 7f5cbd8db700 1 -- 172.21.15.8:0/639336757 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5cb81020b0 msgr2=0x7f5cb810b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:51.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.136+0000 7f5cbd8db700 1 --2- 172.21.15.8:0/639336757 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5cb81020b0 0x7f5cb810b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:51.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.136+0000 7f5cbd8db700 1 -- 172.21.15.8:0/639336757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cb8100510 msgr2=0x7f5cb810c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T11:59:51.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.136+0000 7f5cbd8db700 1 --2- 172.21.15.8:0/639336757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cb8100510 0x7f5cb810c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T11:59:51.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.136+0000 7f5cbd8db700 1 -- 172.21.15.8:0/639336757 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca80095f0 con 0x7f5cb8101710 2023-12-17T11:59:51.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.136+0000 7f5cbd8db700 1 --2- 172.21.15.8:0/639336757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5cb8101710 0x7f5cb810ac40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8005910 tx=0x7f5ca8005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:59:51.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.136+0000 7f5caf7fe700 1 -- 172.21.15.8:0/639336757 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca801d070 con 0x7f5cb8101710 2023-12-17T11:59:51.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.136+0000 7f5caf7fe700 1 -- 172.21.15.8:0/639336757 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5ca800bd30 con 0x7f5cb8101710 2023-12-17T11:59:51.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.136+0000 7f5cc0340700 1 -- 172.21.15.8:0/639336757 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cb81a1780 con 0x7f5cb8101710 2023-12-17T11:59:51.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.136+0000 7f5caf7fe700 1 -- 172.21.15.8:0/639336757 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ca8022cd0 con 0x7f5cb8101710 2023-12-17T11:59:51.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.137+0000 7f5cc0340700 1 -- 172.21.15.8:0/639336757 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cb81a1bf0 con 0x7f5cb8101710 2023-12-17T11:59:51.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.138+0000 7f5cc0340700 1 -- 172.21.15.8:0/639336757 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cb8107a90 con 0x7f5cb8101710 2023-12-17T11:59:51.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.140+0000 7f5caf7fe700 1 -- 172.21.15.8:0/639336757 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7f5ca8022470 con 0x7f5cb8101710 2023-12-17T11:59:51.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.141+0000 7f5caf7fe700 1 --2- 172.21.15.8:0/639336757 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f5ca40a1500 0x7f5ca40a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T11:59:51.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.141+0000 7f5caf7fe700 1 -- 172.21.15.8:0/639336757 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 4562+0+0 (secure 0 0 0) 0x7f5ca80cceb0 con 0x7f5cb8101710 2023-12-17T11:59:51.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.141+0000 7f5cbe0dc700 1 --2- 172.21.15.8:0/639336757 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f5ca40a1500 0x7f5ca40a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T11:59:51.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.142+0000 7f5cbe0dc700 1 --2- 172.21.15.8:0/639336757 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f5ca40a1500 0x7f5ca40a39c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5cb4005950 tx=0x7f5cb400a300 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T11:59:51.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.145+0000 7f5caf7fe700 1 -- 172.21.15.8:0/639336757 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f5ca80973a0 con 0x7f5cb8101710 2023-12-17T11:59:51.367 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T11:59:51.364+0000 7f5cc0340700 1 -- 172.21.15.8:0/639336757 --> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f5cb8061a10 con 0x7f5ca40a1500 2023-12-17T11:59:51.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:51 smithi186 ceph-mon[41182]: Detected new or changed devices on smithi186 2023-12-17T11:59:51.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:51 smithi186 ceph-mon[41182]: Adjusting osd_memory_target on smithi186 to 8635M 2023-12-17T11:59:51.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:51 smithi186 ceph-mon[41182]: osdmap e39: 6 total, 6 up, 6 in 2023-12-17T11:59:51.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:51 smithi008 ceph-mon[36830]: Detected new or changed devices on smithi186 2023-12-17T11:59:51.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:51 smithi008 ceph-mon[36830]: Adjusting osd_memory_target on smithi186 to 8635M 2023-12-17T11:59:51.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:51 smithi008 ceph-mon[36830]: osdmap e39: 6 total, 6 up, 6 in 2023-12-17T11:59:51.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:51 smithi100 ceph-mon[41266]: Detected new or changed devices on smithi186 2023-12-17T11:59:51.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:51 smithi100 ceph-mon[41266]: Adjusting osd_memory_target on smithi186 to 8635M 2023-12-17T11:59:51.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:51 smithi100 ceph-mon[41266]: osdmap e39: 6 total, 6 up, 6 in 2023-12-17T11:59:52.346 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:52 smithi008 ceph-mon[36830]: from='client.14391 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:59:52.346 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:52 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T11:59:52.346 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:52 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T11:59:52.346 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:52 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:59:52.346 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:52 smithi008 ceph-mon[36830]: pgmap v131: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-12-17T11:59:52.346 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:52 smithi008 ceph-mon[36830]: osdmap e40: 6 total, 6 up, 6 in 2023-12-17T11:59:52.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:52 smithi100 ceph-mon[41266]: from='client.14391 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:59:52.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:52 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T11:59:52.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:52 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T11:59:52.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:52 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:59:52.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:52 smithi100 ceph-mon[41266]: pgmap v131: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-12-17T11:59:52.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:52 smithi100 ceph-mon[41266]: osdmap e40: 6 total, 6 up, 6 in 2023-12-17T11:59:52.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:52 smithi186 ceph-mon[41182]: from='client.14391 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T11:59:52.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:52 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T11:59:52.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:52 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T11:59:52.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:52 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T11:59:52.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:52 smithi186 ceph-mon[41182]: pgmap v131: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-12-17T11:59:52.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:52 smithi186 ceph-mon[41182]: osdmap e40: 6 total, 6 up, 6 in 2023-12-17T11:59:54.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:54 smithi008 ceph-mon[36830]: osdmap e41: 6 total, 6 up, 6 in 2023-12-17T11:59:54.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:54 smithi008 ceph-mon[36830]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-12-17T11:59:54.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:54 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/2496846839' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bb5325e0-fe12-4bbc-96a9-86c228106a7c"}]: dispatch 2023-12-17T11:59:54.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:54 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/2496846839' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bb5325e0-fe12-4bbc-96a9-86c228106a7c"}]': finished 2023-12-17T11:59:54.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:54 smithi008 ceph-mon[36830]: osdmap e42: 7 total, 6 up, 7 in 2023-12-17T11:59:54.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:54 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-17T11:59:54.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:54 smithi100 ceph-mon[41266]: osdmap e41: 6 total, 6 up, 6 in 2023-12-17T11:59:54.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:54 smithi100 ceph-mon[41266]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-12-17T11:59:54.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:54 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/2496846839' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bb5325e0-fe12-4bbc-96a9-86c228106a7c"}]: dispatch 2023-12-17T11:59:54.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:54 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/2496846839' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bb5325e0-fe12-4bbc-96a9-86c228106a7c"}]': finished 2023-12-17T11:59:54.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:54 smithi100 ceph-mon[41266]: osdmap e42: 7 total, 6 up, 7 in 2023-12-17T11:59:54.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:54 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-17T11:59:54.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:54 smithi186 ceph-mon[41182]: osdmap e41: 6 total, 6 up, 6 in 2023-12-17T11:59:54.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:54 smithi186 ceph-mon[41182]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-12-17T11:59:54.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:54 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/2496846839' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bb5325e0-fe12-4bbc-96a9-86c228106a7c"}]: dispatch 2023-12-17T11:59:54.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:54 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/2496846839' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bb5325e0-fe12-4bbc-96a9-86c228106a7c"}]': finished 2023-12-17T11:59:54.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:54 smithi186 ceph-mon[41182]: osdmap e42: 7 total, 6 up, 7 in 2023-12-17T11:59:54.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:54 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-17T11:59:55.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:55 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/1717726482' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T11:59:55.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:55 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/1717726482' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T11:59:55.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:55 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/1717726482' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T11:59:56.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:56 smithi008 ceph-mon[36830]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-12-17T11:59:56.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:56 smithi100 ceph-mon[41266]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-12-17T11:59:56.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:56 smithi186 ceph-mon[41182]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-12-17T11:59:58.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 11:59:58 smithi186 ceph-mon[41182]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-17T11:59:58.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 11:59:58 smithi008 ceph-mon[36830]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-17T11:59:58.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 11:59:58 smithi100 ceph-mon[41266]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-17T12:00:00.687 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:00 smithi008 ceph-mon[36830]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 77 KiB/s, 0 objects/s recovering 2023-12-17T12:00:00.687 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:00 smithi008 ceph-mon[36830]: overall HEALTH_OK 2023-12-17T12:00:00.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:00 smithi186 ceph-mon[41182]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 77 KiB/s, 0 objects/s recovering 2023-12-17T12:00:00.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:00 smithi186 ceph-mon[41182]: overall HEALTH_OK 2023-12-17T12:00:00.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:00 smithi100 ceph-mon[41266]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 77 KiB/s, 0 objects/s recovering 2023-12-17T12:00:00.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:00 smithi100 ceph-mon[41266]: overall HEALTH_OK 2023-12-17T12:00:01.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:01 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-12-17T12:00:01.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:01 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:01.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:01 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-12-17T12:00:01.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:01 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:01.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:01 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-12-17T12:00:01.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:01 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:02.710 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:02 smithi008 ceph-mon[36830]: Deploying daemon osd.6 on smithi008 2023-12-17T12:00:02.711 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:02 smithi008 ceph-mon[36830]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2023-12-17T12:00:02.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:02 smithi186 ceph-mon[41182]: Deploying daemon osd.6 on smithi008 2023-12-17T12:00:02.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:02 smithi186 ceph-mon[41182]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2023-12-17T12:00:02.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:02 smithi100 ceph-mon[41266]: Deploying daemon osd.6 on smithi008 2023-12-17T12:00:02.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:02 smithi100 ceph-mon[41266]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 71 KiB/s, 0 objects/s recovering 2023-12-17T12:00:04.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:04 smithi186 ceph-mon[41182]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-17T12:00:04.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:04 smithi008 ceph-mon[36830]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-17T12:00:04.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:04 smithi100 ceph-mon[41266]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-12-17T12:00:06.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:05 smithi186 ceph-mon[41182]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2023-12-17T12:00:06.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:05 smithi008 ceph-mon[36830]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2023-12-17T12:00:06.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:05 smithi100 ceph-mon[41266]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2023-12-17T12:00:07.249 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:07 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:07.249 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:07 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:07.249 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:07 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:00:07.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:07 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:07.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:07 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:07.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:07 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:00:07.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:07 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:07.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:07 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:07.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:07 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:00:08.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:08 smithi100 ceph-mon[41266]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-12-17T12:00:08.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:08 smithi186 ceph-mon[41182]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-12-17T12:00:08.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:08 smithi008 ceph-mon[36830]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2023-12-17T12:00:08.916 INFO:teuthology.orchestra.run.smithi008.stdout:Created osd(s) 6 on host 'smithi008' 2023-12-17T12:00:08.918 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:08.914+0000 7f5caf7fe700 1 -- 172.21.15.8:0/639336757 <== mgr.14154 v2:172.21.15.8:6800/268548699 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5cb8061a10 con 0x7f5ca40a1500 2023-12-17T12:00:08.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:08.917+0000 7f5cc0340700 1 -- 172.21.15.8:0/639336757 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f5ca40a1500 msgr2=0x7f5ca40a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:08.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:08.917+0000 7f5cc0340700 1 --2- 172.21.15.8:0/639336757 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f5ca40a1500 0x7f5ca40a39c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5cb4005950 tx=0x7f5cb400a300 comp rx=0 tx=0).stop 2023-12-17T12:00:08.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:08.917+0000 7f5cc0340700 1 -- 172.21.15.8:0/639336757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5cb8101710 msgr2=0x7f5cb810ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:08.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:08.917+0000 7f5cc0340700 1 --2- 172.21.15.8:0/639336757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5cb8101710 0x7f5cb810ac40 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5ca8005910 tx=0x7f5ca8005b00 comp rx=0 tx=0).stop 2023-12-17T12:00:08.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:08.917+0000 7f5cc0340700 1 -- 172.21.15.8:0/639336757 shutdown_connections 2023-12-17T12:00:08.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:08.917+0000 7f5cc0340700 1 --2- 172.21.15.8:0/639336757 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f5ca40a1500 0x7f5ca40a39c0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:08.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:08.917+0000 7f5cc0340700 1 --2- 172.21.15.8:0/639336757 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5cb81020b0 0x7f5cb810b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:08.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:08.917+0000 7f5cc0340700 1 --2- 172.21.15.8:0/639336757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5cb8100510 0x7f5cb810c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:08.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:08.917+0000 7f5cc0340700 1 --2- 172.21.15.8:0/639336757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5cb8101710 0x7f5cb810ac40 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:08.919 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:08.917+0000 7f5cc0340700 1 -- 172.21.15.8:0/639336757 >> 172.21.15.8:0/639336757 conn(0x7f5cb80fbad0 msgr2=0x7f5cb8104bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:08.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:08.917+0000 7f5cc0340700 1 -- 172.21.15.8:0/639336757 shutdown_connections 2023-12-17T12:00:08.920 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:08.917+0000 7f5cc0340700 1 -- 172.21.15.8:0/639336757 wait complete. 2023-12-17T12:00:09.112 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:09 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:09.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:09 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:09.113 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:09 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:09.152 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:09 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:09.152 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:09 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:09.152 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:09 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:09.152 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:09 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:00:09.152 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:09 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:09.152 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:09 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:09.152 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:09 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:09.152 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:09 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:00:09.345 DEBUG:teuthology.orchestra.run.smithi008:osd.6> sudo journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.6.service 2023-12-17T12:00:09.350 INFO:tasks.cephadm:Deploying osd.7 on smithi100 with /dev/vg_nvme/lv_2... 2023-12-17T12:00:09.350 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-17T12:00:09.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:09 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:09.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:09 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:09.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:09 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:09.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:09 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:00:09.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:09 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:09.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:09 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:09.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:09 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:09.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:09 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:00:09.424 INFO:journalctl@ceph.osd.6.smithi008.stdout:-- Logs begin at Sun 2023-12-17 11:40:41 UTC. -- 2023-12-17T12:00:09.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:09 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:00:09.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:09 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:09.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:09 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:09.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:09 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:09.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:09 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:00:09.758 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.b/config 2023-12-17T12:00:09.960 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:00:09 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:00:09.829+0000 7f3d6eb81640 -1 osd.6 0 log_to_monitors true 2023-12-17T12:00:10.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:10 smithi100 ceph-mon[41266]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-12-17T12:00:10.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:10 smithi100 ceph-mon[41266]: from='osd.6 [v2:172.21.15.8:6818/3266909294,v1:172.21.15.8:6819/3266909294]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-12-17T12:00:10.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:10 smithi008 ceph-mon[36830]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-12-17T12:00:10.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:10 smithi008 ceph-mon[36830]: from='osd.6 [v2:172.21.15.8:6818/3266909294,v1:172.21.15.8:6819/3266909294]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-12-17T12:00:10.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:10 smithi186 ceph-mon[41182]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-12-17T12:00:10.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:10 smithi186 ceph-mon[41182]: from='osd.6 [v2:172.21.15.8:6818/3266909294,v1:172.21.15.8:6819/3266909294]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-12-17T12:00:11.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:11 smithi100 ceph-mon[41266]: from='osd.6 [v2:172.21.15.8:6818/3266909294,v1:172.21.15.8:6819/3266909294]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-12-17T12:00:11.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:11 smithi100 ceph-mon[41266]: osdmap e43: 7 total, 6 up, 7 in 2023-12-17T12:00:11.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:11 smithi100 ceph-mon[41266]: from='osd.6 [v2:172.21.15.8:6818/3266909294,v1:172.21.15.8:6819/3266909294]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-12-17T12:00:11.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:11 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-17T12:00:11.477 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:11 smithi186 ceph-mon[41182]: from='osd.6 [v2:172.21.15.8:6818/3266909294,v1:172.21.15.8:6819/3266909294]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-12-17T12:00:11.477 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:11 smithi186 ceph-mon[41182]: osdmap e43: 7 total, 6 up, 7 in 2023-12-17T12:00:11.477 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:11 smithi186 ceph-mon[41182]: from='osd.6 [v2:172.21.15.8:6818/3266909294,v1:172.21.15.8:6819/3266909294]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-12-17T12:00:11.478 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:11 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-17T12:00:11.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:11 smithi008 ceph-mon[36830]: from='osd.6 [v2:172.21.15.8:6818/3266909294,v1:172.21.15.8:6819/3266909294]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-12-17T12:00:11.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:11 smithi008 ceph-mon[36830]: osdmap e43: 7 total, 6 up, 7 in 2023-12-17T12:00:11.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:11 smithi008 ceph-mon[36830]: from='osd.6 [v2:172.21.15.8:6818/3266909294,v1:172.21.15.8:6819/3266909294]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-12-17T12:00:11.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:11 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-17T12:00:11.497 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:00:11 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:00:11.128+0000 7f3d641f8700 -1 osd.6 0 waiting for initial osdmap 2023-12-17T12:00:11.497 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:00:11 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:00:11.141+0000 7f3d5dfee700 -1 osd.6 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-17T12:00:11.520 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-17T12:00:11.520 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-17T12:00:11.520 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 10+0 records in 2023-12-17T12:00:11.520 INFO:teuthology.orchestra.run.smithi100.stderr:10+0 records out 2023-12-17T12:00:11.520 INFO:teuthology.orchestra.run.smithi100.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0556732 s, 188 MB/s 2023-12-17T12:00:11.520 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 2023-12-17T12:00:11.520 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping successful for: 2023-12-17T12:00:11.907 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi100:vg_nvme/lv_2 2023-12-17T12:00:12.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:12 smithi008 ceph-mon[36830]: from='osd.6 [v2:172.21.15.8:6818/3266909294,v1:172.21.15.8:6819/3266909294]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-12-17T12:00:12.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:12 smithi008 ceph-mon[36830]: osdmap e44: 7 total, 6 up, 7 in 2023-12-17T12:00:12.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:12 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-17T12:00:12.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:12 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-17T12:00:12.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:12 smithi008 ceph-mon[36830]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-12-17T12:00:12.313 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.b/config 2023-12-17T12:00:12.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:12 smithi100 ceph-mon[41266]: from='osd.6 [v2:172.21.15.8:6818/3266909294,v1:172.21.15.8:6819/3266909294]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-12-17T12:00:12.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:12 smithi100 ceph-mon[41266]: osdmap e44: 7 total, 6 up, 7 in 2023-12-17T12:00:12.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:12 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-17T12:00:12.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:12 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-17T12:00:12.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:12 smithi100 ceph-mon[41266]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-12-17T12:00:12.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:12 smithi186 ceph-mon[41182]: from='osd.6 [v2:172.21.15.8:6818/3266909294,v1:172.21.15.8:6819/3266909294]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-12-17T12:00:12.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:12 smithi186 ceph-mon[41182]: osdmap e44: 7 total, 6 up, 7 in 2023-12-17T12:00:12.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:12 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-17T12:00:12.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:12 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-17T12:00:12.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:12 smithi186 ceph-mon[41182]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 161 MiB used, 536 GiB / 536 GiB avail 2023-12-17T12:00:13.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:13 smithi100 ceph-mon[41266]: purged_snaps scrub starts 2023-12-17T12:00:13.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:13 smithi100 ceph-mon[41266]: purged_snaps scrub ok 2023-12-17T12:00:13.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:13 smithi100 ceph-mon[41266]: osd.6 [v2:172.21.15.8:6818/3266909294,v1:172.21.15.8:6819/3266909294] boot 2023-12-17T12:00:13.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:13 smithi100 ceph-mon[41266]: osdmap e45: 7 total, 7 up, 7 in 2023-12-17T12:00:13.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:13 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-17T12:00:13.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:13 smithi100 ceph-mon[41266]: Detected new or changed devices on smithi008 2023-12-17T12:00:13.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:13 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:13.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:13 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:13.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:13 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:00:13.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:13 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:00:13.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:13 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:00:13.417 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:13 smithi100 ceph-mon[41266]: Adjusting osd_memory_target on smithi008 to 5758M 2023-12-17T12:00:13.417 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:13 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:13.417 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:13 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:13.417 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:13 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:00:13.417 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:13 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:13.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:13 smithi186 ceph-mon[41182]: purged_snaps scrub starts 2023-12-17T12:00:13.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:13 smithi186 ceph-mon[41182]: purged_snaps scrub ok 2023-12-17T12:00:13.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:13 smithi186 ceph-mon[41182]: osd.6 [v2:172.21.15.8:6818/3266909294,v1:172.21.15.8:6819/3266909294] boot 2023-12-17T12:00:13.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:13 smithi186 ceph-mon[41182]: osdmap e45: 7 total, 7 up, 7 in 2023-12-17T12:00:13.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:13 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-17T12:00:13.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:13 smithi186 ceph-mon[41182]: Detected new or changed devices on smithi008 2023-12-17T12:00:13.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:13 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:13.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:13 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:13.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:13 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:00:13.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:13 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:00:13.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:13 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:00:13.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:13 smithi186 ceph-mon[41182]: Adjusting osd_memory_target on smithi008 to 5758M 2023-12-17T12:00:13.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:13 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:13.477 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:13 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:13.477 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:13 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:00:13.477 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:13 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:13.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.478+0000 7f705ac1b700 1 -- 172.21.15.100:0/3665165122 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70541031c0 msgr2=0x7f7054109a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:13.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.478+0000 7f705ac1b700 1 --2- 172.21.15.100:0/3665165122 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70541031c0 0x7f7054109a70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f704c00b0d0 tx=0x7f704c00b3e0 comp rx=0 tx=0).stop 2023-12-17T12:00:13.481 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.478+0000 7f705ac1b700 1 -- 172.21.15.100:0/3665165122 shutdown_connections 2023-12-17T12:00:13.482 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.478+0000 7f705ac1b700 1 --2- 172.21.15.100:0/3665165122 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70541031c0 0x7f7054109a70 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:13.482 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.478+0000 7f705ac1b700 1 --2- 172.21.15.100:0/3665165122 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7054101620 0x7f7054101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:13.482 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.478+0000 7f705ac1b700 1 --2- 172.21.15.100:0/3665165122 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7054102820 0x7f7054102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:13.482 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.478+0000 7f705ac1b700 1 -- 172.21.15.100:0/3665165122 >> 172.21.15.100:0/3665165122 conn(0x7f70540fcbe0 msgr2=0x7f70540ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:13.482 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.478+0000 7f705ac1b700 1 -- 172.21.15.100:0/3665165122 shutdown_connections 2023-12-17T12:00:13.482 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.478+0000 7f705ac1b700 1 -- 172.21.15.100:0/3665165122 wait complete. 2023-12-17T12:00:13.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.479+0000 7f705ac1b700 1 Processor -- start 2023-12-17T12:00:13.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.480+0000 7f705ac1b700 1 -- start start 2023-12-17T12:00:13.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.480+0000 7f705ac1b700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7054101620 0x7f70541997d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:13.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.480+0000 7f705ac1b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7054102820 0x7f7054199d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:13.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.480+0000 7f705ac1b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70541031c0 0x7f70541a0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:13.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.480+0000 7f705ac1b700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70541a1270 con 0x7f7054102820 2023-12-17T12:00:13.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.480+0000 7f705ac1b700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70541a13b0 con 0x7f70541031c0 2023-12-17T12:00:13.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.480+0000 7f705ac1b700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70541a1540 con 0x7f7054101620 2023-12-17T12:00:13.484 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.480+0000 7f70591b8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70541031c0 0x7f70541a0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:13.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.480+0000 7f70591b8700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70541031c0 0x7f70541a0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:36930/0 (socket says 172.21.15.100:36930) 2023-12-17T12:00:13.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.480+0000 7f70591b8700 1 -- 172.21.15.100:0/3103625546 learned_addr learned my addr 172.21.15.100:0/3103625546 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-17T12:00:13.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.480+0000 7f7053fff700 1 --2- 172.21.15.100:0/3103625546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7054102820 0x7f7054199d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:13.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.480+0000 7f70589b7700 1 --2- 172.21.15.100:0/3103625546 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7054101620 0x7f70541997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:13.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.481+0000 7f70591b8700 1 -- 172.21.15.100:0/3103625546 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7054101620 msgr2=0x7f70541997d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:13.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.481+0000 7f70591b8700 1 --2- 172.21.15.100:0/3103625546 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7054101620 0x7f70541997d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:13.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.481+0000 7f70591b8700 1 -- 172.21.15.100:0/3103625546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7054102820 msgr2=0x7f7054199d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:13.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.481+0000 7f70591b8700 1 --2- 172.21.15.100:0/3103625546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7054102820 0x7f7054199d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:13.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.481+0000 7f70591b8700 1 -- 172.21.15.100:0/3103625546 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f704c009d00 con 0x7f70541031c0 2023-12-17T12:00:13.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.481+0000 7f70591b8700 1 --2- 172.21.15.100:0/3103625546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70541031c0 0x7f70541a0ca0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f704c0079c0 tx=0x7f704c00ccc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:13.485 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.481+0000 7f7051ffb700 1 -- 172.21.15.100:0/3103625546 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704c00e040 con 0x7f70541031c0 2023-12-17T12:00:13.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.481+0000 7f7051ffb700 1 -- 172.21.15.100:0/3103625546 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f704c004e60 con 0x7f70541031c0 2023-12-17T12:00:13.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.481+0000 7f705ac1b700 1 -- 172.21.15.100:0/3103625546 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70541a17c0 con 0x7f70541031c0 2023-12-17T12:00:13.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.481+0000 7f7051ffb700 1 -- 172.21.15.100:0/3103625546 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f704c01b6b0 con 0x7f70541031c0 2023-12-17T12:00:13.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.481+0000 7f705ac1b700 1 -- 172.21.15.100:0/3103625546 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70541a1c30 con 0x7f70541031c0 2023-12-17T12:00:13.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.482+0000 7f705ac1b700 1 -- 172.21.15.100:0/3103625546 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f705404f290 con 0x7f70541031c0 2023-12-17T12:00:13.486 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.484+0000 7f7051ffb700 1 -- 172.21.15.100:0/3103625546 <== mon.2 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7f704c01d480 con 0x7f70541031c0 2023-12-17T12:00:13.488 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.485+0000 7f7051ffb700 1 --2- 172.21.15.100:0/3103625546 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f70440a1480 0x7f70440a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:13.488 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.486+0000 7f7051ffb700 1 -- 172.21.15.100:0/3103625546 <== mon.2 v2:172.21.15.100:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 4965+0+0 (secure 0 0 0) 0x7f704c0cd8e0 con 0x7f70541031c0 2023-12-17T12:00:13.488 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.486+0000 7f70589b7700 1 --2- 172.21.15.100:0/3103625546 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f70440a1480 0x7f70440a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:13.489 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.487+0000 7f70589b7700 1 --2- 172.21.15.100:0/3103625546 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f70440a1480 0x7f70440a3940 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7054102680 tx=0x7f7048009260 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:13.492 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.490+0000 7f7051ffb700 1 -- 172.21.15.100:0/3103625546 <== mon.2 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f704c097c40 con 0x7f70541031c0 2023-12-17T12:00:13.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:13 smithi008 ceph-mon[36830]: purged_snaps scrub starts 2023-12-17T12:00:13.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:13 smithi008 ceph-mon[36830]: purged_snaps scrub ok 2023-12-17T12:00:13.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:13 smithi008 ceph-mon[36830]: osd.6 [v2:172.21.15.8:6818/3266909294,v1:172.21.15.8:6819/3266909294] boot 2023-12-17T12:00:13.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:13 smithi008 ceph-mon[36830]: osdmap e45: 7 total, 7 up, 7 in 2023-12-17T12:00:13.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:13 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-12-17T12:00:13.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:13 smithi008 ceph-mon[36830]: Detected new or changed devices on smithi008 2023-12-17T12:00:13.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:13 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:13.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:13 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:13.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:13 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:00:13.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:13 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:00:13.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:13 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:00:13.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:13 smithi008 ceph-mon[36830]: Adjusting osd_memory_target on smithi008 to 5758M 2023-12-17T12:00:13.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:13 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:13.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:13 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:13.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:13 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:00:13.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:13 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:13.700 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:13.698+0000 7f705ac1b700 1 -- 172.21.15.100:0/3103625546 --> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f7054074f20 con 0x7f70440a1480 2023-12-17T12:00:14.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:14 smithi100 ceph-mon[41266]: osdmap e46: 7 total, 7 up, 7 in 2023-12-17T12:00:14.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:14 smithi100 ceph-mon[41266]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-17T12:00:14.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:14 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T12:00:14.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:14 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T12:00:14.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:14 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:14.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:14 smithi186 ceph-mon[41182]: osdmap e46: 7 total, 7 up, 7 in 2023-12-17T12:00:14.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:14 smithi186 ceph-mon[41182]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-17T12:00:14.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:14 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T12:00:14.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:14 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T12:00:14.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:14 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:14.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:14 smithi008 ceph-mon[36830]: osdmap e46: 7 total, 7 up, 7 in 2023-12-17T12:00:14.748 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:14 smithi008 ceph-mon[36830]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-17T12:00:14.748 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:14 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T12:00:14.749 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:14 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T12:00:14.749 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:14 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:15.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:15 smithi100 ceph-mon[41266]: from='client.24302 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:00:15.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:15 smithi186 ceph-mon[41182]: from='client.24302 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:00:15.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:15 smithi008 ceph-mon[36830]: from='client.24302 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:00:16.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:16 smithi100 ceph-mon[41266]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-17T12:00:16.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:16 smithi100 ceph-mon[41266]: from='client.? 172.21.15.100:0/482574310' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "48939d99-29dd-436b-b9f1-fdfe1ee26315"}]: dispatch 2023-12-17T12:00:16.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:16 smithi100 ceph-mon[41266]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "48939d99-29dd-436b-b9f1-fdfe1ee26315"}]: dispatch 2023-12-17T12:00:16.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:16 smithi100 ceph-mon[41266]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "48939d99-29dd-436b-b9f1-fdfe1ee26315"}]': finished 2023-12-17T12:00:16.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:16 smithi100 ceph-mon[41266]: osdmap e47: 8 total, 7 up, 8 in 2023-12-17T12:00:16.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:16 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-17T12:00:16.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:16 smithi186 ceph-mon[41182]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-17T12:00:16.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:16 smithi186 ceph-mon[41182]: from='client.? 172.21.15.100:0/482574310' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "48939d99-29dd-436b-b9f1-fdfe1ee26315"}]: dispatch 2023-12-17T12:00:16.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:16 smithi186 ceph-mon[41182]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "48939d99-29dd-436b-b9f1-fdfe1ee26315"}]: dispatch 2023-12-17T12:00:16.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:16 smithi186 ceph-mon[41182]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "48939d99-29dd-436b-b9f1-fdfe1ee26315"}]': finished 2023-12-17T12:00:16.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:16 smithi186 ceph-mon[41182]: osdmap e47: 8 total, 7 up, 8 in 2023-12-17T12:00:16.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:16 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-17T12:00:16.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:16 smithi008 ceph-mon[36830]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-17T12:00:16.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:16 smithi008 ceph-mon[36830]: from='client.? 172.21.15.100:0/482574310' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "48939d99-29dd-436b-b9f1-fdfe1ee26315"}]: dispatch 2023-12-17T12:00:16.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:16 smithi008 ceph-mon[36830]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "48939d99-29dd-436b-b9f1-fdfe1ee26315"}]: dispatch 2023-12-17T12:00:16.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:16 smithi008 ceph-mon[36830]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "48939d99-29dd-436b-b9f1-fdfe1ee26315"}]': finished 2023-12-17T12:00:16.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:16 smithi008 ceph-mon[36830]: osdmap e47: 8 total, 7 up, 8 in 2023-12-17T12:00:16.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:16 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-17T12:00:17.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:17 smithi100 ceph-mon[41266]: from='client.? 172.21.15.100:0/2877643180' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T12:00:17.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:17 smithi186 ceph-mon[41182]: from='client.? 172.21.15.100:0/2877643180' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T12:00:17.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:17 smithi008 ceph-mon[36830]: from='client.? 172.21.15.100:0/2877643180' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T12:00:18.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:18 smithi100 ceph-mon[41266]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-17T12:00:18.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:18 smithi186 ceph-mon[41182]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-17T12:00:18.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:18 smithi008 ceph-mon[36830]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-17T12:00:20.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:20 smithi186 ceph-mon[41182]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-17T12:00:20.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:20 smithi008 ceph-mon[36830]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-17T12:00:20.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:20 smithi100 ceph-mon[41266]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-17T12:00:22.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:22 smithi100 ceph-mon[41266]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-17T12:00:22.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:22 smithi186 ceph-mon[41182]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-17T12:00:22.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:22 smithi008 ceph-mon[36830]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-17T12:00:23.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:23 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-12-17T12:00:23.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:23 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:23.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:23 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-12-17T12:00:23.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:23 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:23.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:23 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-12-17T12:00:23.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:23 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:24.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:24 smithi186 ceph-mon[41182]: Deploying daemon osd.7 on smithi100 2023-12-17T12:00:24.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:24 smithi186 ceph-mon[41182]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-17T12:00:24.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:24 smithi008 ceph-mon[36830]: Deploying daemon osd.7 on smithi100 2023-12-17T12:00:24.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:24 smithi008 ceph-mon[36830]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-17T12:00:24.794 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:24 smithi100 ceph-mon[41266]: Deploying daemon osd.7 on smithi100 2023-12-17T12:00:24.794 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:24 smithi100 ceph-mon[41266]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-17T12:00:26.201 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:25 smithi100 ceph-mon[41266]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-17T12:00:26.225 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:25 smithi186 ceph-mon[41182]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-17T12:00:26.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:25 smithi008 ceph-mon[36830]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-17T12:00:28.634 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:28 smithi100 ceph-mon[41266]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-17T12:00:28.634 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:28 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:00:28.634 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:28 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:28.634 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:28 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:28.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:28 smithi186 ceph-mon[41182]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-17T12:00:28.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:28 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:00:28.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:28 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:28.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:28 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:28.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:28 smithi008 ceph-mon[36830]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-17T12:00:28.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:28 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:00:28.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:28 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:28.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:28 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:30.593 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:30 smithi100 ceph-mon[41266]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-17T12:00:30.593 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:30 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:30.593 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:30 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:30.593 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:30 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:30.594 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:30 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:00:30.594 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:30 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:30.674 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:30.672+0000 7f7051ffb700 1 -- 172.21.15.100:0/3103625546 <== mgr.14154 v2:172.21.15.8:6800/268548699 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f7054074f20 con 0x7f70440a1480 2023-12-17T12:00:30.674 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 7 on host 'smithi100' 2023-12-17T12:00:30.676 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:30.674+0000 7f705ac1b700 1 -- 172.21.15.100:0/3103625546 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f70440a1480 msgr2=0x7f70440a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:30.676 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:30.674+0000 7f705ac1b700 1 --2- 172.21.15.100:0/3103625546 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f70440a1480 0x7f70440a3940 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7054102680 tx=0x7f7048009260 comp rx=0 tx=0).stop 2023-12-17T12:00:30.676 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:30.674+0000 7f705ac1b700 1 -- 172.21.15.100:0/3103625546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70541031c0 msgr2=0x7f70541a0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:30.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:30.674+0000 7f705ac1b700 1 --2- 172.21.15.100:0/3103625546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70541031c0 0x7f70541a0ca0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f704c0079c0 tx=0x7f704c00ccc0 comp rx=0 tx=0).stop 2023-12-17T12:00:30.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:30.675+0000 7f705ac1b700 1 -- 172.21.15.100:0/3103625546 shutdown_connections 2023-12-17T12:00:30.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:30.675+0000 7f705ac1b700 1 --2- 172.21.15.100:0/3103625546 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f70440a1480 0x7f70440a3940 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:30.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:30.675+0000 7f705ac1b700 1 --2- 172.21.15.100:0/3103625546 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70541031c0 0x7f70541a0ca0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:30.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:30.675+0000 7f705ac1b700 1 --2- 172.21.15.100:0/3103625546 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7054101620 0x7f70541997d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:30.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:30.675+0000 7f705ac1b700 1 --2- 172.21.15.100:0/3103625546 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7054102820 0x7f7054199d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:30.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:30.675+0000 7f705ac1b700 1 -- 172.21.15.100:0/3103625546 >> 172.21.15.100:0/3103625546 conn(0x7f70540fcbe0 msgr2=0x7f7054073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:30.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:30.675+0000 7f705ac1b700 1 -- 172.21.15.100:0/3103625546 shutdown_connections 2023-12-17T12:00:30.677 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:00:30.675+0000 7f705ac1b700 1 -- 172.21.15.100:0/3103625546 wait complete. 2023-12-17T12:00:30.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:30 smithi186 ceph-mon[41182]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-17T12:00:30.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:30 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:30.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:30 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:30.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:30 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:30.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:30 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:00:30.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:30 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:30.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:30 smithi008 ceph-mon[36830]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-17T12:00:30.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:30 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:30.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:30 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:30.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:30 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:30.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:30 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:00:30.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:30 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:31.105 DEBUG:teuthology.orchestra.run.smithi100:osd.7> sudo journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.7.service 2023-12-17T12:00:31.109 INFO:tasks.cephadm:Deploying osd.8 on smithi186 with /dev/vg_nvme/lv_2... 2023-12-17T12:00:31.109 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-12-17T12:00:31.186 INFO:journalctl@ceph.osd.7.smithi100.stdout:-- Logs begin at Sun 2023-12-17 11:35:53 UTC. -- 2023-12-17T12:00:31.523 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.c/config 2023-12-17T12:00:31.860 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:31 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:00:31.860 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:31 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:31.860 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:31 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:31.860 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:31 smithi100 ceph-mon[41266]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-17T12:00:31.901 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:31 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:00:31.901 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:31 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:31.901 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:31 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:31.901 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:31 smithi186 ceph-mon[41182]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-17T12:00:31.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:31 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:00:31.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:31 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:31.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:31 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:31.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:31 smithi008 ceph-mon[36830]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-17T12:00:32.140 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:00:31 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:00:31.878+0000 7ff19abda640 -1 osd.7 0 log_to_monitors true 2023-12-17T12:00:32.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:32 smithi100 ceph-mon[41266]: from='osd.7 [v2:172.21.15.100:6816/1631494583,v1:172.21.15.100:6817/1631494583]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-12-17T12:00:32.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:32 smithi100 ceph-mon[41266]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-12-17T12:00:32.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:32 smithi186 ceph-mon[41182]: from='osd.7 [v2:172.21.15.100:6816/1631494583,v1:172.21.15.100:6817/1631494583]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-12-17T12:00:32.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:32 smithi186 ceph-mon[41182]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-12-17T12:00:32.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:32 smithi008 ceph-mon[36830]: from='osd.7 [v2:172.21.15.100:6816/1631494583,v1:172.21.15.100:6817/1631494583]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-12-17T12:00:32.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:32 smithi008 ceph-mon[36830]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-12-17T12:00:33.362 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-12-17T12:00:33.362 INFO:teuthology.orchestra.run.smithi186.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-12-17T12:00:33.363 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10+0 records in 2023-12-17T12:00:33.363 INFO:teuthology.orchestra.run.smithi186.stderr:10+0 records out 2023-12-17T12:00:33.363 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0325245 s, 322 MB/s 2023-12-17T12:00:33.363 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping successful for: 2023-12-17T12:00:33.811 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi186:vg_nvme/lv_2 2023-12-17T12:00:33.916 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:00:33 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:00:33.660+0000 7ff190251700 -1 osd.7 0 waiting for initial osdmap 2023-12-17T12:00:33.916 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:00:33 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:00:33.672+0000 7ff188043700 -1 osd.7 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-17T12:00:33.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:33 smithi100 ceph-mon[41266]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-12-17T12:00:33.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:33 smithi100 ceph-mon[41266]: osdmap e48: 8 total, 7 up, 8 in 2023-12-17T12:00:33.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:33 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-17T12:00:33.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:33 smithi100 ceph-mon[41266]: from='osd.7 [v2:172.21.15.100:6816/1631494583,v1:172.21.15.100:6817/1631494583]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2023-12-17T12:00:33.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:33 smithi100 ceph-mon[41266]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2023-12-17T12:00:33.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:33 smithi100 ceph-mon[41266]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-17T12:00:33.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:33 smithi186 ceph-mon[41182]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-12-17T12:00:33.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:33 smithi186 ceph-mon[41182]: osdmap e48: 8 total, 7 up, 8 in 2023-12-17T12:00:33.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:33 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-17T12:00:33.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:33 smithi186 ceph-mon[41182]: from='osd.7 [v2:172.21.15.100:6816/1631494583,v1:172.21.15.100:6817/1631494583]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2023-12-17T12:00:33.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:33 smithi186 ceph-mon[41182]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2023-12-17T12:00:33.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:33 smithi186 ceph-mon[41182]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-17T12:00:33.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:33 smithi008 ceph-mon[36830]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-12-17T12:00:33.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:33 smithi008 ceph-mon[36830]: osdmap e48: 8 total, 7 up, 8 in 2023-12-17T12:00:33.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:33 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-17T12:00:33.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:33 smithi008 ceph-mon[36830]: from='osd.7 [v2:172.21.15.100:6816/1631494583,v1:172.21.15.100:6817/1631494583]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2023-12-17T12:00:33.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:33 smithi008 ceph-mon[36830]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2023-12-17T12:00:33.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:33 smithi008 ceph-mon[36830]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 188 MiB used, 626 GiB / 626 GiB avail 2023-12-17T12:00:34.226 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.c/config 2023-12-17T12:00:34.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:34 smithi186 ceph-mon[41182]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2023-12-17T12:00:34.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:34 smithi186 ceph-mon[41182]: osdmap e49: 8 total, 7 up, 8 in 2023-12-17T12:00:34.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:34 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-17T12:00:34.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:34 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-17T12:00:34.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:34 smithi186 ceph-mon[41182]: Detected new or changed devices on smithi100 2023-12-17T12:00:34.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:34 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:34.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:34 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:34.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:34 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:00:34.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:34 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:00:34.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:34 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:00:34.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:34 smithi186 ceph-mon[41182]: Adjusting osd_memory_target on smithi100 to 5757M 2023-12-17T12:00:34.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:34 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:34.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:34 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:34.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:34 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:00:34.727 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:34 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:34.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:34 smithi100 ceph-mon[41266]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2023-12-17T12:00:34.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:34 smithi100 ceph-mon[41266]: osdmap e49: 8 total, 7 up, 8 in 2023-12-17T12:00:34.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:34 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-17T12:00:34.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:34 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-17T12:00:34.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:34 smithi100 ceph-mon[41266]: Detected new or changed devices on smithi100 2023-12-17T12:00:34.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:34 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:34.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:34 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:34.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:34 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:00:34.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:34 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:00:34.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:34 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:00:34.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:34 smithi100 ceph-mon[41266]: Adjusting osd_memory_target on smithi100 to 5757M 2023-12-17T12:00:34.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:34 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:34.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:34 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:34.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:34 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:00:34.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:34 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:34.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:34 smithi008 ceph-mon[36830]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2023-12-17T12:00:34.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:34 smithi008 ceph-mon[36830]: osdmap e49: 8 total, 7 up, 8 in 2023-12-17T12:00:34.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:34 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-17T12:00:34.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:34 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-17T12:00:34.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:34 smithi008 ceph-mon[36830]: Detected new or changed devices on smithi100 2023-12-17T12:00:34.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:34 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:34.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:34 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:34.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:34 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:00:34.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:34 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:00:34.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:34 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:00:34.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:34 smithi008 ceph-mon[36830]: Adjusting osd_memory_target on smithi100 to 5757M 2023-12-17T12:00:34.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:34 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:34.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:34 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:34.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:34 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:00:34.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:34 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:35.474 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.471+0000 7f237db8f700 1 -- 172.21.15.186:0/1583089395 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2378102820 msgr2=0x7f2378102c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:35.474 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.471+0000 7f237db8f700 1 --2- 172.21.15.186:0/1583089395 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2378102820 0x7f2378102c80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f236c009990 tx=0x7f236c009ca0 comp rx=0 tx=0).stop 2023-12-17T12:00:35.474 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.471+0000 7f237db8f700 1 -- 172.21.15.186:0/1583089395 shutdown_connections 2023-12-17T12:00:35.474 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.471+0000 7f237db8f700 1 --2- 172.21.15.186:0/1583089395 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f23781031c0 0x7f2378109a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:35.474 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.471+0000 7f237db8f700 1 --2- 172.21.15.186:0/1583089395 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2378101620 0x7f2378101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:35.475 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.471+0000 7f237db8f700 1 --2- 172.21.15.186:0/1583089395 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2378102820 0x7f2378102c80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:35.475 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.471+0000 7f237db8f700 1 -- 172.21.15.186:0/1583089395 >> 172.21.15.186:0/1583089395 conn(0x7f23780fcbc0 msgr2=0x7f23780ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:35.475 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.472+0000 7f237db8f700 1 -- 172.21.15.186:0/1583089395 shutdown_connections 2023-12-17T12:00:35.475 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.472+0000 7f237db8f700 1 -- 172.21.15.186:0/1583089395 wait complete. 2023-12-17T12:00:35.476 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.473+0000 7f237db8f700 1 Processor -- start 2023-12-17T12:00:35.477 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.473+0000 7f237db8f700 1 -- start start 2023-12-17T12:00:35.477 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.473+0000 7f237db8f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2378101620 0x7f23780752d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:35.477 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.473+0000 7f237db8f700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2378102820 0x7f23780739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:35.477 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.473+0000 7f237db8f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23781031c0 0x7f2378073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:35.477 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.473+0000 7f237db8f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23780745e0 con 0x7f23781031c0 2023-12-17T12:00:35.477 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.473+0000 7f237db8f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2378074750 con 0x7f2378101620 2023-12-17T12:00:35.477 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.473+0000 7f237db8f700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23781a1570 con 0x7f2378102820 2023-12-17T12:00:35.477 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.473+0000 7f2376ffd700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2378102820 0x7f23780739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:35.477 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.473+0000 7f2376ffd700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2378102820 0x7f23780739c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:42624/0 (socket says 172.21.15.186:42624) 2023-12-17T12:00:35.477 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.473+0000 7f2376ffd700 1 -- 172.21.15.186:0/1849637514 learned_addr learned my addr 172.21.15.186:0/1849637514 (peer_addr_for_me v2:172.21.15.186:0/0) 2023-12-17T12:00:35.477 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.473+0000 7f23777fe700 1 --2- 172.21.15.186:0/1849637514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2378101620 0x7f23780752d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:35.477 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.474+0000 7f2377fff700 1 --2- 172.21.15.186:0/1849637514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23781031c0 0x7f2378073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:35.478 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.474+0000 7f2376ffd700 1 -- 172.21.15.186:0/1849637514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2378101620 msgr2=0x7f23780752d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:35.478 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.474+0000 7f2376ffd700 1 --2- 172.21.15.186:0/1849637514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2378101620 0x7f23780752d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:35.478 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.474+0000 7f2376ffd700 1 -- 172.21.15.186:0/1849637514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23781031c0 msgr2=0x7f2378073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:35.478 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.474+0000 7f2376ffd700 1 --2- 172.21.15.186:0/1849637514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23781031c0 0x7f2378073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:35.478 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.474+0000 7f2376ffd700 1 -- 172.21.15.186:0/1849637514 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f236c0095f0 con 0x7f2378102820 2023-12-17T12:00:35.478 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.474+0000 7f2376ffd700 1 --2- 172.21.15.186:0/1849637514 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2378102820 0x7f23780739c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f236c000c00 tx=0x7f236c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:35.478 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.474+0000 7f2374ff9700 1 -- 172.21.15.186:0/1849637514 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c01d070 con 0x7f2378102820 2023-12-17T12:00:35.478 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.474+0000 7f2374ff9700 1 -- 172.21.15.186:0/1849637514 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f236c0054c0 con 0x7f2378102820 2023-12-17T12:00:35.478 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.474+0000 7f237db8f700 1 -- 172.21.15.186:0/1849637514 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23781a1770 con 0x7f2378102820 2023-12-17T12:00:35.478 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.474+0000 7f2374ff9700 1 -- 172.21.15.186:0/1849637514 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c003ab0 con 0x7f2378102820 2023-12-17T12:00:35.478 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.474+0000 7f237db8f700 1 -- 172.21.15.186:0/1849637514 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23781a1be0 con 0x7f2378102820 2023-12-17T12:00:35.479 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.476+0000 7f237db8f700 1 -- 172.21.15.186:0/1849637514 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2378108bf0 con 0x7f2378102820 2023-12-17T12:00:35.479 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.477+0000 7f2374ff9700 1 -- 172.21.15.186:0/1849637514 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7f236c0047a0 con 0x7f2378102820 2023-12-17T12:00:35.481 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.478+0000 7f2374ff9700 1 --2- 172.21.15.186:0/1849637514 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f23600a1500 0x7f23600a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:35.481 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.479+0000 7f2374ff9700 1 -- 172.21.15.186:0/1849637514 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5426+0+0 (secure 0 0 0) 0x7f236c0cd0c0 con 0x7f2378102820 2023-12-17T12:00:35.481 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.479+0000 7f23777fe700 1 --2- 172.21.15.186:0/1849637514 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f23600a1500 0x7f23600a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:35.482 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.480+0000 7f23777fe700 1 --2- 172.21.15.186:0/1849637514 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f23600a1500 0x7f23600a39c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2378102680 tx=0x7f2368007400 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:35.485 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.483+0000 7f2374ff9700 1 -- 172.21.15.186:0/1849637514 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f236c09ad60 con 0x7f2378102820 2023-12-17T12:00:35.697 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:35.695+0000 7f237db8f700 1 -- 172.21.15.186:0/1849637514 --> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f2378061a10 con 0x7f23600a1500 2023-12-17T12:00:35.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:35 smithi100 ceph-mon[41266]: purged_snaps scrub starts 2023-12-17T12:00:35.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:35 smithi100 ceph-mon[41266]: purged_snaps scrub ok 2023-12-17T12:00:35.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:35 smithi100 ceph-mon[41266]: osd.7 [v2:172.21.15.100:6816/1631494583,v1:172.21.15.100:6817/1631494583] boot 2023-12-17T12:00:35.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:35 smithi100 ceph-mon[41266]: osdmap e50: 8 total, 8 up, 8 in 2023-12-17T12:00:35.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:35 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-17T12:00:35.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:35 smithi100 ceph-mon[41266]: osdmap e51: 8 total, 8 up, 8 in 2023-12-17T12:00:35.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:35 smithi100 ceph-mon[41266]: pgmap v165: 1 pgs: 1 remapped+peering; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-17T12:00:35.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:35 smithi186 ceph-mon[41182]: purged_snaps scrub starts 2023-12-17T12:00:35.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:35 smithi186 ceph-mon[41182]: purged_snaps scrub ok 2023-12-17T12:00:35.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:35 smithi186 ceph-mon[41182]: osd.7 [v2:172.21.15.100:6816/1631494583,v1:172.21.15.100:6817/1631494583] boot 2023-12-17T12:00:35.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:35 smithi186 ceph-mon[41182]: osdmap e50: 8 total, 8 up, 8 in 2023-12-17T12:00:35.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:35 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-17T12:00:35.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:35 smithi186 ceph-mon[41182]: osdmap e51: 8 total, 8 up, 8 in 2023-12-17T12:00:35.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:35 smithi186 ceph-mon[41182]: pgmap v165: 1 pgs: 1 remapped+peering; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-17T12:00:35.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:35 smithi008 ceph-mon[36830]: purged_snaps scrub starts 2023-12-17T12:00:35.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:35 smithi008 ceph-mon[36830]: purged_snaps scrub ok 2023-12-17T12:00:35.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:35 smithi008 ceph-mon[36830]: osd.7 [v2:172.21.15.100:6816/1631494583,v1:172.21.15.100:6817/1631494583] boot 2023-12-17T12:00:35.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:35 smithi008 ceph-mon[36830]: osdmap e50: 8 total, 8 up, 8 in 2023-12-17T12:00:35.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:35 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-12-17T12:00:35.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:35 smithi008 ceph-mon[36830]: osdmap e51: 8 total, 8 up, 8 in 2023-12-17T12:00:35.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:35 smithi008 ceph-mon[36830]: pgmap v165: 1 pgs: 1 remapped+peering; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-17T12:00:36.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:36 smithi100 ceph-mon[41266]: from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:00:36.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:36 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T12:00:36.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:36 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T12:00:36.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:36 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:36.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:36 smithi100 ceph-mon[41266]: osdmap e52: 8 total, 8 up, 8 in 2023-12-17T12:00:36.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:36 smithi186 ceph-mon[41182]: from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:00:36.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:36 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T12:00:36.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:36 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T12:00:36.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:36 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:36.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:36 smithi186 ceph-mon[41182]: osdmap e52: 8 total, 8 up, 8 in 2023-12-17T12:00:36.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:36 smithi008 ceph-mon[36830]: from='client.24316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:00:36.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:36 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T12:00:36.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:36 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T12:00:36.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:36 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:36.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:36 smithi008 ceph-mon[36830]: osdmap e52: 8 total, 8 up, 8 in 2023-12-17T12:00:38.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:37 smithi186 ceph-mon[41182]: osdmap e53: 8 total, 8 up, 8 in 2023-12-17T12:00:38.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:37 smithi186 ceph-mon[41182]: pgmap v168: 1 pgs: 1 remapped+peering; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-17T12:00:38.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:37 smithi008 ceph-mon[36830]: osdmap e53: 8 total, 8 up, 8 in 2023-12-17T12:00:38.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:37 smithi008 ceph-mon[36830]: pgmap v168: 1 pgs: 1 remapped+peering; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-17T12:00:38.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:37 smithi100 ceph-mon[41266]: osdmap e53: 8 total, 8 up, 8 in 2023-12-17T12:00:38.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:37 smithi100 ceph-mon[41266]: pgmap v168: 1 pgs: 1 remapped+peering; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-17T12:00:39.225 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:38 smithi186 ceph-mon[41182]: osdmap e54: 8 total, 8 up, 8 in 2023-12-17T12:00:39.225 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:38 smithi186 ceph-mon[41182]: from='client.? 172.21.15.186:0/3671842379' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e3414f7f-7665-406f-89ec-79cbb3d3e274"}]: dispatch 2023-12-17T12:00:39.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:38 smithi186 ceph-mon[41182]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e3414f7f-7665-406f-89ec-79cbb3d3e274"}]: dispatch 2023-12-17T12:00:39.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:38 smithi186 ceph-mon[41182]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e3414f7f-7665-406f-89ec-79cbb3d3e274"}]': finished 2023-12-17T12:00:39.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:38 smithi186 ceph-mon[41182]: osdmap e55: 9 total, 8 up, 9 in 2023-12-17T12:00:39.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:38 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-17T12:00:39.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:38 smithi008 ceph-mon[36830]: osdmap e54: 8 total, 8 up, 8 in 2023-12-17T12:00:39.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:38 smithi008 ceph-mon[36830]: from='client.? 172.21.15.186:0/3671842379' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e3414f7f-7665-406f-89ec-79cbb3d3e274"}]: dispatch 2023-12-17T12:00:39.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:38 smithi008 ceph-mon[36830]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e3414f7f-7665-406f-89ec-79cbb3d3e274"}]: dispatch 2023-12-17T12:00:39.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:38 smithi008 ceph-mon[36830]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e3414f7f-7665-406f-89ec-79cbb3d3e274"}]': finished 2023-12-17T12:00:39.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:38 smithi008 ceph-mon[36830]: osdmap e55: 9 total, 8 up, 9 in 2023-12-17T12:00:39.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:38 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-17T12:00:39.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:38 smithi100 ceph-mon[41266]: osdmap e54: 8 total, 8 up, 8 in 2023-12-17T12:00:39.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:38 smithi100 ceph-mon[41266]: from='client.? 172.21.15.186:0/3671842379' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e3414f7f-7665-406f-89ec-79cbb3d3e274"}]: dispatch 2023-12-17T12:00:39.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:38 smithi100 ceph-mon[41266]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e3414f7f-7665-406f-89ec-79cbb3d3e274"}]: dispatch 2023-12-17T12:00:39.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:38 smithi100 ceph-mon[41266]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e3414f7f-7665-406f-89ec-79cbb3d3e274"}]': finished 2023-12-17T12:00:39.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:38 smithi100 ceph-mon[41266]: osdmap e55: 9 total, 8 up, 9 in 2023-12-17T12:00:39.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:38 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-17T12:00:40.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:39 smithi186 ceph-mon[41182]: from='client.? 172.21.15.186:0/1481401591' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T12:00:40.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:39 smithi186 ceph-mon[41182]: pgmap v171: 1 pgs: 1 remapped+peering; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-17T12:00:40.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:39 smithi008 ceph-mon[36830]: from='client.? 172.21.15.186:0/1481401591' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T12:00:40.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:39 smithi008 ceph-mon[36830]: pgmap v171: 1 pgs: 1 remapped+peering; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-17T12:00:40.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:39 smithi100 ceph-mon[41266]: from='client.? 172.21.15.186:0/1481401591' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T12:00:40.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:39 smithi100 ceph-mon[41266]: pgmap v171: 1 pgs: 1 remapped+peering; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-17T12:00:42.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:42 smithi186 ceph-mon[41182]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-17T12:00:42.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:42 smithi008 ceph-mon[36830]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-17T12:00:42.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:42 smithi100 ceph-mon[41266]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-17T12:00:44.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:44 smithi186 ceph-mon[41182]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-17T12:00:44.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:44 smithi008 ceph-mon[36830]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-17T12:00:44.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:44 smithi100 ceph-mon[41266]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-17T12:00:45.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:45 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-12-17T12:00:45.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:45 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:45.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:45 smithi186 ceph-mon[41182]: Deploying daemon osd.8 on smithi186 2023-12-17T12:00:45.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:45 smithi186 ceph-mon[41182]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-17T12:00:46.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:45 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-12-17T12:00:46.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:45 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:46.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:45 smithi008 ceph-mon[36830]: Deploying daemon osd.8 on smithi186 2023-12-17T12:00:46.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:45 smithi008 ceph-mon[36830]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-17T12:00:46.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:45 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-12-17T12:00:46.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:45 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:46.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:45 smithi100 ceph-mon[41266]: Deploying daemon osd.8 on smithi186 2023-12-17T12:00:46.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:45 smithi100 ceph-mon[41266]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-17T12:00:48.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:48 smithi186 ceph-mon[41182]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-17T12:00:48.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:48 smithi008 ceph-mon[36830]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-17T12:00:48.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:48 smithi100 ceph-mon[41266]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-17T12:00:50.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:50 smithi186 ceph-mon[41182]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-17T12:00:50.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:50 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:50.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:50 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:50.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:50 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:00:50.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:50 smithi008 ceph-mon[36830]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-17T12:00:50.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:50 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:50.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:50 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:50.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:50 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:00:50.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:50 smithi100 ceph-mon[41266]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-17T12:00:50.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:50 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:50.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:50 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:50.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:50 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:00:52.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:52 smithi008 ceph-mon[36830]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-17T12:00:52.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:52 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:52.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:52 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:52.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:52 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:52.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:52 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:00:52.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:52 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:52.823 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:52 smithi186 ceph-mon[41182]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-17T12:00:52.823 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:52 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:52.823 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:52 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:52.823 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:52 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:52.823 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:52 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:00:52.823 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:52 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:52.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:52 smithi100 ceph-mon[41266]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-17T12:00:52.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:52 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:52.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:52 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:52.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:52 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:52.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:52 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:00:52.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:52 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:53.266 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:53.263+0000 7f2374ff9700 1 -- 172.21.15.186:0/1849637514 <== mgr.14154 v2:172.21.15.8:6800/268548699 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f2378061a10 con 0x7f23600a1500 2023-12-17T12:00:53.266 INFO:teuthology.orchestra.run.smithi186.stdout:Created osd(s) 8 on host 'smithi186' 2023-12-17T12:00:53.268 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:53.266+0000 7f237db8f700 1 -- 172.21.15.186:0/1849637514 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f23600a1500 msgr2=0x7f23600a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:53.268 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:53.266+0000 7f237db8f700 1 --2- 172.21.15.186:0/1849637514 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f23600a1500 0x7f23600a39c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2378102680 tx=0x7f2368007400 comp rx=0 tx=0).stop 2023-12-17T12:00:53.268 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:53.266+0000 7f237db8f700 1 -- 172.21.15.186:0/1849637514 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2378102820 msgr2=0x7f23780739c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:53.269 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:53.266+0000 7f237db8f700 1 --2- 172.21.15.186:0/1849637514 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2378102820 0x7f23780739c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f236c000c00 tx=0x7f236c004730 comp rx=0 tx=0).stop 2023-12-17T12:00:53.269 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:53.266+0000 7f237db8f700 1 -- 172.21.15.186:0/1849637514 shutdown_connections 2023-12-17T12:00:53.269 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:53.266+0000 7f237db8f700 1 --2- 172.21.15.186:0/1849637514 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f23600a1500 0x7f23600a39c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:53.269 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:53.266+0000 7f237db8f700 1 --2- 172.21.15.186:0/1849637514 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f23781031c0 0x7f2378073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:53.269 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:53.266+0000 7f237db8f700 1 --2- 172.21.15.186:0/1849637514 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2378101620 0x7f23780752d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:53.269 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:53.266+0000 7f237db8f700 1 --2- 172.21.15.186:0/1849637514 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2378102820 0x7f23780739c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:53.269 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:53.266+0000 7f237db8f700 1 -- 172.21.15.186:0/1849637514 >> 172.21.15.186:0/1849637514 conn(0x7f23780fcbc0 msgr2=0x7f2378105d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:53.269 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:53.266+0000 7f237db8f700 1 -- 172.21.15.186:0/1849637514 shutdown_connections 2023-12-17T12:00:53.269 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:00:53.266+0000 7f237db8f700 1 -- 172.21.15.186:0/1849637514 wait complete. 2023-12-17T12:00:53.714 DEBUG:teuthology.orchestra.run.smithi186:osd.8> sudo journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.8.service 2023-12-17T12:00:53.718 INFO:tasks.cephadm:Deploying osd.9 on smithi008 with /dev/vg_nvme/lv_1... 2023-12-17T12:00:53.719 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-12-17T12:00:53.797 INFO:journalctl@ceph.osd.8.smithi186.stdout:-- Logs begin at Sun 2023-12-17 11:40:47 UTC. -- 2023-12-17T12:00:54.145 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:00:54.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:54 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:54.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:54 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:54.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:54 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:00:54.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:54 smithi186 ceph-mon[41182]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-17T12:00:54.476 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:00:54 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:00:54.307+0000 7f6a6b9a5640 -1 osd.8 0 log_to_monitors true 2023-12-17T12:00:54.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:54 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:54.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:54 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:54.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:54 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:00:54.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:54 smithi008 ceph-mon[36830]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-17T12:00:54.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:54 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:54.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:54 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:54.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:54 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:00:54.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:54 smithi100 ceph-mon[41266]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-17T12:00:55.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:55 smithi186 ceph-mon[41182]: from='osd.8 [v2:172.21.15.186:6816/3569004799,v1:172.21.15.186:6817/3569004799]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-12-17T12:00:55.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:55 smithi008 ceph-mon[36830]: from='osd.8 [v2:172.21.15.186:6816/3569004799,v1:172.21.15.186:6817/3569004799]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-12-17T12:00:55.668 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:55 smithi100 ceph-mon[41266]: from='osd.8 [v2:172.21.15.186:6816/3569004799,v1:172.21.15.186:6817/3569004799]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-12-17T12:00:55.914 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-12-17T12:00:55.914 INFO:teuthology.orchestra.run.smithi008.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-12-17T12:00:55.914 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 10+0 records in 2023-12-17T12:00:55.914 INFO:teuthology.orchestra.run.smithi008.stderr:10+0 records out 2023-12-17T12:00:55.915 INFO:teuthology.orchestra.run.smithi008.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0311045 s, 337 MB/s 2023-12-17T12:00:55.915 INFO:teuthology.orchestra.run.smithi008.stderr:--> Zapping successful for: 2023-12-17T12:00:56.296 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi008:vg_nvme/lv_1 2023-12-17T12:00:56.475 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:00:56 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:00:56.242+0000 7f6a6101c700 -1 osd.8 0 waiting for initial osdmap 2023-12-17T12:00:56.475 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:00:56 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:00:56.260+0000 7f6a5ce16700 -1 osd.8 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-17T12:00:56.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:56 smithi186 ceph-mon[41182]: from='osd.8 [v2:172.21.15.186:6816/3569004799,v1:172.21.15.186:6817/3569004799]' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-12-17T12:00:56.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:56 smithi186 ceph-mon[41182]: osdmap e56: 9 total, 8 up, 9 in 2023-12-17T12:00:56.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:56 smithi186 ceph-mon[41182]: from='osd.8 [v2:172.21.15.186:6816/3569004799,v1:172.21.15.186:6817/3569004799]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-12-17T12:00:56.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:56 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-17T12:00:56.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:56 smithi186 ceph-mon[41182]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-17T12:00:56.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:56 smithi008 ceph-mon[36830]: from='osd.8 [v2:172.21.15.186:6816/3569004799,v1:172.21.15.186:6817/3569004799]' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-12-17T12:00:56.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:56 smithi008 ceph-mon[36830]: osdmap e56: 9 total, 8 up, 9 in 2023-12-17T12:00:56.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:56 smithi008 ceph-mon[36830]: from='osd.8 [v2:172.21.15.186:6816/3569004799,v1:172.21.15.186:6817/3569004799]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-12-17T12:00:56.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:56 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-17T12:00:56.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:56 smithi008 ceph-mon[36830]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-17T12:00:56.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:56 smithi100 ceph-mon[41266]: from='osd.8 [v2:172.21.15.186:6816/3569004799,v1:172.21.15.186:6817/3569004799]' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-12-17T12:00:56.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:56 smithi100 ceph-mon[41266]: osdmap e56: 9 total, 8 up, 9 in 2023-12-17T12:00:56.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:56 smithi100 ceph-mon[41266]: from='osd.8 [v2:172.21.15.186:6816/3569004799,v1:172.21.15.186:6817/3569004799]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-12-17T12:00:56.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:56 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-17T12:00:56.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:56 smithi100 ceph-mon[41266]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-17T12:00:56.727 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:00:57.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:57 smithi008 ceph-mon[36830]: from='osd.8 [v2:172.21.15.186:6816/3569004799,v1:172.21.15.186:6817/3569004799]' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2023-12-17T12:00:57.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:57 smithi008 ceph-mon[36830]: osdmap e57: 9 total, 8 up, 9 in 2023-12-17T12:00:57.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:57 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-17T12:00:57.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:57 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-17T12:00:57.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:57 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:57.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:57 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:57.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:57 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:00:57.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:57 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:00:57.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:57 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:00:57.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:57 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:57.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:57 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:57.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:57 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:00:57.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:57 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:57.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:57 smithi100 ceph-mon[41266]: from='osd.8 [v2:172.21.15.186:6816/3569004799,v1:172.21.15.186:6817/3569004799]' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2023-12-17T12:00:57.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:57 smithi100 ceph-mon[41266]: osdmap e57: 9 total, 8 up, 9 in 2023-12-17T12:00:57.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:57 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-17T12:00:57.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:57 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-17T12:00:57.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:57 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:57.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:57 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:57.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:57 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:00:57.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:57 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:00:57.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:57 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:00:57.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:57 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:57.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:57 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:57.667 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:57 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:00:57.667 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:57 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:57.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:57 smithi186 ceph-mon[41182]: from='osd.8 [v2:172.21.15.186:6816/3569004799,v1:172.21.15.186:6817/3569004799]' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2023-12-17T12:00:57.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:57 smithi186 ceph-mon[41182]: osdmap e57: 9 total, 8 up, 9 in 2023-12-17T12:00:57.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:57 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-17T12:00:57.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:57 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-17T12:00:57.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:57 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:57.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:57 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:57.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:57 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:00:57.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:57 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:00:57.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:57 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:00:57.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:57 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:57.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:57 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:57.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:57 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:00:57.727 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:57 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:00:57.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.934+0000 7f2927350700 1 -- 172.21.15.8:0/1657210501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2920102820 msgr2=0x7f2920102c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:57.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.934+0000 7f2927350700 1 --2- 172.21.15.8:0/1657210501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2920102820 0x7f2920102c80 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f29100099c0 tx=0x7f2910009cd0 comp rx=0 tx=0).stop 2023-12-17T12:00:57.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.934+0000 7f2927350700 1 -- 172.21.15.8:0/1657210501 shutdown_connections 2023-12-17T12:00:57.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.934+0000 7f2927350700 1 --2- 172.21.15.8:0/1657210501 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f29201031c0 0x7f2920109a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:57.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.934+0000 7f2927350700 1 --2- 172.21.15.8:0/1657210501 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2920101620 0x7f2920101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:57.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.934+0000 7f2927350700 1 --2- 172.21.15.8:0/1657210501 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2920102820 0x7f2920102c80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:57.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.934+0000 7f2927350700 1 -- 172.21.15.8:0/1657210501 >> 172.21.15.8:0/1657210501 conn(0x7f29200fcbe0 msgr2=0x7f29200ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:00:57.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.934+0000 7f2927350700 1 -- 172.21.15.8:0/1657210501 shutdown_connections 2023-12-17T12:00:57.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.934+0000 7f2927350700 1 -- 172.21.15.8:0/1657210501 wait complete. 2023-12-17T12:00:57.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.936+0000 7f2927350700 1 Processor -- start 2023-12-17T12:00:57.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.936+0000 7f2927350700 1 -- start start 2023-12-17T12:00:57.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.936+0000 7f2927350700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2920101620 0x7f29201996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:57.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.936+0000 7f2927350700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2920102820 0x7f2920199bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:57.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.936+0000 7f2927350700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29201031c0 0x7f29201a0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:57.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.936+0000 7f2927350700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29201a11f0 con 0x7f2920101620 2023-12-17T12:00:57.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.936+0000 7f2927350700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29201a1330 con 0x7f29201031c0 2023-12-17T12:00:57.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.936+0000 7f2927350700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29201a14c0 con 0x7f2920102820 2023-12-17T12:00:57.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.936+0000 7f29250ec700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2920101620 0x7f29201996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:57.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.936+0000 7f29250ec700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2920101620 0x7f29201996b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:43470/0 (socket says 172.21.15.8:43470) 2023-12-17T12:00:57.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.936+0000 7f29250ec700 1 -- 172.21.15.8:0/2189285494 learned_addr learned my addr 172.21.15.8:0/2189285494 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:00:57.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.937+0000 7f29248eb700 1 --2- 172.21.15.8:0/2189285494 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2920102820 0x7f2920199bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:57.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.937+0000 7f29258ed700 1 --2- 172.21.15.8:0/2189285494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29201031c0 0x7f29201a0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:57.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.937+0000 7f29250ec700 1 -- 172.21.15.8:0/2189285494 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2920102820 msgr2=0x7f2920199bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:57.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.937+0000 7f29250ec700 1 --2- 172.21.15.8:0/2189285494 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2920102820 0x7f2920199bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:57.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.937+0000 7f29250ec700 1 -- 172.21.15.8:0/2189285494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29201031c0 msgr2=0x7f29201a0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:00:57.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.937+0000 7f29250ec700 1 --2- 172.21.15.8:0/2189285494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29201031c0 0x7f29201a0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:00:57.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.937+0000 7f29250ec700 1 -- 172.21.15.8:0/2189285494 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29100095f0 con 0x7f2920101620 2023-12-17T12:00:57.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.937+0000 7f29250ec700 1 --2- 172.21.15.8:0/2189285494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2920101620 0x7f29201996b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f291c00d9b0 tx=0x7f291c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:57.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.937+0000 7f29167fc700 1 -- 172.21.15.8:0/2189285494 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291c00b950 con 0x7f2920101620 2023-12-17T12:00:57.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.937+0000 7f29167fc700 1 -- 172.21.15.8:0/2189285494 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f291c007620 con 0x7f2920101620 2023-12-17T12:00:57.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.937+0000 7f2927350700 1 -- 172.21.15.8:0/2189285494 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29201a17a0 con 0x7f2920101620 2023-12-17T12:00:57.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.937+0000 7f29167fc700 1 -- 172.21.15.8:0/2189285494 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f291c00f3c0 con 0x7f2920101620 2023-12-17T12:00:57.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.938+0000 7f2927350700 1 -- 172.21.15.8:0/2189285494 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29201a1ca0 con 0x7f2920101620 2023-12-17T12:00:57.942 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.939+0000 7f2927350700 1 -- 172.21.15.8:0/2189285494 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2920193d20 con 0x7f2920101620 2023-12-17T12:00:57.943 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.940+0000 7f29167fc700 1 -- 172.21.15.8:0/2189285494 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7f291c00bab0 con 0x7f2920101620 2023-12-17T12:00:57.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.942+0000 7f29167fc700 1 --2- 172.21.15.8:0/2189285494 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f290c0a1480 0x7f290c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:00:57.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.942+0000 7f29167fc700 1 -- 172.21.15.8:0/2189285494 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5862+0+0 (secure 0 0 0) 0x7f291c0cc630 con 0x7f2920101620 2023-12-17T12:00:57.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.942+0000 7f29248eb700 1 --2- 172.21.15.8:0/2189285494 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f290c0a1480 0x7f290c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:00:57.945 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.943+0000 7f29248eb700 1 --2- 172.21.15.8:0/2189285494 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f290c0a1480 0x7f290c0a3940 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f291000b580 tx=0x7f2910005e80 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:00:57.949 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:57.946+0000 7f29167fc700 1 -- 172.21.15.8:0/2189285494 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f291c096580 con 0x7f2920101620 2023-12-17T12:00:58.173 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:00:58.171+0000 7f2927350700 1 -- 172.21.15.8:0/2189285494 --> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f2920061a10 con 0x7f290c0a1480 2023-12-17T12:00:58.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:58 smithi008 ceph-mon[36830]: purged_snaps scrub starts 2023-12-17T12:00:58.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:58 smithi008 ceph-mon[36830]: purged_snaps scrub ok 2023-12-17T12:00:58.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:58 smithi008 ceph-mon[36830]: Detected new or changed devices on smithi186 2023-12-17T12:00:58.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:58 smithi008 ceph-mon[36830]: Adjusting osd_memory_target on smithi186 to 5757M 2023-12-17T12:00:58.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:58 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-17T12:00:58.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:58 smithi008 ceph-mon[36830]: osd.8 [v2:172.21.15.186:6816/3569004799,v1:172.21.15.186:6817/3569004799] boot 2023-12-17T12:00:58.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:58 smithi008 ceph-mon[36830]: osdmap e58: 9 total, 9 up, 9 in 2023-12-17T12:00:58.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:58 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-17T12:00:58.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:58 smithi008 ceph-mon[36830]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-17T12:00:58.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:58 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T12:00:58.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:58 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T12:00:58.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:58 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:58.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:58 smithi100 ceph-mon[41266]: purged_snaps scrub starts 2023-12-17T12:00:58.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:58 smithi100 ceph-mon[41266]: purged_snaps scrub ok 2023-12-17T12:00:58.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:58 smithi100 ceph-mon[41266]: Detected new or changed devices on smithi186 2023-12-17T12:00:58.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:58 smithi100 ceph-mon[41266]: Adjusting osd_memory_target on smithi186 to 5757M 2023-12-17T12:00:58.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:58 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-17T12:00:58.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:58 smithi100 ceph-mon[41266]: osd.8 [v2:172.21.15.186:6816/3569004799,v1:172.21.15.186:6817/3569004799] boot 2023-12-17T12:00:58.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:58 smithi100 ceph-mon[41266]: osdmap e58: 9 total, 9 up, 9 in 2023-12-17T12:00:58.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:58 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-17T12:00:58.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:58 smithi100 ceph-mon[41266]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-17T12:00:58.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:58 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T12:00:58.667 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:58 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T12:00:58.667 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:58 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:58.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:58 smithi186 ceph-mon[41182]: purged_snaps scrub starts 2023-12-17T12:00:58.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:58 smithi186 ceph-mon[41182]: purged_snaps scrub ok 2023-12-17T12:00:58.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:58 smithi186 ceph-mon[41182]: Detected new or changed devices on smithi186 2023-12-17T12:00:58.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:58 smithi186 ceph-mon[41182]: Adjusting osd_memory_target on smithi186 to 5757M 2023-12-17T12:00:58.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:58 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-17T12:00:58.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:58 smithi186 ceph-mon[41182]: osd.8 [v2:172.21.15.186:6816/3569004799,v1:172.21.15.186:6817/3569004799] boot 2023-12-17T12:00:58.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:58 smithi186 ceph-mon[41182]: osdmap e58: 9 total, 9 up, 9 in 2023-12-17T12:00:58.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:58 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-12-17T12:00:58.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:58 smithi186 ceph-mon[41182]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-12-17T12:00:58.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:58 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T12:00:58.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:58 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T12:00:58.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:58 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:00:59.464 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:59 smithi008 ceph-mon[36830]: from='client.14460 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:00:59.464 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:00:59 smithi008 ceph-mon[36830]: osdmap e59: 9 total, 9 up, 9 in 2023-12-17T12:00:59.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:59 smithi100 ceph-mon[41266]: from='client.14460 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:00:59.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:00:59 smithi100 ceph-mon[41266]: osdmap e59: 9 total, 9 up, 9 in 2023-12-17T12:00:59.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:59 smithi186 ceph-mon[41182]: from='client.14460 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi008:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:00:59.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:00:59 smithi186 ceph-mon[41182]: osdmap e59: 9 total, 9 up, 9 in 2023-12-17T12:01:00.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:00 smithi100 ceph-mon[41266]: osdmap e60: 9 total, 9 up, 9 in 2023-12-17T12:01:00.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:00 smithi100 ceph-mon[41266]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail 2023-12-17T12:01:00.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:00 smithi100 ceph-mon[41266]: osdmap e61: 9 total, 9 up, 9 in 2023-12-17T12:01:00.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:00 smithi186 ceph-mon[41182]: osdmap e60: 9 total, 9 up, 9 in 2023-12-17T12:01:00.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:00 smithi186 ceph-mon[41182]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail 2023-12-17T12:01:00.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:00 smithi186 ceph-mon[41182]: osdmap e61: 9 total, 9 up, 9 in 2023-12-17T12:01:00.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:00 smithi008 ceph-mon[36830]: osdmap e60: 9 total, 9 up, 9 in 2023-12-17T12:01:00.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:00 smithi008 ceph-mon[36830]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail 2023-12-17T12:01:00.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:00 smithi008 ceph-mon[36830]: osdmap e61: 9 total, 9 up, 9 in 2023-12-17T12:01:01.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:01 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/2460274771' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b04f519d-6e44-4158-b6e1-aa4d64be3404"}]: dispatch 2023-12-17T12:01:01.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:01 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/2460274771' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b04f519d-6e44-4158-b6e1-aa4d64be3404"}]': finished 2023-12-17T12:01:01.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:01 smithi100 ceph-mon[41266]: osdmap e62: 10 total, 9 up, 10 in 2023-12-17T12:01:01.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:01 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-17T12:01:01.521 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:01 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/2460274771' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b04f519d-6e44-4158-b6e1-aa4d64be3404"}]: dispatch 2023-12-17T12:01:01.521 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:01 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/2460274771' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b04f519d-6e44-4158-b6e1-aa4d64be3404"}]': finished 2023-12-17T12:01:01.521 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:01 smithi186 ceph-mon[41182]: osdmap e62: 10 total, 9 up, 10 in 2023-12-17T12:01:01.521 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:01 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-17T12:01:01.535 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:01 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/2460274771' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b04f519d-6e44-4158-b6e1-aa4d64be3404"}]: dispatch 2023-12-17T12:01:01.535 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:01 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/2460274771' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b04f519d-6e44-4158-b6e1-aa4d64be3404"}]': finished 2023-12-17T12:01:01.535 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:01 smithi008 ceph-mon[36830]: osdmap e62: 10 total, 9 up, 10 in 2023-12-17T12:01:01.535 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:01 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-17T12:01:02.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:02 smithi100 ceph-mon[41266]: pgmap v189: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-12-17T12:01:02.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:02 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/722616744' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T12:01:02.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:02 smithi186 ceph-mon[41182]: pgmap v189: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-12-17T12:01:02.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:02 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/722616744' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T12:01:02.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:02 smithi008 ceph-mon[36830]: pgmap v189: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-12-17T12:01:02.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:02 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/722616744' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T12:01:04.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:04 smithi186 ceph-mon[41182]: pgmap v190: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 112 KiB/s, 0 objects/s recovering 2023-12-17T12:01:04.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:04 smithi008 ceph-mon[36830]: pgmap v190: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 112 KiB/s, 0 objects/s recovering 2023-12-17T12:01:04.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:04 smithi100 ceph-mon[41266]: pgmap v190: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 112 KiB/s, 0 objects/s recovering 2023-12-17T12:01:06.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:05 smithi186 ceph-mon[41182]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 94 KiB/s, 0 objects/s recovering 2023-12-17T12:01:06.244 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:05 smithi008 ceph-mon[36830]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 94 KiB/s, 0 objects/s recovering 2023-12-17T12:01:06.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:05 smithi100 ceph-mon[41266]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 94 KiB/s, 0 objects/s recovering 2023-12-17T12:01:08.619 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:08 smithi008 ceph-mon[36830]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-12-17T12:01:08.619 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:08 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-12-17T12:01:08.619 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:08 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:08.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:08 smithi186 ceph-mon[41182]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-12-17T12:01:08.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:08 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-12-17T12:01:08.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:08 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:08.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:08 smithi100 ceph-mon[41266]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-12-17T12:01:08.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:08 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-12-17T12:01:08.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:08 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:09.698 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:09 smithi008 ceph-mon[36830]: Deploying daemon osd.9 on smithi008 2023-12-17T12:01:09.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:09 smithi100 ceph-mon[41266]: Deploying daemon osd.9 on smithi008 2023-12-17T12:01:09.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:09 smithi186 ceph-mon[41182]: Deploying daemon osd.9 on smithi008 2023-12-17T12:01:10.712 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:10 smithi008 ceph-mon[36830]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-17T12:01:10.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:10 smithi100 ceph-mon[41266]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-17T12:01:10.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:10 smithi186 ceph-mon[41182]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-17T12:01:12.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:12 smithi008 ceph-mon[36830]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-17T12:01:12.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:12 smithi100 ceph-mon[41266]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-17T12:01:12.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:12 smithi186 ceph-mon[41182]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-17T12:01:14.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:14 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:14.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:14 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:14.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:14 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:01:14.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:14 smithi100 ceph-mon[41266]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-17T12:01:14.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:14 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:14.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:14 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:14.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:14 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:01:14.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:14 smithi186 ceph-mon[41182]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-17T12:01:14.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:14 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:14.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:14 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:14.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:14 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:01:14.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:14 smithi008 ceph-mon[36830]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-17T12:01:16.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:01:16.222+0000 7f29167fc700 1 -- 172.21.15.8:0/2189285494 <== mgr.14154 v2:172.21.15.8:6800/268548699 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f2920061a10 con 0x7f290c0a1480 2023-12-17T12:01:16.226 INFO:teuthology.orchestra.run.smithi008.stdout:Created osd(s) 9 on host 'smithi008' 2023-12-17T12:01:16.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:01:16.225+0000 7f2927350700 1 -- 172.21.15.8:0/2189285494 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f290c0a1480 msgr2=0x7f290c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:16.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:01:16.225+0000 7f2927350700 1 --2- 172.21.15.8:0/2189285494 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f290c0a1480 0x7f290c0a3940 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f291000b580 tx=0x7f2910005e80 comp rx=0 tx=0).stop 2023-12-17T12:01:16.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:01:16.225+0000 7f2927350700 1 -- 172.21.15.8:0/2189285494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2920101620 msgr2=0x7f29201996b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:16.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:01:16.225+0000 7f2927350700 1 --2- 172.21.15.8:0/2189285494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2920101620 0x7f29201996b0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f291c00d9b0 tx=0x7f291c00dcc0 comp rx=0 tx=0).stop 2023-12-17T12:01:16.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:01:16.225+0000 7f2927350700 1 -- 172.21.15.8:0/2189285494 shutdown_connections 2023-12-17T12:01:16.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:01:16.225+0000 7f2927350700 1 --2- 172.21.15.8:0/2189285494 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f290c0a1480 0x7f290c0a3940 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:16.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:01:16.225+0000 7f2927350700 1 --2- 172.21.15.8:0/2189285494 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f29201031c0 0x7f29201a0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:16.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:01:16.225+0000 7f2927350700 1 --2- 172.21.15.8:0/2189285494 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2920101620 0x7f29201996b0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:16.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:01:16.225+0000 7f2927350700 1 --2- 172.21.15.8:0/2189285494 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2920102820 0x7f2920199bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:16.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:01:16.225+0000 7f2927350700 1 -- 172.21.15.8:0/2189285494 >> 172.21.15.8:0/2189285494 conn(0x7f29200fcbe0 msgr2=0x7f29201080e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:01:16.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:01:16.225+0000 7f2927350700 1 -- 172.21.15.8:0/2189285494 shutdown_connections 2023-12-17T12:01:16.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:01:16.225+0000 7f2927350700 1 -- 172.21.15.8:0/2189285494 wait complete. 2023-12-17T12:01:16.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:16 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:16.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:16 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:16.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:16 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:16.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:16 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:01:16.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:16 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:16.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:16 smithi100 ceph-mon[41266]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-17T12:01:16.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:16 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:16.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:16 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:16.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:16 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:16.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:16 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:01:16.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:16 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:16.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:16 smithi186 ceph-mon[41182]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-17T12:01:16.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:16 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:16.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:16 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:16.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:16 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:16.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:16 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:01:16.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:16 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:16.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:16 smithi008 ceph-mon[36830]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-17T12:01:16.768 DEBUG:teuthology.orchestra.run.smithi008:osd.9> sudo journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.9.service 2023-12-17T12:01:16.773 INFO:tasks.cephadm:Deploying osd.10 on smithi100 with /dev/vg_nvme/lv_1... 2023-12-17T12:01:16.773 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-12-17T12:01:16.862 INFO:journalctl@ceph.osd.9.smithi008.stdout:-- Logs begin at Sun 2023-12-17 11:40:41 UTC. -- 2023-12-17T12:01:17.185 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.b/config 2023-12-17T12:01:17.401 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:17 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:17.401 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:17 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:17.401 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:17 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:01:17.401 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:17 smithi008 ceph-mon[36830]: from='osd.9 [v2:172.21.15.8:6826/3980647643,v1:172.21.15.8:6827/3980647643]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-12-17T12:01:17.402 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:01:17 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:01:17.152+0000 7f429bf75640 -1 osd.9 0 log_to_monitors true 2023-12-17T12:01:17.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:17 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:17.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:17 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:17.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:17 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:01:17.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:17 smithi186 ceph-mon[41182]: from='osd.9 [v2:172.21.15.8:6826/3980647643,v1:172.21.15.8:6827/3980647643]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-12-17T12:01:17.538 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:17 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:17.539 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:17 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:17.539 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:17 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:01:17.539 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:17 smithi100 ceph-mon[41266]: from='osd.9 [v2:172.21.15.8:6826/3980647643,v1:172.21.15.8:6827/3980647643]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-12-17T12:01:18.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:18 smithi186 ceph-mon[41182]: from='osd.9 [v2:172.21.15.8:6826/3980647643,v1:172.21.15.8:6827/3980647643]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-12-17T12:01:18.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:18 smithi186 ceph-mon[41182]: osdmap e63: 10 total, 9 up, 10 in 2023-12-17T12:01:18.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:18 smithi186 ceph-mon[41182]: from='osd.9 [v2:172.21.15.8:6826/3980647643,v1:172.21.15.8:6827/3980647643]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-12-17T12:01:18.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:18 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-17T12:01:18.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:18 smithi186 ceph-mon[41182]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-17T12:01:18.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:18 smithi008 ceph-mon[36830]: from='osd.9 [v2:172.21.15.8:6826/3980647643,v1:172.21.15.8:6827/3980647643]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-12-17T12:01:18.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:18 smithi008 ceph-mon[36830]: osdmap e63: 10 total, 9 up, 10 in 2023-12-17T12:01:18.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:18 smithi008 ceph-mon[36830]: from='osd.9 [v2:172.21.15.8:6826/3980647643,v1:172.21.15.8:6827/3980647643]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-12-17T12:01:18.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:18 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-17T12:01:18.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:18 smithi008 ceph-mon[36830]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-17T12:01:18.496 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:01:18 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:01:18.228+0000 7f42915ec700 -1 osd.9 0 waiting for initial osdmap 2023-12-17T12:01:18.496 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:01:18 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:01:18.247+0000 7f428b3e2700 -1 osd.9 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-17T12:01:18.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:18 smithi100 ceph-mon[41266]: from='osd.9 [v2:172.21.15.8:6826/3980647643,v1:172.21.15.8:6827/3980647643]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-12-17T12:01:18.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:18 smithi100 ceph-mon[41266]: osdmap e63: 10 total, 9 up, 10 in 2023-12-17T12:01:18.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:18 smithi100 ceph-mon[41266]: from='osd.9 [v2:172.21.15.8:6826/3980647643,v1:172.21.15.8:6827/3980647643]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]: dispatch 2023-12-17T12:01:18.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:18 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-17T12:01:18.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:18 smithi100 ceph-mon[41266]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-17T12:01:19.024 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-12-17T12:01:19.025 INFO:teuthology.orchestra.run.smithi100.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-12-17T12:01:19.025 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 10+0 records in 2023-12-17T12:01:19.025 INFO:teuthology.orchestra.run.smithi100.stderr:10+0 records out 2023-12-17T12:01:19.025 INFO:teuthology.orchestra.run.smithi100.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0429774 s, 244 MB/s 2023-12-17T12:01:19.025 INFO:teuthology.orchestra.run.smithi100.stderr:--> Zapping successful for: 2023-12-17T12:01:19.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:19 smithi100 ceph-mon[41266]: from='osd.9 [v2:172.21.15.8:6826/3980647643,v1:172.21.15.8:6827/3980647643]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-12-17T12:01:19.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:19 smithi100 ceph-mon[41266]: osdmap e64: 10 total, 9 up, 10 in 2023-12-17T12:01:19.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:19 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-17T12:01:19.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:19 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-17T12:01:19.451 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi100:vg_nvme/lv_1 2023-12-17T12:01:19.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:19 smithi186 ceph-mon[41182]: from='osd.9 [v2:172.21.15.8:6826/3980647643,v1:172.21.15.8:6827/3980647643]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-12-17T12:01:19.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:19 smithi186 ceph-mon[41182]: osdmap e64: 10 total, 9 up, 10 in 2023-12-17T12:01:19.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:19 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-17T12:01:19.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:19 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-17T12:01:19.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:19 smithi008 ceph-mon[36830]: from='osd.9 [v2:172.21.15.8:6826/3980647643,v1:172.21.15.8:6827/3980647643]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi008", "root=default"]}]': finished 2023-12-17T12:01:19.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:19 smithi008 ceph-mon[36830]: osdmap e64: 10 total, 9 up, 10 in 2023-12-17T12:01:19.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:19 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-17T12:01:19.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:19 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-17T12:01:19.852 INFO:teuthology.orchestra.run.smithi100.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.b/config 2023-12-17T12:01:20.351 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:20 smithi100 ceph-mon[41266]: purged_snaps scrub starts 2023-12-17T12:01:20.351 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:20 smithi100 ceph-mon[41266]: purged_snaps scrub ok 2023-12-17T12:01:20.351 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:20 smithi100 ceph-mon[41266]: osd.9 [v2:172.21.15.8:6826/3980647643,v1:172.21.15.8:6827/3980647643] boot 2023-12-17T12:01:20.351 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:20 smithi100 ceph-mon[41266]: osdmap e65: 10 total, 10 up, 10 in 2023-12-17T12:01:20.351 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:20 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-17T12:01:20.351 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:20 smithi100 ceph-mon[41266]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-17T12:01:20.352 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:20 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:20.352 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:20 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:20.352 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:20 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:01:20.352 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:20 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:01:20.352 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:20 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:01:20.352 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:20 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:01:20.352 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:20 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:20.352 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:20 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:20.352 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:20 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:01:20.352 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:20 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:20.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:20 smithi008 ceph-mon[36830]: purged_snaps scrub starts 2023-12-17T12:01:20.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:20 smithi008 ceph-mon[36830]: purged_snaps scrub ok 2023-12-17T12:01:20.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:20 smithi008 ceph-mon[36830]: osd.9 [v2:172.21.15.8:6826/3980647643,v1:172.21.15.8:6827/3980647643] boot 2023-12-17T12:01:20.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:20 smithi008 ceph-mon[36830]: osdmap e65: 10 total, 10 up, 10 in 2023-12-17T12:01:20.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:20 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-17T12:01:20.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:20 smithi008 ceph-mon[36830]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-17T12:01:20.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:20 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:20.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:20 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:20.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:20 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:01:20.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:20 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:01:20.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:20 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:01:20.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:20 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:01:20.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:20 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:20.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:20 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:20.497 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:20 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:01:20.497 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:20 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:20.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:20 smithi186 ceph-mon[41182]: purged_snaps scrub starts 2023-12-17T12:01:20.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:20 smithi186 ceph-mon[41182]: purged_snaps scrub ok 2023-12-17T12:01:20.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:20 smithi186 ceph-mon[41182]: osd.9 [v2:172.21.15.8:6826/3980647643,v1:172.21.15.8:6827/3980647643] boot 2023-12-17T12:01:20.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:20 smithi186 ceph-mon[41182]: osdmap e65: 10 total, 10 up, 10 in 2023-12-17T12:01:20.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:20 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-12-17T12:01:20.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:20 smithi186 ceph-mon[41182]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-12-17T12:01:20.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:20 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:20.727 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:20 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:20.727 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:20 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:01:20.727 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:20 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:01:20.727 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:20 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:01:20.727 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:20 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:01:20.727 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:20 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:20.727 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:20 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:20.727 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:20 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:01:20.727 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:20 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:20.996 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:20.994+0000 7f4bb92ab700 1 -- 172.21.15.100:0/675079664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bb410dc00 msgr2=0x7f4bb410fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:20.997 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:20.994+0000 7f4bb92ab700 1 --2- 172.21.15.100:0/675079664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bb410dc00 0x7f4bb410fff0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4bac00b0a0 tx=0x7f4bac00b3b0 comp rx=0 tx=0).stop 2023-12-17T12:01:20.997 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:20.994+0000 7f4bb92ab700 1 -- 172.21.15.100:0/675079664 shutdown_connections 2023-12-17T12:01:20.997 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:20.994+0000 7f4bb92ab700 1 --2- 172.21.15.100:0/675079664 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bb410dc00 0x7f4bb410fff0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:20.997 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:20.994+0000 7f4bb92ab700 1 --2- 172.21.15.100:0/675079664 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4bb4075600 0x7f4bb4073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:20.997 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:20.994+0000 7f4bb92ab700 1 --2- 172.21.15.100:0/675079664 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bb4074030 0x7f4bb40744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:20.997 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:20.994+0000 7f4bb92ab700 1 -- 172.21.15.100:0/675079664 >> 172.21.15.100:0/675079664 conn(0x7f4bb40fcbe0 msgr2=0x7f4bb40ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:01:20.997 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:20.994+0000 7f4bb92ab700 1 -- 172.21.15.100:0/675079664 shutdown_connections 2023-12-17T12:01:20.997 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:20.994+0000 7f4bb92ab700 1 -- 172.21.15.100:0/675079664 wait complete. 2023-12-17T12:01:20.999 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:20.995+0000 7f4bb92ab700 1 Processor -- start 2023-12-17T12:01:20.999 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:20.995+0000 7f4bb92ab700 1 -- start start 2023-12-17T12:01:20.999 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:20.995+0000 7f4bb92ab700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bb4074030 0x7f4bb419dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:01:21.000 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:20.995+0000 7f4bb92ab700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4bb4075600 0x7f4bb419e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:01:21.000 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:20.995+0000 7f4bb92ab700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bb410dc00 0x7f4bb41a5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:01:21.000 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:20.995+0000 7f4bb92ab700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb41a57e0 con 0x7f4bb4074030 2023-12-17T12:01:21.000 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:20.995+0000 7f4bb92ab700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb41a5920 con 0x7f4bb410dc00 2023-12-17T12:01:21.000 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:20.995+0000 7f4bb92ab700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb41a5ae0 con 0x7f4bb4075600 2023-12-17T12:01:21.000 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:20.996+0000 7f4bb37fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bb410dc00 0x7f4bb41a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:01:21.000 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:20.996+0000 7f4bb37fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bb410dc00 0x7f4bb41a5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.100:40326/0 (socket says 172.21.15.100:40326) 2023-12-17T12:01:21.000 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:20.996+0000 7f4bb37fe700 1 -- 172.21.15.100:0/1195892744 learned_addr learned my addr 172.21.15.100:0/1195892744 (peer_addr_for_me v2:172.21.15.100:0/0) 2023-12-17T12:01:21.000 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:20.996+0000 7f4bb2ffd700 1 --2- 172.21.15.100:0/1195892744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bb4074030 0x7f4bb419dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:01:21.000 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:20.996+0000 7f4bb37fe700 1 -- 172.21.15.100:0/1195892744 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4bb4075600 msgr2=0x7f4bb419e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:21.000 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:20.996+0000 7f4bb27fc700 1 --2- 172.21.15.100:0/1195892744 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4bb4075600 0x7f4bb419e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:01:21.000 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:20.996+0000 7f4bb37fe700 1 --2- 172.21.15.100:0/1195892744 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4bb4075600 0x7f4bb419e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:21.000 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:20.996+0000 7f4bb37fe700 1 -- 172.21.15.100:0/1195892744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bb4074030 msgr2=0x7f4bb419dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:21.000 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:20.996+0000 7f4bb37fe700 1 --2- 172.21.15.100:0/1195892744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bb4074030 0x7f4bb419dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:21.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:20.996+0000 7f4bb37fe700 1 -- 172.21.15.100:0/1195892744 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bac009d00 con 0x7f4bb410dc00 2023-12-17T12:01:21.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:20.996+0000 7f4bb2ffd700 1 --2- 172.21.15.100:0/1195892744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bb4074030 0x7f4bb419dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T12:01:21.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:20.996+0000 7f4bb27fc700 1 --2- 172.21.15.100:0/1195892744 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4bb4075600 0x7f4bb419e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T12:01:21.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:20.996+0000 7f4bb37fe700 1 --2- 172.21.15.100:0/1195892744 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bb410dc00 0x7f4bb41a5210 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4bac00b830 tx=0x7f4bac004d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:01:21.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:20.996+0000 7f4b9bfff700 1 -- 172.21.15.100:0/1195892744 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac00e040 con 0x7f4bb410dc00 2023-12-17T12:01:21.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:20.997+0000 7f4b9bfff700 1 -- 172.21.15.100:0/1195892744 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4bac01dd20 con 0x7f4bb410dc00 2023-12-17T12:01:21.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:20.997+0000 7f4b9bfff700 1 -- 172.21.15.100:0/1195892744 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bac01bcc0 con 0x7f4bb410dc00 2023-12-17T12:01:21.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:20.997+0000 7f4bb92ab700 1 -- 172.21.15.100:0/1195892744 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb41a5d60 con 0x7f4bb410dc00 2023-12-17T12:01:21.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:20.997+0000 7f4bb92ab700 1 -- 172.21.15.100:0/1195892744 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb41a6180 con 0x7f4bb410dc00 2023-12-17T12:01:21.001 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:20.998+0000 7f4bb92ab700 1 -- 172.21.15.100:0/1195892744 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bb4103e60 con 0x7f4bb410dc00 2023-12-17T12:01:21.002 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:21.000+0000 7f4b9bfff700 1 -- 172.21.15.100:0/1195892744 <== mon.2 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7f4bac01b450 con 0x7f4bb410dc00 2023-12-17T12:01:21.004 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:21.001+0000 7f4b9bfff700 1 --2- 172.21.15.100:0/1195892744 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4b9c0a1500 0x7f4b9c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:01:21.004 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:21.001+0000 7f4b9bfff700 1 -- 172.21.15.100:0/1195892744 <== mon.2 v2:172.21.15.100:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f4bac0ceda0 con 0x7f4bb410dc00 2023-12-17T12:01:21.004 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:21.002+0000 7f4bb2ffd700 1 --2- 172.21.15.100:0/1195892744 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4b9c0a1500 0x7f4b9c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:01:21.004 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:21.002+0000 7f4bb2ffd700 1 --2- 172.21.15.100:0/1195892744 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4b9c0a1500 0x7f4b9c0a39c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4110010 tx=0x7f4ba4008040 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:01:21.006 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:21.003+0000 7f4b9bfff700 1 -- 172.21.15.100:0/1195892744 <== mon.2 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4bac098bf0 con 0x7f4bb410dc00 2023-12-17T12:01:21.212 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:21.210+0000 7f4bb92ab700 1 -- 172.21.15.100:0/1195892744 --> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f4bb402d490 con 0x7f4b9c0a1500 2023-12-17T12:01:21.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:21 smithi008 ceph-mon[36830]: Detected new or changed devices on smithi008 2023-12-17T12:01:21.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:21 smithi008 ceph-mon[36830]: Adjusting osd_memory_target on smithi008 to 4319M 2023-12-17T12:01:21.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:21 smithi008 ceph-mon[36830]: osdmap e66: 10 total, 10 up, 10 in 2023-12-17T12:01:21.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:21 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T12:01:21.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:21 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T12:01:21.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:21 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:21.665 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:21 smithi100 ceph-mon[41266]: Detected new or changed devices on smithi008 2023-12-17T12:01:21.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:21 smithi100 ceph-mon[41266]: Adjusting osd_memory_target on smithi008 to 4319M 2023-12-17T12:01:21.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:21 smithi100 ceph-mon[41266]: osdmap e66: 10 total, 10 up, 10 in 2023-12-17T12:01:21.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:21 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T12:01:21.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:21 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T12:01:21.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:21 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:21.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:21 smithi186 ceph-mon[41182]: Detected new or changed devices on smithi008 2023-12-17T12:01:21.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:21 smithi186 ceph-mon[41182]: Adjusting osd_memory_target on smithi008 to 4319M 2023-12-17T12:01:21.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:21 smithi186 ceph-mon[41182]: osdmap e66: 10 total, 10 up, 10 in 2023-12-17T12:01:21.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:21 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T12:01:21.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:21 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T12:01:21.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:21 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:22.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:22 smithi100 ceph-mon[41266]: from='client.24368 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:01:22.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:22 smithi100 ceph-mon[41266]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-12-17T12:01:22.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:22 smithi008 ceph-mon[36830]: from='client.24368 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:01:22.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:22 smithi008 ceph-mon[36830]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-12-17T12:01:22.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:22 smithi186 ceph-mon[41182]: from='client.24368 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi100:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:01:22.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:22 smithi186 ceph-mon[41182]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-12-17T12:01:24.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:24 smithi008 ceph-mon[36830]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-12-17T12:01:24.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:24 smithi008 ceph-mon[36830]: from='client.? 172.21.15.100:0/1457573548' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "779fde04-620b-4b44-bd35-39be1470eec4"}]: dispatch 2023-12-17T12:01:24.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:24 smithi008 ceph-mon[36830]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "779fde04-620b-4b44-bd35-39be1470eec4"}]: dispatch 2023-12-17T12:01:24.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:24 smithi008 ceph-mon[36830]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "779fde04-620b-4b44-bd35-39be1470eec4"}]': finished 2023-12-17T12:01:24.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:24 smithi008 ceph-mon[36830]: osdmap e67: 11 total, 10 up, 11 in 2023-12-17T12:01:24.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:24 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-17T12:01:24.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:24 smithi008 ceph-mon[36830]: from='client.? 172.21.15.100:0/2360693892' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T12:01:24.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:24 smithi100 ceph-mon[41266]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-12-17T12:01:24.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:24 smithi100 ceph-mon[41266]: from='client.? 172.21.15.100:0/1457573548' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "779fde04-620b-4b44-bd35-39be1470eec4"}]: dispatch 2023-12-17T12:01:24.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:24 smithi100 ceph-mon[41266]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "779fde04-620b-4b44-bd35-39be1470eec4"}]: dispatch 2023-12-17T12:01:24.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:24 smithi100 ceph-mon[41266]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "779fde04-620b-4b44-bd35-39be1470eec4"}]': finished 2023-12-17T12:01:24.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:24 smithi100 ceph-mon[41266]: osdmap e67: 11 total, 10 up, 11 in 2023-12-17T12:01:24.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:24 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-17T12:01:24.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:24 smithi100 ceph-mon[41266]: from='client.? 172.21.15.100:0/2360693892' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T12:01:24.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:24 smithi186 ceph-mon[41182]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-12-17T12:01:24.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:24 smithi186 ceph-mon[41182]: from='client.? 172.21.15.100:0/1457573548' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "779fde04-620b-4b44-bd35-39be1470eec4"}]: dispatch 2023-12-17T12:01:24.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:24 smithi186 ceph-mon[41182]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "779fde04-620b-4b44-bd35-39be1470eec4"}]: dispatch 2023-12-17T12:01:24.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:24 smithi186 ceph-mon[41182]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "779fde04-620b-4b44-bd35-39be1470eec4"}]': finished 2023-12-17T12:01:24.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:24 smithi186 ceph-mon[41182]: osdmap e67: 11 total, 10 up, 11 in 2023-12-17T12:01:24.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:24 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-17T12:01:24.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:24 smithi186 ceph-mon[41182]: from='client.? 172.21.15.100:0/2360693892' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T12:01:26.225 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:25 smithi186 ceph-mon[41182]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-17T12:01:26.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:25 smithi008 ceph-mon[36830]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-17T12:01:26.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:25 smithi100 ceph-mon[41266]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-17T12:01:28.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:28 smithi008 ceph-mon[36830]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-17T12:01:28.817 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:28 smithi100 ceph-mon[41266]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-17T12:01:28.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:28 smithi186 ceph-mon[41182]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-17T12:01:30.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:30 smithi008 ceph-mon[36830]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-17T12:01:30.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:30 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-12-17T12:01:30.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:30 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:30.805 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:30 smithi100 ceph-mon[41266]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-17T12:01:30.805 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:30 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-12-17T12:01:30.805 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:30 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:30.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:30 smithi186 ceph-mon[41182]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-17T12:01:30.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:30 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-12-17T12:01:30.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:30 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:31.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:31 smithi008 ceph-mon[36830]: Deploying daemon osd.10 on smithi100 2023-12-17T12:01:31.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:31 smithi100 ceph-mon[41266]: Deploying daemon osd.10 on smithi100 2023-12-17T12:01:31.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:31 smithi186 ceph-mon[41182]: Deploying daemon osd.10 on smithi100 2023-12-17T12:01:32.665 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:32 smithi100 ceph-mon[41266]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-17T12:01:32.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:32 smithi008 ceph-mon[36830]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-17T12:01:32.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:32 smithi186 ceph-mon[41182]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-17T12:01:34.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:34 smithi100 ceph-mon[41266]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-17T12:01:34.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:34 smithi186 ceph-mon[41182]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-17T12:01:34.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:34 smithi008 ceph-mon[36830]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-17T12:01:36.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:36 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:36.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:36 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:36.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:36 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:01:36.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:36 smithi100 ceph-mon[41266]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-17T12:01:36.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:36 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:36.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:36 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:36.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:36 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:01:36.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:36 smithi186 ceph-mon[41182]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-17T12:01:36.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:36 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:36.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:36 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:36.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:36 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:01:36.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:36 smithi008 ceph-mon[36830]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-17T12:01:38.080 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:38.077+0000 7f4b9bfff700 1 -- 172.21.15.100:0/1195892744 <== mgr.14154 v2:172.21.15.8:6800/268548699 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f4bb402d490 con 0x7f4b9c0a1500 2023-12-17T12:01:38.080 INFO:teuthology.orchestra.run.smithi100.stdout:Created osd(s) 10 on host 'smithi100' 2023-12-17T12:01:38.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:38.079+0000 7f4bb92ab700 1 -- 172.21.15.100:0/1195892744 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4b9c0a1500 msgr2=0x7f4b9c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:38.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:38.079+0000 7f4bb92ab700 1 --2- 172.21.15.100:0/1195892744 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4b9c0a1500 0x7f4b9c0a39c0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4110010 tx=0x7f4ba4008040 comp rx=0 tx=0).stop 2023-12-17T12:01:38.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:38.080+0000 7f4bb92ab700 1 -- 172.21.15.100:0/1195892744 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bb410dc00 msgr2=0x7f4bb41a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:38.082 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:38.080+0000 7f4bb92ab700 1 --2- 172.21.15.100:0/1195892744 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bb410dc00 0x7f4bb41a5210 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4bac00b830 tx=0x7f4bac004d30 comp rx=0 tx=0).stop 2023-12-17T12:01:38.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:38.080+0000 7f4bb92ab700 1 -- 172.21.15.100:0/1195892744 shutdown_connections 2023-12-17T12:01:38.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:38.080+0000 7f4bb92ab700 1 --2- 172.21.15.100:0/1195892744 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4b9c0a1500 0x7f4b9c0a39c0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:38.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:38.080+0000 7f4bb92ab700 1 --2- 172.21.15.100:0/1195892744 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4bb410dc00 0x7f4bb41a5210 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:38.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:38.080+0000 7f4bb92ab700 1 --2- 172.21.15.100:0/1195892744 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4bb4074030 0x7f4bb419dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:38.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:38.080+0000 7f4bb92ab700 1 --2- 172.21.15.100:0/1195892744 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4bb4075600 0x7f4bb419e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:38.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:38.080+0000 7f4bb92ab700 1 -- 172.21.15.100:0/1195892744 >> 172.21.15.100:0/1195892744 conn(0x7f4bb40fcbe0 msgr2=0x7f4bb4100fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:01:38.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:38.080+0000 7f4bb92ab700 1 -- 172.21.15.100:0/1195892744 shutdown_connections 2023-12-17T12:01:38.083 INFO:teuthology.orchestra.run.smithi100.stderr:2023-12-17T12:01:38.080+0000 7f4bb92ab700 1 -- 172.21.15.100:0/1195892744 wait complete. 2023-12-17T12:01:38.518 DEBUG:teuthology.orchestra.run.smithi100:osd.10> sudo journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.10.service 2023-12-17T12:01:38.523 INFO:tasks.cephadm:Deploying osd.11 on smithi186 with /dev/vg_nvme/lv_1... 2023-12-17T12:01:38.523 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-12-17T12:01:38.583 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:38 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:38.583 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:38 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:38.584 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:38 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:38.584 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:38 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:01:38.584 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:38 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:38.584 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:38 smithi100 ceph-mon[41266]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-17T12:01:38.584 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:38 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:38.584 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:38 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:38.584 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:38 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:01:38.592 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:38 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:38.592 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:38 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:38.592 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:38 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:38.592 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:38 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:01:38.592 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:38 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:38.592 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:38 smithi186 ceph-mon[41182]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-17T12:01:38.592 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:38 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:38.592 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:38 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:38.593 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:38 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:01:38.597 INFO:journalctl@ceph.osd.10.smithi100.stdout:-- Logs begin at Sun 2023-12-17 11:35:53 UTC. -- 2023-12-17T12:01:38.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:38 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:38.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:38 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:38.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:38 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:38.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:38 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:01:38.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:38 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:38.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:38 smithi008 ceph-mon[36830]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-17T12:01:38.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:38 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:38.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:38 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:38.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:38 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:01:38.937 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.c/config 2023-12-17T12:01:39.469 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:39 smithi186 ceph-mon[41182]: from='osd.10 [v2:172.21.15.100:6824/34112410,v1:172.21.15.100:6825/34112410]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-12-17T12:01:39.469 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:39 smithi186 ceph-mon[41182]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-12-17T12:01:39.578 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:39 smithi100 ceph-mon[41266]: from='osd.10 [v2:172.21.15.100:6824/34112410,v1:172.21.15.100:6825/34112410]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-12-17T12:01:39.578 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:39 smithi100 ceph-mon[41266]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-12-17T12:01:39.578 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:01:39 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:01:39.302+0000 7f860f9a9640 -1 osd.10 0 log_to_monitors true 2023-12-17T12:01:39.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:39 smithi008 ceph-mon[36830]: from='osd.10 [v2:172.21.15.100:6824/34112410,v1:172.21.15.100:6825/34112410]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-12-17T12:01:39.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:39 smithi008 ceph-mon[36830]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-12-17T12:01:40.666 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:01:40 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:01:40.362+0000 7f8605020700 -1 osd.10 0 waiting for initial osdmap 2023-12-17T12:01:40.666 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:01:40 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:01:40.377+0000 7f85fee16700 -1 osd.10 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-17T12:01:40.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:40 smithi100 ceph-mon[41266]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-12-17T12:01:40.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:40 smithi100 ceph-mon[41266]: osdmap e68: 11 total, 10 up, 11 in 2023-12-17T12:01:40.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:40 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-17T12:01:40.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:40 smithi100 ceph-mon[41266]: from='osd.10 [v2:172.21.15.100:6824/34112410,v1:172.21.15.100:6825/34112410]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2023-12-17T12:01:40.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:40 smithi100 ceph-mon[41266]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2023-12-17T12:01:40.667 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:40 smithi100 ceph-mon[41266]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-17T12:01:40.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:40 smithi186 ceph-mon[41182]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-12-17T12:01:40.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:40 smithi186 ceph-mon[41182]: osdmap e68: 11 total, 10 up, 11 in 2023-12-17T12:01:40.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:40 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-17T12:01:40.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:40 smithi186 ceph-mon[41182]: from='osd.10 [v2:172.21.15.100:6824/34112410,v1:172.21.15.100:6825/34112410]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2023-12-17T12:01:40.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:40 smithi186 ceph-mon[41182]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2023-12-17T12:01:40.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:40 smithi186 ceph-mon[41182]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-17T12:01:40.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:40 smithi008 ceph-mon[36830]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-12-17T12:01:40.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:40 smithi008 ceph-mon[36830]: osdmap e68: 11 total, 10 up, 11 in 2023-12-17T12:01:40.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:40 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-17T12:01:40.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:40 smithi008 ceph-mon[36830]: from='osd.10 [v2:172.21.15.100:6824/34112410,v1:172.21.15.100:6825/34112410]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2023-12-17T12:01:40.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:40 smithi008 ceph-mon[36830]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]: dispatch 2023-12-17T12:01:40.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:40 smithi008 ceph-mon[36830]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-17T12:01:40.746 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-12-17T12:01:40.746 INFO:teuthology.orchestra.run.smithi186.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-12-17T12:01:40.746 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10+0 records in 2023-12-17T12:01:40.746 INFO:teuthology.orchestra.run.smithi186.stderr:10+0 records out 2023-12-17T12:01:40.746 INFO:teuthology.orchestra.run.smithi186.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0392311 s, 267 MB/s 2023-12-17T12:01:40.746 INFO:teuthology.orchestra.run.smithi186.stderr:--> Zapping successful for: 2023-12-17T12:01:41.175 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph orch daemon add osd smithi186:vg_nvme/lv_1 2023-12-17T12:01:41.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:41 smithi186 ceph-mon[41182]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2023-12-17T12:01:41.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:41 smithi186 ceph-mon[41182]: osdmap e69: 11 total, 10 up, 11 in 2023-12-17T12:01:41.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:41 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-17T12:01:41.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:41 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-17T12:01:41.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:41 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:41.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:41 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:41.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:41 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:01:41.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:41 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:01:41.477 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:41 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:01:41.477 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:41 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:01:41.477 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:41 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:41.477 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:41 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:41.477 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:41 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:01:41.477 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:41 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:41.594 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.c/config 2023-12-17T12:01:41.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:41 smithi100 ceph-mon[41266]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2023-12-17T12:01:41.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:41 smithi100 ceph-mon[41266]: osdmap e69: 11 total, 10 up, 11 in 2023-12-17T12:01:41.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:41 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-17T12:01:41.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:41 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-17T12:01:41.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:41 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:41.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:41 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:41.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:41 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:01:41.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:41 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:01:41.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:41 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:01:41.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:41 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:01:41.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:41 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:41.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:41 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:41.667 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:41 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:01:41.667 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:41 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:41.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:41 smithi008 ceph-mon[36830]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi100", "root=default"]}]': finished 2023-12-17T12:01:41.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:41 smithi008 ceph-mon[36830]: osdmap e69: 11 total, 10 up, 11 in 2023-12-17T12:01:41.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:41 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-17T12:01:41.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:41 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-17T12:01:41.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:41 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:41.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:41 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:41.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:41 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:01:41.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:41 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:01:41.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:41 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:01:41.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:41 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:01:41.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:41 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:41.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:41 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:41.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:41 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:01:41.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:41 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:42.343 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:42 smithi186 ceph-mon[41182]: purged_snaps scrub starts 2023-12-17T12:01:42.343 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:42 smithi186 ceph-mon[41182]: purged_snaps scrub ok 2023-12-17T12:01:42.344 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:42 smithi186 ceph-mon[41182]: Detected new or changed devices on smithi100 2023-12-17T12:01:42.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:42 smithi100 ceph-mon[41266]: purged_snaps scrub starts 2023-12-17T12:01:42.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:42 smithi100 ceph-mon[41266]: purged_snaps scrub ok 2023-12-17T12:01:42.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:42 smithi100 ceph-mon[41266]: Detected new or changed devices on smithi100 2023-12-17T12:01:42.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:42 smithi100 ceph-mon[41266]: Adjusting osd_memory_target on smithi100 to 4317M 2023-12-17T12:01:42.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:42 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-17T12:01:42.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:42 smithi100 ceph-mon[41266]: osd.10 [v2:172.21.15.100:6824/34112410,v1:172.21.15.100:6825/34112410] boot 2023-12-17T12:01:42.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:42 smithi100 ceph-mon[41266]: osdmap e70: 11 total, 11 up, 11 in 2023-12-17T12:01:42.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:42 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-17T12:01:42.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:42 smithi100 ceph-mon[41266]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-17T12:01:42.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:42 smithi186 ceph-mon[41182]: Adjusting osd_memory_target on smithi100 to 4317M 2023-12-17T12:01:42.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:42 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-17T12:01:42.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:42 smithi186 ceph-mon[41182]: osd.10 [v2:172.21.15.100:6824/34112410,v1:172.21.15.100:6825/34112410] boot 2023-12-17T12:01:42.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:42 smithi186 ceph-mon[41182]: osdmap e70: 11 total, 11 up, 11 in 2023-12-17T12:01:42.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:42 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-17T12:01:42.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:42 smithi186 ceph-mon[41182]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-17T12:01:42.748 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:42 smithi008 ceph-mon[36830]: purged_snaps scrub starts 2023-12-17T12:01:42.748 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:42 smithi008 ceph-mon[36830]: purged_snaps scrub ok 2023-12-17T12:01:42.748 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:42 smithi008 ceph-mon[36830]: Detected new or changed devices on smithi100 2023-12-17T12:01:42.748 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:42 smithi008 ceph-mon[36830]: Adjusting osd_memory_target on smithi100 to 4317M 2023-12-17T12:01:42.748 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:42 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-17T12:01:42.748 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:42 smithi008 ceph-mon[36830]: osd.10 [v2:172.21.15.100:6824/34112410,v1:172.21.15.100:6825/34112410] boot 2023-12-17T12:01:42.748 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:42 smithi008 ceph-mon[36830]: osdmap e70: 11 total, 11 up, 11 in 2023-12-17T12:01:42.748 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:42 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-12-17T12:01:42.748 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:42 smithi008 ceph-mon[36830]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 271 MiB used, 894 GiB / 894 GiB avail 2023-12-17T12:01:42.774 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.772+0000 7f1a41a00700 1 -- 172.21.15.186:0/1581799886 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a3c102800 msgr2=0x7f1a3c102c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:42.774 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.772+0000 7f1a41a00700 1 --2- 172.21.15.186:0/1581799886 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a3c102800 0x7f1a3c102c60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1a30009990 tx=0x7f1a30009ca0 comp rx=0 tx=0).stop 2023-12-17T12:01:42.774 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.772+0000 7f1a41a00700 1 -- 172.21.15.186:0/1581799886 shutdown_connections 2023-12-17T12:01:42.774 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.772+0000 7f1a41a00700 1 --2- 172.21.15.186:0/1581799886 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a3c1031a0 0x7f1a3c109a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:42.774 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.772+0000 7f1a41a00700 1 --2- 172.21.15.186:0/1581799886 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a3c101600 0x7f1a3c101a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:42.775 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.772+0000 7f1a41a00700 1 --2- 172.21.15.186:0/1581799886 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a3c102800 0x7f1a3c102c60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:42.775 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.772+0000 7f1a41a00700 1 -- 172.21.15.186:0/1581799886 >> 172.21.15.186:0/1581799886 conn(0x7f1a3c0fcbe0 msgr2=0x7f1a3c0ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:01:42.775 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.772+0000 7f1a41a00700 1 -- 172.21.15.186:0/1581799886 shutdown_connections 2023-12-17T12:01:42.775 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.772+0000 7f1a41a00700 1 -- 172.21.15.186:0/1581799886 wait complete. 2023-12-17T12:01:42.777 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.773+0000 7f1a41a00700 1 Processor -- start 2023-12-17T12:01:42.777 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.773+0000 7f1a41a00700 1 -- start start 2023-12-17T12:01:42.777 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.773+0000 7f1a41a00700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a3c101600 0x7f1a3c1996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:01:42.777 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.774+0000 7f1a41a00700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a3c102800 0x7f1a3c199be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:01:42.778 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.774+0000 7f1a41a00700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a3c1031a0 0x7f1a3c1a0c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:01:42.778 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.774+0000 7f1a41a00700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3c1a11e0 con 0x7f1a3c101600 2023-12-17T12:01:42.778 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.774+0000 7f1a41a00700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3c1a1320 con 0x7f1a3c102800 2023-12-17T12:01:42.778 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.774+0000 7f1a41a00700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3c1a14b0 con 0x7f1a3c1031a0 2023-12-17T12:01:42.778 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.774+0000 7f1a3b7fe700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a3c1031a0 0x7f1a3c1a0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:01:42.778 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.774+0000 7f1a3b7fe700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a3c1031a0 0x7f1a3c1a0c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:53082/0 (socket says 172.21.15.186:53082) 2023-12-17T12:01:42.778 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.774+0000 7f1a3b7fe700 1 -- 172.21.15.186:0/3057703309 learned_addr learned my addr 172.21.15.186:0/3057703309 (peer_addr_for_me v2:172.21.15.186:0/0) 2023-12-17T12:01:42.778 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.774+0000 7f1a3affd700 1 --2- 172.21.15.186:0/3057703309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a3c101600 0x7f1a3c1996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:01:42.778 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.774+0000 7f1a3a7fc700 1 --2- 172.21.15.186:0/3057703309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a3c102800 0x7f1a3c199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:01:42.778 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.774+0000 7f1a3b7fe700 1 -- 172.21.15.186:0/3057703309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a3c102800 msgr2=0x7f1a3c199be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:42.778 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.774+0000 7f1a3b7fe700 1 --2- 172.21.15.186:0/3057703309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a3c102800 0x7f1a3c199be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:42.778 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.774+0000 7f1a3b7fe700 1 -- 172.21.15.186:0/3057703309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a3c101600 msgr2=0x7f1a3c1996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:01:42.778 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.774+0000 7f1a3b7fe700 1 --2- 172.21.15.186:0/3057703309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a3c101600 0x7f1a3c1996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:01:42.778 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.774+0000 7f1a3b7fe700 1 -- 172.21.15.186:0/3057703309 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a300095f0 con 0x7f1a3c1031a0 2023-12-17T12:01:42.779 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.774+0000 7f1a3a7fc700 1 --2- 172.21.15.186:0/3057703309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a3c102800 0x7f1a3c199be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T12:01:42.779 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.775+0000 7f1a3b7fe700 1 --2- 172.21.15.186:0/3057703309 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a3c1031a0 0x7f1a3c1a0c10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1a34007f10 tx=0x7f1a3400d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:01:42.779 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.775+0000 7f1a409fe700 1 -- 172.21.15.186:0/3057703309 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a34017070 con 0x7f1a3c1031a0 2023-12-17T12:01:42.779 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.775+0000 7f1a409fe700 1 -- 172.21.15.186:0/3057703309 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1a3400f040 con 0x7f1a3c1031a0 2023-12-17T12:01:42.779 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.775+0000 7f1a41a00700 1 -- 172.21.15.186:0/3057703309 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a3c1a1790 con 0x7f1a3c1031a0 2023-12-17T12:01:42.779 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.775+0000 7f1a409fe700 1 -- 172.21.15.186:0/3057703309 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a34005710 con 0x7f1a3c1031a0 2023-12-17T12:01:42.779 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.775+0000 7f1a41a00700 1 -- 172.21.15.186:0/3057703309 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a3c1a1ce0 con 0x7f1a3c1031a0 2023-12-17T12:01:42.779 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.776+0000 7f1a41a00700 1 -- 172.21.15.186:0/3057703309 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a3c04f290 con 0x7f1a3c1031a0 2023-12-17T12:01:42.780 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.778+0000 7f1a409fe700 1 -- 172.21.15.186:0/3057703309 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7f1a34004ad0 con 0x7f1a3c1031a0 2023-12-17T12:01:42.782 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.781+0000 7f1a409fe700 1 --2- 172.21.15.186:0/3057703309 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f1a240a1500 0x7f1a240a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:01:42.783 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.781+0000 7f1a409fe700 1 -- 172.21.15.186:0/3057703309 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6723+0+0 (secure 0 0 0) 0x7f1a340cc5b0 con 0x7f1a3c1031a0 2023-12-17T12:01:42.783 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.781+0000 7f1a3affd700 1 --2- 172.21.15.186:0/3057703309 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f1a240a1500 0x7f1a240a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:01:42.784 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.782+0000 7f1a3affd700 1 --2- 172.21.15.186:0/3057703309 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f1a240a1500 0x7f1a240a39c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c005950 tx=0x7f1a2c0058e0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:01:42.785 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.784+0000 7f1a409fe700 1 -- 172.21.15.186:0/3057703309 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f1a340961a0 con 0x7f1a3c1031a0 2023-12-17T12:01:42.996 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:01:42.994+0000 7f1a41a00700 1 -- 172.21.15.186:0/3057703309 --> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a3c1096f0 con 0x7f1a240a1500 2023-12-17T12:01:43.646 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:43 smithi186 ceph-mon[41182]: osdmap e71: 11 total, 11 up, 11 in 2023-12-17T12:01:43.647 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:43 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T12:01:43.647 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:43 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T12:01:43.647 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:43 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:43.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:43 smithi100 ceph-mon[41266]: osdmap e71: 11 total, 11 up, 11 in 2023-12-17T12:01:43.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:43 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T12:01:43.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:43 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T12:01:43.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:43 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:43.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:43 smithi008 ceph-mon[36830]: osdmap e71: 11 total, 11 up, 11 in 2023-12-17T12:01:43.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:43 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-12-17T12:01:43.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:43 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-12-17T12:01:43.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:43 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:44.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:44 smithi100 ceph-mon[41266]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:01:44.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:44 smithi100 ceph-mon[41266]: osdmap e72: 11 total, 11 up, 11 in 2023-12-17T12:01:44.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:44 smithi100 ceph-mon[41266]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-12-17T12:01:44.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:44 smithi186 ceph-mon[41182]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:01:44.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:44 smithi186 ceph-mon[41182]: osdmap e72: 11 total, 11 up, 11 in 2023-12-17T12:01:44.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:44 smithi186 ceph-mon[41182]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-12-17T12:01:44.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:44 smithi008 ceph-mon[36830]: from='client.24382 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi186:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:01:44.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:44 smithi008 ceph-mon[36830]: osdmap e72: 11 total, 11 up, 11 in 2023-12-17T12:01:44.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:44 smithi008 ceph-mon[36830]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-12-17T12:01:45.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:45 smithi100 ceph-mon[41266]: osdmap e73: 11 total, 11 up, 11 in 2023-12-17T12:01:45.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:45 smithi186 ceph-mon[41182]: osdmap e73: 11 total, 11 up, 11 in 2023-12-17T12:01:45.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:45 smithi008 ceph-mon[36830]: osdmap e73: 11 total, 11 up, 11 in 2023-12-17T12:01:46.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:46 smithi100 ceph-mon[41266]: osdmap e74: 11 total, 11 up, 11 in 2023-12-17T12:01:46.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:46 smithi100 ceph-mon[41266]: pgmap v223: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-12-17T12:01:46.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:46 smithi100 ceph-mon[41266]: from='client.? 172.21.15.186:0/3846092430' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6bbcb42f-aa99-44e4-9c3f-d818423eb5b0"}]: dispatch 2023-12-17T12:01:46.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:46 smithi100 ceph-mon[41266]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6bbcb42f-aa99-44e4-9c3f-d818423eb5b0"}]: dispatch 2023-12-17T12:01:46.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:46 smithi100 ceph-mon[41266]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6bbcb42f-aa99-44e4-9c3f-d818423eb5b0"}]': finished 2023-12-17T12:01:46.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:46 smithi100 ceph-mon[41266]: osdmap e75: 12 total, 11 up, 12 in 2023-12-17T12:01:46.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:46 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-17T12:01:46.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:46 smithi100 ceph-mon[41266]: from='client.? 172.21.15.186:0/472231028' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T12:01:46.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:46 smithi186 ceph-mon[41182]: osdmap e74: 11 total, 11 up, 11 in 2023-12-17T12:01:46.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:46 smithi186 ceph-mon[41182]: pgmap v223: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-12-17T12:01:46.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:46 smithi186 ceph-mon[41182]: from='client.? 172.21.15.186:0/3846092430' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6bbcb42f-aa99-44e4-9c3f-d818423eb5b0"}]: dispatch 2023-12-17T12:01:46.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:46 smithi186 ceph-mon[41182]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6bbcb42f-aa99-44e4-9c3f-d818423eb5b0"}]: dispatch 2023-12-17T12:01:46.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:46 smithi186 ceph-mon[41182]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6bbcb42f-aa99-44e4-9c3f-d818423eb5b0"}]': finished 2023-12-17T12:01:46.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:46 smithi186 ceph-mon[41182]: osdmap e75: 12 total, 11 up, 12 in 2023-12-17T12:01:46.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:46 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-17T12:01:46.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:46 smithi186 ceph-mon[41182]: from='client.? 172.21.15.186:0/472231028' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T12:01:46.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:46 smithi008 ceph-mon[36830]: osdmap e74: 11 total, 11 up, 11 in 2023-12-17T12:01:46.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:46 smithi008 ceph-mon[36830]: pgmap v223: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-12-17T12:01:46.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:46 smithi008 ceph-mon[36830]: from='client.? 172.21.15.186:0/3846092430' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6bbcb42f-aa99-44e4-9c3f-d818423eb5b0"}]: dispatch 2023-12-17T12:01:46.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:46 smithi008 ceph-mon[36830]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6bbcb42f-aa99-44e4-9c3f-d818423eb5b0"}]: dispatch 2023-12-17T12:01:46.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:46 smithi008 ceph-mon[36830]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6bbcb42f-aa99-44e4-9c3f-d818423eb5b0"}]': finished 2023-12-17T12:01:46.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:46 smithi008 ceph-mon[36830]: osdmap e75: 12 total, 11 up, 12 in 2023-12-17T12:01:46.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:46 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-17T12:01:46.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:46 smithi008 ceph-mon[36830]: from='client.? 172.21.15.186:0/472231028' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-12-17T12:01:48.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:48 smithi008 ceph-mon[36830]: pgmap v225: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 142 KiB/s, 0 objects/s recovering 2023-12-17T12:01:48.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:48 smithi100 ceph-mon[41266]: pgmap v225: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 142 KiB/s, 0 objects/s recovering 2023-12-17T12:01:48.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:48 smithi186 ceph-mon[41182]: pgmap v225: 1 pgs: 1 peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 142 KiB/s, 0 objects/s recovering 2023-12-17T12:01:50.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:50 smithi008 ceph-mon[36830]: pgmap v226: 1 pgs: 1 peering; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-17T12:01:50.746 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:50 smithi186 ceph-mon[41182]: pgmap v226: 1 pgs: 1 peering; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-17T12:01:50.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:50 smithi100 ceph-mon[41266]: pgmap v226: 1 pgs: 1 peering; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-12-17T12:01:52.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:52 smithi186 ceph-mon[41182]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 82 KiB/s, 0 objects/s recovering 2023-12-17T12:01:52.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:52 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-12-17T12:01:52.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:52 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:52.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:52 smithi008 ceph-mon[36830]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 82 KiB/s, 0 objects/s recovering 2023-12-17T12:01:52.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:52 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-12-17T12:01:52.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:52 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:52.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:52 smithi100 ceph-mon[41266]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail; 82 KiB/s, 0 objects/s recovering 2023-12-17T12:01:52.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:52 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-12-17T12:01:52.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:52 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:01:53.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:53 smithi186 ceph-mon[41182]: Deploying daemon osd.11 on smithi186 2023-12-17T12:01:53.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:53 smithi100 ceph-mon[41266]: Deploying daemon osd.11 on smithi186 2023-12-17T12:01:53.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:53 smithi008 ceph-mon[36830]: Deploying daemon osd.11 on smithi186 2023-12-17T12:01:54.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:54 smithi186 ceph-mon[41182]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-17T12:01:54.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:54 smithi100 ceph-mon[41266]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-17T12:01:54.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:54 smithi008 ceph-mon[36830]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-17T12:01:56.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:55 smithi186 ceph-mon[41182]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-17T12:01:56.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:55 smithi008 ceph-mon[36830]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-17T12:01:56.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:55 smithi100 ceph-mon[41266]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-17T12:01:58.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:58 smithi008 ceph-mon[36830]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-17T12:01:58.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:58 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:58.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:58 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:58.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:01:58 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:01:58.908 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:58 smithi186 ceph-mon[41182]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-17T12:01:58.908 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:58 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:58.908 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:58 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:58.908 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:01:58 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:01:58.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:58 smithi100 ceph-mon[41266]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-17T12:01:58.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:58 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:58.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:58 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:01:58.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:01:58 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:02:00.593 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:00 smithi186 ceph-mon[41182]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-17T12:02:00.594 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:00 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:00.594 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:00 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:00.594 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:00 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:00.594 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:00 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:02:00.594 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:00 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:00.669 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:00.667+0000 7f1a409fe700 1 -- 172.21.15.186:0/3057703309 <== mgr.14154 v2:172.21.15.8:6800/268548699 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f1a3c1096f0 con 0x7f1a240a1500 2023-12-17T12:02:00.671 INFO:teuthology.orchestra.run.smithi186.stdout:Created osd(s) 11 on host 'smithi186' 2023-12-17T12:02:00.674 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:00.671+0000 7f1a41a00700 1 -- 172.21.15.186:0/3057703309 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f1a240a1500 msgr2=0x7f1a240a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:00.674 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:00.671+0000 7f1a41a00700 1 --2- 172.21.15.186:0/3057703309 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f1a240a1500 0x7f1a240a39c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c005950 tx=0x7f1a2c0058e0 comp rx=0 tx=0).stop 2023-12-17T12:02:00.674 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:00.671+0000 7f1a41a00700 1 -- 172.21.15.186:0/3057703309 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a3c1031a0 msgr2=0x7f1a3c1a0c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:00.674 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:00.671+0000 7f1a41a00700 1 --2- 172.21.15.186:0/3057703309 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a3c1031a0 0x7f1a3c1a0c10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1a34007f10 tx=0x7f1a3400d3b0 comp rx=0 tx=0).stop 2023-12-17T12:02:00.674 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:00.671+0000 7f1a41a00700 1 -- 172.21.15.186:0/3057703309 shutdown_connections 2023-12-17T12:02:00.674 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:00.671+0000 7f1a41a00700 1 --2- 172.21.15.186:0/3057703309 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f1a240a1500 0x7f1a240a39c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:00.674 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:00.671+0000 7f1a41a00700 1 --2- 172.21.15.186:0/3057703309 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1a3c1031a0 0x7f1a3c1a0c10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:00.674 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:00.671+0000 7f1a41a00700 1 --2- 172.21.15.186:0/3057703309 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1a3c101600 0x7f1a3c1996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:00.674 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:00.671+0000 7f1a41a00700 1 --2- 172.21.15.186:0/3057703309 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1a3c102800 0x7f1a3c199be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:00.674 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:00.671+0000 7f1a41a00700 1 -- 172.21.15.186:0/3057703309 >> 172.21.15.186:0/3057703309 conn(0x7f1a3c0fcbe0 msgr2=0x7f1a3c107fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:00.675 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:00.672+0000 7f1a41a00700 1 -- 172.21.15.186:0/3057703309 shutdown_connections 2023-12-17T12:02:00.675 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:00.672+0000 7f1a41a00700 1 -- 172.21.15.186:0/3057703309 wait complete. 2023-12-17T12:02:00.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:00 smithi008 ceph-mon[36830]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-17T12:02:00.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:00 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:00.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:00 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:00.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:00 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:00.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:00 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:02:00.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:00 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:00.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:00 smithi100 ceph-mon[41266]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-17T12:02:00.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:00 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:00.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:00 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:00.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:00 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:00.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:00 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:02:00.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:00 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:01.157 DEBUG:teuthology.orchestra.run.smithi186:osd.11> sudo journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.11.service 2023-12-17T12:02:01.162 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2023-12-17T12:02:01.162 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph osd stat -f json 2023-12-17T12:02:01.237 INFO:journalctl@ceph.osd.11.smithi186.stdout:-- Logs begin at Sun 2023-12-17 11:40:47 UTC. -- 2023-12-17T12:02:01.595 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:02:01.698 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:01 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:01.698 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:01 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:01.698 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:01 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:02:01.698 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:01 smithi186 ceph-mon[41182]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-17T12:02:01.910 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:01 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:01.910 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:01 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:01.910 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:01 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:02:01.910 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:01 smithi008 ceph-mon[36830]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-17T12:02:01.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:01 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:01.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:01 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:01.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:01 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:02:01.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:01 smithi100 ceph-mon[41266]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-17T12:02:01.975 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:02:01 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:02:01.759+0000 7fc96b4c4640 -1 osd.11 0 log_to_monitors true 2023-12-17T12:02:02.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.805+0000 7f9cd3d97700 1 -- 172.21.15.8:0/317155608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ccc1020a0 msgr2=0x7f9ccc104490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:02.808 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.805+0000 7f9cd3d97700 1 --2- 172.21.15.8:0/317155608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ccc1020a0 0x7f9ccc104490 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f9cc8009990 tx=0x7f9cc8009ca0 comp rx=0 tx=0).stop 2023-12-17T12:02:02.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.805+0000 7f9cd3d97700 1 -- 172.21.15.8:0/317155608 shutdown_connections 2023-12-17T12:02:02.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.805+0000 7f9cd3d97700 1 --2- 172.21.15.8:0/317155608 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ccc107300 0x7f9ccc109770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:02.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.805+0000 7f9cd3d97700 1 --2- 172.21.15.8:0/317155608 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ccc1020a0 0x7f9ccc104490 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:02.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.805+0000 7f9cd3d97700 1 --2- 172.21.15.8:0/317155608 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9ccc1049d0 0x7f9ccc106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:02.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.805+0000 7f9cd3d97700 1 -- 172.21.15.8:0/317155608 >> 172.21.15.8:0/317155608 conn(0x7f9ccc0fbad0 msgr2=0x7f9ccc0fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:02.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.805+0000 7f9cd3d97700 1 -- 172.21.15.8:0/317155608 shutdown_connections 2023-12-17T12:02:02.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.805+0000 7f9cd3d97700 1 -- 172.21.15.8:0/317155608 wait complete. 2023-12-17T12:02:02.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.806+0000 7f9cd3d97700 1 Processor -- start 2023-12-17T12:02:02.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.806+0000 7f9cd3d97700 1 -- start start 2023-12-17T12:02:02.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.807+0000 7f9cd3d97700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ccc1020a0 0x7f9ccc1996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:02.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.807+0000 7f9cd3d97700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9ccc1049d0 0x7f9ccc199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:02.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.807+0000 7f9cd3d97700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ccc107300 0x7f9ccc1a0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:02.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.807+0000 7f9cd3d97700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ccc1a1210 con 0x7f9ccc107300 2023-12-17T12:02:02.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.807+0000 7f9cd3d97700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ccc1a1350 con 0x7f9ccc1020a0 2023-12-17T12:02:02.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.807+0000 7f9cd3d97700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ccc1a14e0 con 0x7f9ccc1049d0 2023-12-17T12:02:02.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.807+0000 7f9cd1b33700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ccc1020a0 0x7f9ccc1996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:02.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.807+0000 7f9cd1332700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9ccc1049d0 0x7f9ccc199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:02.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.807+0000 7f9cd1b33700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ccc1020a0 0x7f9ccc1996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.8:52612/0 (socket says 172.21.15.8:52612) 2023-12-17T12:02:02.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.807+0000 7f9cd1b33700 1 -- 172.21.15.8:0/3892847634 learned_addr learned my addr 172.21.15.8:0/3892847634 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:02:02.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.807+0000 7f9cd2334700 1 --2- 172.21.15.8:0/3892847634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ccc107300 0x7f9ccc1a0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:02.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.808+0000 7f9cd2334700 1 -- 172.21.15.8:0/3892847634 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9ccc1049d0 msgr2=0x7f9ccc199c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:02.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.808+0000 7f9cd2334700 1 --2- 172.21.15.8:0/3892847634 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9ccc1049d0 0x7f9ccc199c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:02.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.808+0000 7f9cd2334700 1 -- 172.21.15.8:0/3892847634 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ccc1020a0 msgr2=0x7f9ccc1996d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:02.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.808+0000 7f9cd2334700 1 --2- 172.21.15.8:0/3892847634 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ccc1020a0 0x7f9ccc1996d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:02.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.808+0000 7f9cd2334700 1 -- 172.21.15.8:0/3892847634 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cc80095f0 con 0x7f9ccc107300 2023-12-17T12:02:02.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.808+0000 7f9cd1b33700 1 --2- 172.21.15.8:0/3892847634 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ccc1020a0 0x7f9ccc1996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T12:02:02.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.808+0000 7f9cd2334700 1 --2- 172.21.15.8:0/3892847634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ccc107300 0x7f9ccc1a0c40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4007f10 tx=0x7f9cc400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:02.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.808+0000 7f9cc2ffd700 1 -- 172.21.15.8:0/3892847634 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4004db0 con 0x7f9ccc107300 2023-12-17T12:02:02.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.808+0000 7f9cc2ffd700 1 -- 172.21.15.8:0/3892847634 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9cc400f040 con 0x7f9ccc107300 2023-12-17T12:02:02.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.808+0000 7f9cd3d97700 1 -- 172.21.15.8:0/3892847634 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ccc1a17c0 con 0x7f9ccc107300 2023-12-17T12:02:02.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.808+0000 7f9cc2ffd700 1 -- 172.21.15.8:0/3892847634 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4005880 con 0x7f9ccc107300 2023-12-17T12:02:02.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.808+0000 7f9cd3d97700 1 -- 172.21.15.8:0/3892847634 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ccc1a1cc0 con 0x7f9ccc107300 2023-12-17T12:02:02.812 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.810+0000 7f9cd3d97700 1 -- 172.21.15.8:0/3892847634 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ccc04f290 con 0x7f9ccc107300 2023-12-17T12:02:02.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.811+0000 7f9cc2ffd700 1 -- 172.21.15.8:0/3892847634 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7f9cc400db20 con 0x7f9ccc107300 2023-12-17T12:02:02.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.813+0000 7f9cc2ffd700 1 --2- 172.21.15.8:0/3892847634 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f9cb80a1480 0x7f9cb80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:02.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.813+0000 7f9cc2ffd700 1 -- 172.21.15.8:0/3892847634 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 6831+0+0 (secure 0 0 0) 0x7f9cc40cbfa0 con 0x7f9ccc107300 2023-12-17T12:02:02.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.813+0000 7f9cd1b33700 1 --2- 172.21.15.8:0/3892847634 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f9cb80a1480 0x7f9cb80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:02.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.814+0000 7f9cd1b33700 1 --2- 172.21.15.8:0/3892847634 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f9cb80a1480 0x7f9cb80a3940 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9cc800b5c0 tx=0x7f9cc8003720 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:02.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:02.817+0000 7f9cc2ffd700 1 -- 172.21.15.8:0/3892847634 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f9cc404f2f0 con 0x7f9ccc107300 2023-12-17T12:02:02.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:02 smithi100 ceph-mon[41266]: from='osd.11 [v2:172.21.15.186:6824/3779371472,v1:172.21.15.186:6825/3779371472]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-12-17T12:02:02.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:02 smithi100 ceph-mon[41266]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-12-17T12:02:02.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:02 smithi186 ceph-mon[41182]: from='osd.11 [v2:172.21.15.186:6824/3779371472,v1:172.21.15.186:6825/3779371472]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-12-17T12:02:02.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:02 smithi186 ceph-mon[41182]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-12-17T12:02:02.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:02 smithi008 ceph-mon[36830]: from='osd.11 [v2:172.21.15.186:6824/3779371472,v1:172.21.15.186:6825/3779371472]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-12-17T12:02:02.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:02 smithi008 ceph-mon[36830]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-12-17T12:02:03.027 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:03.025+0000 7f9cd3d97700 1 -- 172.21.15.8:0/3892847634 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f9ccc10cd40 con 0x7f9ccc107300 2023-12-17T12:02:03.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:03.025+0000 7f9cc2ffd700 1 -- 172.21.15.8:0/3892847634 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v76) v1 ==== 74+0+133 (secure 0 0 0) 0x7f9cc4095b30 con 0x7f9ccc107300 2023-12-17T12:02:03.028 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:02:03.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:03.028+0000 7f9cd3d97700 1 -- 172.21.15.8:0/3892847634 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f9cb80a1480 msgr2=0x7f9cb80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:03.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:03.028+0000 7f9cd3d97700 1 --2- 172.21.15.8:0/3892847634 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f9cb80a1480 0x7f9cb80a3940 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9cc800b5c0 tx=0x7f9cc8003720 comp rx=0 tx=0).stop 2023-12-17T12:02:03.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:03.028+0000 7f9cd3d97700 1 -- 172.21.15.8:0/3892847634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ccc107300 msgr2=0x7f9ccc1a0c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:03.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:03.028+0000 7f9cd3d97700 1 --2- 172.21.15.8:0/3892847634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ccc107300 0x7f9ccc1a0c40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4007f10 tx=0x7f9cc400d3b0 comp rx=0 tx=0).stop 2023-12-17T12:02:03.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:03.028+0000 7f9cd3d97700 1 -- 172.21.15.8:0/3892847634 shutdown_connections 2023-12-17T12:02:03.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:03.028+0000 7f9cd3d97700 1 --2- 172.21.15.8:0/3892847634 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f9cb80a1480 0x7f9cb80a3940 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:03.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:03.028+0000 7f9cd3d97700 1 --2- 172.21.15.8:0/3892847634 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9ccc107300 0x7f9ccc1a0c40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:03.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:03.028+0000 7f9cd3d97700 1 --2- 172.21.15.8:0/3892847634 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9ccc1020a0 0x7f9ccc1996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:03.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:03.028+0000 7f9cd3d97700 1 --2- 172.21.15.8:0/3892847634 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9ccc1049d0 0x7f9ccc199c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:03.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:03.028+0000 7f9cd3d97700 1 -- 172.21.15.8:0/3892847634 >> 172.21.15.8:0/3892847634 conn(0x7f9ccc0fbad0 msgr2=0x7f9ccc1000d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:03.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:03.028+0000 7f9cd3d97700 1 -- 172.21.15.8:0/3892847634 shutdown_connections 2023-12-17T12:02:03.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:03.028+0000 7f9cd3d97700 1 -- 172.21.15.8:0/3892847634 wait complete. 2023-12-17T12:02:03.435 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":76,"num_osds":12,"num_up_osds":11,"osd_up_since":1702814501,"num_in_osds":12,"osd_in_since":1702814505,"num_remapped_pgs":0} 2023-12-17T12:02:03.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:03 smithi100 ceph-mon[41266]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-12-17T12:02:03.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:03 smithi100 ceph-mon[41266]: osdmap e76: 12 total, 11 up, 12 in 2023-12-17T12:02:03.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:03 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-17T12:02:03.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:03 smithi100 ceph-mon[41266]: from='osd.11 [v2:172.21.15.186:6824/3779371472,v1:172.21.15.186:6825/3779371472]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-12-17T12:02:03.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:03 smithi100 ceph-mon[41266]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-12-17T12:02:03.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:03 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/3892847634' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-17T12:02:03.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:03 smithi100 ceph-mon[41266]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-17T12:02:03.975 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:02:03 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:02:03.671+0000 7fc960b3b700 -1 osd.11 0 waiting for initial osdmap 2023-12-17T12:02:03.976 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:02:03 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:02:03.688+0000 7fc95892d700 -1 osd.11 77 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-17T12:02:03.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:03 smithi186 ceph-mon[41182]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-12-17T12:02:03.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:03 smithi186 ceph-mon[41182]: osdmap e76: 12 total, 11 up, 12 in 2023-12-17T12:02:03.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:03 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-17T12:02:03.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:03 smithi186 ceph-mon[41182]: from='osd.11 [v2:172.21.15.186:6824/3779371472,v1:172.21.15.186:6825/3779371472]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-12-17T12:02:03.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:03 smithi186 ceph-mon[41182]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-12-17T12:02:03.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:03 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/3892847634' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-17T12:02:03.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:03 smithi186 ceph-mon[41182]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-17T12:02:03.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:03 smithi008 ceph-mon[36830]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-12-17T12:02:03.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:03 smithi008 ceph-mon[36830]: osdmap e76: 12 total, 11 up, 12 in 2023-12-17T12:02:03.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:03 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-17T12:02:03.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:03 smithi008 ceph-mon[36830]: from='osd.11 [v2:172.21.15.186:6824/3779371472,v1:172.21.15.186:6825/3779371472]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-12-17T12:02:03.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:03 smithi008 ceph-mon[36830]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]: dispatch 2023-12-17T12:02:03.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:03 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/3892847634' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-17T12:02:03.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:03 smithi008 ceph-mon[36830]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 299 MiB used, 983 GiB / 983 GiB avail 2023-12-17T12:02:04.437 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph osd stat -f json 2023-12-17T12:02:04.859 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:02:04.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:04 smithi186 ceph-mon[41182]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2023-12-17T12:02:04.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:04 smithi186 ceph-mon[41182]: osdmap e77: 12 total, 11 up, 12 in 2023-12-17T12:02:04.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:04 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-17T12:02:04.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:04 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-17T12:02:04.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:04 smithi186 ceph-mon[41182]: Detected new or changed devices on smithi186 2023-12-17T12:02:04.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:04 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:04.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:04 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:04.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:04 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:02:04.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:04 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:02:04.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:04 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:02:04.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:04 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:02:04.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:04 smithi186 ceph-mon[41182]: Adjusting osd_memory_target on smithi186 to 4317M 2023-12-17T12:02:04.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:04 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:04.977 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:04 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:04.977 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:04 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:02:04.977 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:04 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:04.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:04 smithi008 ceph-mon[36830]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2023-12-17T12:02:04.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:04 smithi008 ceph-mon[36830]: osdmap e77: 12 total, 11 up, 12 in 2023-12-17T12:02:04.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:04 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-17T12:02:04.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:04 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-17T12:02:04.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:04 smithi008 ceph-mon[36830]: Detected new or changed devices on smithi186 2023-12-17T12:02:04.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:04 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:04.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:04 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:04.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:04 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:02:04.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:04 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:02:04.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:04 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:02:04.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:04 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:02:04.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:04 smithi008 ceph-mon[36830]: Adjusting osd_memory_target on smithi186 to 4317M 2023-12-17T12:02:04.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:04 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:04.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:04 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:04.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:04 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:02:04.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:04 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:05.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:04 smithi100 ceph-mon[41266]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi186", "root=default"]}]': finished 2023-12-17T12:02:05.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:04 smithi100 ceph-mon[41266]: osdmap e77: 12 total, 11 up, 12 in 2023-12-17T12:02:05.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:04 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-17T12:02:05.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:04 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-17T12:02:05.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:04 smithi100 ceph-mon[41266]: Detected new or changed devices on smithi186 2023-12-17T12:02:05.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:04 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:05.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:04 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:05.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:04 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:02:05.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:04 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:02:05.167 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:04 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:02:05.167 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:04 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-12-17T12:02:05.167 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:04 smithi100 ceph-mon[41266]: Adjusting osd_memory_target on smithi186 to 4317M 2023-12-17T12:02:05.167 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:04 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:05.167 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:04 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:05.167 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:04 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:02:05.167 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:04 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:05.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:05 smithi186 ceph-mon[41182]: purged_snaps scrub starts 2023-12-17T12:02:05.977 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:05 smithi186 ceph-mon[41182]: purged_snaps scrub ok 2023-12-17T12:02:05.977 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:05 smithi186 ceph-mon[41182]: osd.11 [v2:172.21.15.186:6824/3779371472,v1:172.21.15.186:6825/3779371472] boot 2023-12-17T12:02:05.977 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:05 smithi186 ceph-mon[41182]: osdmap e78: 12 total, 12 up, 12 in 2023-12-17T12:02:05.977 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:05 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-17T12:02:05.977 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:05 smithi186 ceph-mon[41182]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:05.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:05 smithi008 ceph-mon[36830]: purged_snaps scrub starts 2023-12-17T12:02:05.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:05 smithi008 ceph-mon[36830]: purged_snaps scrub ok 2023-12-17T12:02:05.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:05 smithi008 ceph-mon[36830]: osd.11 [v2:172.21.15.186:6824/3779371472,v1:172.21.15.186:6825/3779371472] boot 2023-12-17T12:02:05.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:05 smithi008 ceph-mon[36830]: osdmap e78: 12 total, 12 up, 12 in 2023-12-17T12:02:05.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:05 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-17T12:02:05.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:05 smithi008 ceph-mon[36830]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:06.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.082+0000 7fd0324f9700 1 -- 172.21.15.8:0/2708786466 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd02c101620 msgr2=0x7fd02c101a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:06.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.082+0000 7fd0324f9700 1 --2- 172.21.15.8:0/2708786466 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd02c101620 0x7fd02c101a40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd01c0099c0 tx=0x7fd01c009cd0 comp rx=0 tx=0).stop 2023-12-17T12:02:06.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.082+0000 7fd0324f9700 1 -- 172.21.15.8:0/2708786466 shutdown_connections 2023-12-17T12:02:06.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.082+0000 7fd0324f9700 1 --2- 172.21.15.8:0/2708786466 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd02c1031c0 0x7fd02c109a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:06.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.082+0000 7fd0324f9700 1 --2- 172.21.15.8:0/2708786466 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd02c101620 0x7fd02c101a40 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:06.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.082+0000 7fd0324f9700 1 --2- 172.21.15.8:0/2708786466 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd02c102820 0x7fd02c102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:06.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.082+0000 7fd0324f9700 1 -- 172.21.15.8:0/2708786466 >> 172.21.15.8:0/2708786466 conn(0x7fd02c0fcbe0 msgr2=0x7fd02c0ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:06.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.082+0000 7fd0324f9700 1 -- 172.21.15.8:0/2708786466 shutdown_connections 2023-12-17T12:02:06.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.082+0000 7fd0324f9700 1 -- 172.21.15.8:0/2708786466 wait complete. 2023-12-17T12:02:06.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.083+0000 7fd0324f9700 1 Processor -- start 2023-12-17T12:02:06.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.083+0000 7fd0324f9700 1 -- start start 2023-12-17T12:02:06.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.083+0000 7fd0324f9700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd02c101620 0x7fd02c199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:06.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.083+0000 7fd0324f9700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd02c102820 0x7fd02c199c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:06.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.083+0000 7fd0324f9700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd02c1031c0 0x7fd02c1a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:06.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.083+0000 7fd0324f9700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd02c1a1260 con 0x7fd02c102820 2023-12-17T12:02:06.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.083+0000 7fd0324f9700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd02c1a13a0 con 0x7fd02c1031c0 2023-12-17T12:02:06.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.083+0000 7fd0324f9700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd02c1a1530 con 0x7fd02c101620 2023-12-17T12:02:06.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.084+0000 7fd02b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd02c102820 0x7fd02c199c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:06.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.084+0000 7fd02b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd02c102820 0x7fd02c199c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50134/0 (socket says 172.21.15.8:50134) 2023-12-17T12:02:06.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.084+0000 7fd02b7fe700 1 -- 172.21.15.8:0/1763086038 learned_addr learned my addr 172.21.15.8:0/1763086038 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:02:06.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.084+0000 7fd02bfff700 1 --2- 172.21.15.8:0/1763086038 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd02c101620 0x7fd02c199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:06.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.084+0000 7fd030a96700 1 --2- 172.21.15.8:0/1763086038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd02c1031c0 0x7fd02c1a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:06.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.084+0000 7fd02b7fe700 1 -- 172.21.15.8:0/1763086038 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd02c101620 msgr2=0x7fd02c199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:06.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.084+0000 7fd02b7fe700 1 --2- 172.21.15.8:0/1763086038 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd02c101620 0x7fd02c199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:06.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.084+0000 7fd02b7fe700 1 -- 172.21.15.8:0/1763086038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd02c1031c0 msgr2=0x7fd02c1a0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:06.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.084+0000 7fd02b7fe700 1 --2- 172.21.15.8:0/1763086038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd02c1031c0 0x7fd02c1a0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:06.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.084+0000 7fd02b7fe700 1 -- 172.21.15.8:0/1763086038 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd01c0095f0 con 0x7fd02c102820 2023-12-17T12:02:06.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.084+0000 7fd030a96700 1 --2- 172.21.15.8:0/1763086038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd02c1031c0 0x7fd02c1a0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T12:02:06.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.084+0000 7fd02b7fe700 1 --2- 172.21.15.8:0/1763086038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd02c102820 0x7fd02c199c60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd02000d980 tx=0x7fd02000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:06.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.085+0000 7fd0297fa700 1 -- 172.21.15.8:0/1763086038 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd020009b40 con 0x7fd02c102820 2023-12-17T12:02:06.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.085+0000 7fd0297fa700 1 -- 172.21.15.8:0/1763086038 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd02000b6e0 con 0x7fd02c102820 2023-12-17T12:02:06.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.085+0000 7fd0324f9700 1 -- 172.21.15.8:0/1763086038 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd02c1a1810 con 0x7fd02c102820 2023-12-17T12:02:06.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.085+0000 7fd0297fa700 1 -- 172.21.15.8:0/1763086038 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd02000f3c0 con 0x7fd02c102820 2023-12-17T12:02:06.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.085+0000 7fd0324f9700 1 -- 172.21.15.8:0/1763086038 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd02c1a1d60 con 0x7fd02c102820 2023-12-17T12:02:06.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.086+0000 7fd0324f9700 1 -- 172.21.15.8:0/1763086038 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd02c04f290 con 0x7fd02c102820 2023-12-17T12:02:06.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.088+0000 7fd0297fa700 1 -- 172.21.15.8:0/1763086038 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7fd020010460 con 0x7fd02c102820 2023-12-17T12:02:06.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.089+0000 7fd0297fa700 1 --2- 172.21.15.8:0/1763086038 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fd0140a1500 0x7fd0140a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:06.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.089+0000 7fd0297fa700 1 -- 172.21.15.8:0/1763086038 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fd0200cc740 con 0x7fd02c102820 2023-12-17T12:02:06.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.089+0000 7fd02bfff700 1 --2- 172.21.15.8:0/1763086038 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fd0140a1500 0x7fd0140a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:06.092 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.090+0000 7fd02bfff700 1 --2- 172.21.15.8:0/1763086038 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fd0140a1500 0x7fd0140a39c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd01c006010 tx=0x7fd01c003740 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:06.096 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.093+0000 7fd0297fa700 1 -- 172.21.15.8:0/1763086038 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fd0200961a0 con 0x7fd02c102820 2023-12-17T12:02:06.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:05 smithi100 ceph-mon[41266]: purged_snaps scrub starts 2023-12-17T12:02:06.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:05 smithi100 ceph-mon[41266]: purged_snaps scrub ok 2023-12-17T12:02:06.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:05 smithi100 ceph-mon[41266]: osd.11 [v2:172.21.15.186:6824/3779371472,v1:172.21.15.186:6825/3779371472] boot 2023-12-17T12:02:06.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:05 smithi100 ceph-mon[41266]: osdmap e78: 12 total, 12 up, 12 in 2023-12-17T12:02:06.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:05 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-12-17T12:02:06.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:05 smithi100 ceph-mon[41266]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:06.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.303+0000 7fd0324f9700 1 -- 172.21.15.8:0/1763086038 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fd02c10cdb0 con 0x7fd02c102820 2023-12-17T12:02:06.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.304+0000 7fd0297fa700 1 -- 172.21.15.8:0/1763086038 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v79) v1 ==== 74+0+133 (secure 0 0 0) 0x7fd0200997c0 con 0x7fd02c102820 2023-12-17T12:02:06.307 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:02:06.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.306+0000 7fd0324f9700 1 -- 172.21.15.8:0/1763086038 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fd0140a1500 msgr2=0x7fd0140a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:06.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.306+0000 7fd0324f9700 1 --2- 172.21.15.8:0/1763086038 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fd0140a1500 0x7fd0140a39c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd01c006010 tx=0x7fd01c003740 comp rx=0 tx=0).stop 2023-12-17T12:02:06.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.306+0000 7fd0324f9700 1 -- 172.21.15.8:0/1763086038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd02c102820 msgr2=0x7fd02c199c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:06.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.306+0000 7fd0324f9700 1 --2- 172.21.15.8:0/1763086038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd02c102820 0x7fd02c199c60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fd02000d980 tx=0x7fd02000dc90 comp rx=0 tx=0).stop 2023-12-17T12:02:06.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.306+0000 7fd0324f9700 1 -- 172.21.15.8:0/1763086038 shutdown_connections 2023-12-17T12:02:06.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.306+0000 7fd0324f9700 1 --2- 172.21.15.8:0/1763086038 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fd0140a1500 0x7fd0140a39c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:06.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.306+0000 7fd0324f9700 1 --2- 172.21.15.8:0/1763086038 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd02c1031c0 0x7fd02c1a0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:06.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.306+0000 7fd0324f9700 1 --2- 172.21.15.8:0/1763086038 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd02c101620 0x7fd02c199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:06.309 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.306+0000 7fd0324f9700 1 --2- 172.21.15.8:0/1763086038 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd02c102820 0x7fd02c199c60 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:06.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.306+0000 7fd0324f9700 1 -- 172.21.15.8:0/1763086038 >> 172.21.15.8:0/1763086038 conn(0x7fd02c0fcbe0 msgr2=0x7fd02c108090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:06.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.306+0000 7fd0324f9700 1 -- 172.21.15.8:0/1763086038 shutdown_connections 2023-12-17T12:02:06.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:06.306+0000 7fd0324f9700 1 -- 172.21.15.8:0/1763086038 wait complete. 2023-12-17T12:02:06.709 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":79,"num_osds":12,"num_up_osds":12,"osd_up_since":1702814524,"num_in_osds":12,"osd_in_since":1702814505,"num_remapped_pgs":0} 2023-12-17T12:02:06.710 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph osd dump --format=json 2023-12-17T12:02:06.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:06 smithi186 ceph-mon[41182]: osdmap e79: 12 total, 12 up, 12 in 2023-12-17T12:02:06.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:06 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/1763086038' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-17T12:02:06.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:06 smithi008 ceph-mon[36830]: osdmap e79: 12 total, 12 up, 12 in 2023-12-17T12:02:06.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:06 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/1763086038' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-17T12:02:07.126 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:02:07.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:06 smithi100 ceph-mon[41266]: osdmap e79: 12 total, 12 up, 12 in 2023-12-17T12:02:07.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:06 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/1763086038' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-12-17T12:02:07.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:07 smithi186 ceph-mon[41182]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:07.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:07 smithi008 ceph-mon[36830]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:08.165 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:07 smithi100 ceph-mon[41266]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:08.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.347+0000 7f9d21e17700 1 -- 172.21.15.8:0/414967371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d1c102040 msgr2=0x7f9d1c10e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:08.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.347+0000 7f9d21e17700 1 --2- 172.21.15.8:0/414967371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d1c102040 0x7f9d1c10e430 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9d1400b0a0 tx=0x7f9d1400b3b0 comp rx=0 tx=0).stop 2023-12-17T12:02:08.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.347+0000 7f9d21e17700 1 -- 172.21.15.8:0/414967371 shutdown_connections 2023-12-17T12:02:08.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.347+0000 7f9d21e17700 1 --2- 172.21.15.8:0/414967371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d1c102040 0x7f9d1c10e430 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:08.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.347+0000 7f9d21e17700 1 --2- 172.21.15.8:0/414967371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d1c1076f0 0x7f9d1c107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:08.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.347+0000 7f9d21e17700 1 --2- 172.21.15.8:0/414967371 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d1c101680 0x7f9d1c101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:08.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.347+0000 7f9d21e17700 1 -- 172.21.15.8:0/414967371 >> 172.21.15.8:0/414967371 conn(0x7f9d1c0787c0 msgr2=0x7f9d1c078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:08.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.347+0000 7f9d21e17700 1 -- 172.21.15.8:0/414967371 shutdown_connections 2023-12-17T12:02:08.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.347+0000 7f9d21e17700 1 -- 172.21.15.8:0/414967371 wait complete. 2023-12-17T12:02:08.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.348+0000 7f9d21e17700 1 Processor -- start 2023-12-17T12:02:08.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.348+0000 7f9d21e17700 1 -- start start 2023-12-17T12:02:08.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.348+0000 7f9d21e17700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d1c101680 0x7f9d1c19f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:08.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.348+0000 7f9d21e17700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d1c102040 0x7f9d1c19fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:08.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.348+0000 7f9d21e17700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d1c1076f0 0x7f9d1c199a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:08.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.348+0000 7f9d21e17700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c19a090 con 0x7f9d1c1076f0 2023-12-17T12:02:08.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.348+0000 7f9d21e17700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c19a200 con 0x7f9d1c102040 2023-12-17T12:02:08.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.348+0000 7f9d21e17700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1c19a3c0 con 0x7f9d1c101680 2023-12-17T12:02:08.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.349+0000 7f9d1bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d1c1076f0 0x7f9d1c199a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:08.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.349+0000 7f9d1bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d1c1076f0 0x7f9d1c199a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50152/0 (socket says 172.21.15.8:50152) 2023-12-17T12:02:08.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.349+0000 7f9d1bfff700 1 -- 172.21.15.8:0/3580407759 learned_addr learned my addr 172.21.15.8:0/3580407759 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:02:08.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.349+0000 7f9d1affd700 1 --2- 172.21.15.8:0/3580407759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d1c102040 0x7f9d1c19fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:08.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.349+0000 7f9d1b7fe700 1 --2- 172.21.15.8:0/3580407759 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d1c101680 0x7f9d1c19f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:08.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.349+0000 7f9d1bfff700 1 -- 172.21.15.8:0/3580407759 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d1c101680 msgr2=0x7f9d1c19f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:08.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.349+0000 7f9d1bfff700 1 --2- 172.21.15.8:0/3580407759 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d1c101680 0x7f9d1c19f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:08.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.349+0000 7f9d1bfff700 1 -- 172.21.15.8:0/3580407759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d1c102040 msgr2=0x7f9d1c19fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:08.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.349+0000 7f9d1bfff700 1 --2- 172.21.15.8:0/3580407759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d1c102040 0x7f9d1c19fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:08.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.349+0000 7f9d1bfff700 1 -- 172.21.15.8:0/3580407759 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d14009d00 con 0x7f9d1c1076f0 2023-12-17T12:02:08.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.349+0000 7f9d1b7fe700 1 --2- 172.21.15.8:0/3580407759 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d1c101680 0x7f9d1c19f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T12:02:08.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.349+0000 7f9d1bfff700 1 --2- 172.21.15.8:0/3580407759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d1c1076f0 0x7f9d1c199a30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9d14007930 tx=0x7f9d14007960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:08.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.350+0000 7f9d18ff9700 1 -- 172.21.15.8:0/3580407759 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1400e040 con 0x7f9d1c1076f0 2023-12-17T12:02:08.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.350+0000 7f9d21e17700 1 -- 172.21.15.8:0/3580407759 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d1c19a640 con 0x7f9d1c1076f0 2023-12-17T12:02:08.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.350+0000 7f9d18ff9700 1 -- 172.21.15.8:0/3580407759 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9d140094a0 con 0x7f9d1c1076f0 2023-12-17T12:02:08.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.350+0000 7f9d18ff9700 1 -- 172.21.15.8:0/3580407759 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d140052a0 con 0x7f9d1c1076f0 2023-12-17T12:02:08.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.350+0000 7f9d21e17700 1 -- 172.21.15.8:0/3580407759 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d1c1a68e0 con 0x7f9d1c1076f0 2023-12-17T12:02:08.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.351+0000 7f9d21e17700 1 -- 172.21.15.8:0/3580407759 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d1c102d10 con 0x7f9d1c1076f0 2023-12-17T12:02:08.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.353+0000 7f9d18ff9700 1 -- 172.21.15.8:0/3580407759 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7f9d14004c50 con 0x7f9d1c1076f0 2023-12-17T12:02:08.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.355+0000 7f9d18ff9700 1 --2- 172.21.15.8:0/3580407759 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f9d040a1480 0x7f9d040a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:08.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.355+0000 7f9d18ff9700 1 -- 172.21.15.8:0/3580407759 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f9d140ce4c0 con 0x7f9d1c1076f0 2023-12-17T12:02:08.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.355+0000 7f9d1b7fe700 1 --2- 172.21.15.8:0/3580407759 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f9d040a1480 0x7f9d040a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:08.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.355+0000 7f9d1b7fe700 1 --2- 172.21.15.8:0/3580407759 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f9d040a1480 0x7f9d040a3940 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c005e10 tx=0x7f9d0c005d60 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:08.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.357+0000 7f9d18ff9700 1 -- 172.21.15.8:0/3580407759 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f9d14097fb0 con 0x7f9d1c1076f0 2023-12-17T12:02:08.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.568+0000 7f9d21e17700 1 -- 172.21.15.8:0/3580407759 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d1c04f290 con 0x7f9d1c1076f0 2023-12-17T12:02:08.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.569+0000 7f9d18ff9700 1 -- 172.21.15.8:0/3580407759 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+18349 (secure 0 0 0) 0x7f9d1409b5d0 con 0x7f9d1c1076f0 2023-12-17T12:02:08.572 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:02:08.572 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":79,"fsid":"f43f508a-9cd2-11ee-95a5-87774f69a715","created":"2023-12-17T11:55:30.666634+0000","modified":"2023-12-17T12:02:05.664519+0000","last_up_change":"2023-12-17T12:02:04.656573+0000","last_in_change":"2023-12-17T12:01:45.526832+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:58:43.972745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1f8acaf-a47b-4b74-a78d-e0b6be49a10e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6803","nonce":297519189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6805","nonce":297519189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6809","nonce":297519189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6807","nonce":297519189}]},"public_addr":"172.21.15.8:6803/297519189","cluster_addr":"172.21.15.8:6805/297519189","heartbeat_back_addr":"172.21.15.8:6809/297519189","heartbeat_front_addr":"172.21.15.8:6807/297519189","state":["exists","up"]},{"osd":1,"uuid":"d7138889-77de-43ba-b36b-7628f6f66bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6801","nonce":2496516573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6803","nonce":2496516573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6807","nonce":2496516573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6805","nonce":2496516573}]},"public_addr":"172.21.15.100:6801/2496516573","cluster_addr":"172.21.15.100:6803/2496516573","heartbeat_back_addr":"172.21.15.100:6807/2496516573","heartbeat_front_addr":"172.21.15.100:6805/2496516573","state":["exists","up"]},{"osd":2,"uuid":"ff452a6b-a11e-47be-9eaf-ec1001b51447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6801","nonce":2454925270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6803","nonce":2454925270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6807","nonce":2454925270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6805","nonce":2454925270}]},"public_addr":"172.21.15.186:6801/2454925270","cluster_addr":"172.21.15.186:6803/2454925270","heartbeat_back_addr":"172.21.15.186:6807/2454925270","heartbeat_front_addr":"172.21.15.186:6805/2454925270","state":["exists","up"]},{"osd":3,"uuid":"d19ab765-df7b-48c7-9012-8a3ac7d81aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6811","nonce":1141622701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6813","nonce":1141622701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6817","nonce":1141622701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6815","nonce":1141622701}]},"public_addr":"172.21.15.8:6811/1141622701","cluster_addr":"172.21.15.8:6813/1141622701","heartbeat_back_addr":"172.21.15.8:6817/1141622701","heartbeat_front_addr":"172.21.15.8:6815/1141622701","state":["exists","up"]},{"osd":4,"uuid":"8ecc3a01-f19a-40a7-93a2-8870116afe6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6809","nonce":1902152516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6811","nonce":1902152516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6815","nonce":1902152516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6813","nonce":1902152516}]},"public_addr":"172.21.15.100:6809/1902152516","cluster_addr":"172.21.15.100:6811/1902152516","heartbeat_back_addr":"172.21.15.100:6815/1902152516","heartbeat_front_addr":"172.21.15.100:6813/1902152516","state":["exists","up"]},{"osd":5,"uuid":"ac057cc9-2a27-4216-a7ae-fc60d9796eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6809","nonce":648349934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6811","nonce":648349934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6815","nonce":648349934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6813","nonce":648349934}]},"public_addr":"172.21.15.186:6809/648349934","cluster_addr":"172.21.15.186:6811/648349934","heartbeat_back_addr":"172.21.15.186:6815/648349934","heartbeat_front_addr":"172.21.15.186:6813/648349934","state":["exists","up"]},{"osd":6,"uuid":"bb5325e0-fe12-4bbc-96a9-86c228106a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6819","nonce":3266909294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6821","nonce":3266909294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6825","nonce":3266909294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6823","nonce":3266909294}]},"public_addr":"172.21.15.8:6819/3266909294","cluster_addr":"172.21.15.8:6821/3266909294","heartbeat_back_addr":"172.21.15.8:6825/3266909294","heartbeat_front_addr":"172.21.15.8:6823/3266909294","state":["exists","up"]},{"osd":7,"uuid":"48939d99-29dd-436b-b9f1-fdfe1ee26315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6817","nonce":1631494583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6819","nonce":1631494583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6823","nonce":1631494583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6821","nonce":1631494583}]},"public_addr":"172.21.15.100:6817/1631494583","cluster_addr":"172.21.15.100:6819/1631494583","heartbeat_back_addr":"172.21.15.100:6823/1631494583","heartbeat_front_addr":"172.21.15.100:6821/1631494583","state":["exists","up"]},{"osd":8,"uuid":"e3414f7f-7665-406f-89ec-79cbb3d3e274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6817","nonce":3569004799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6819","nonce":3569004799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6823","nonce":3569004799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6821","nonce":3569004799}]},"public_addr":"172.21.15.186:6817/3569004799","cluster_addr":"172.21.15.186:6819/3569004799","heartbeat_back_addr":"172.21.15.186:6823/3569004799","heartbeat_front_addr":"172.21.15.186:6821/3569004799","state":["exists","up"]},{"osd":9,"uuid":"b04f519d-6e44-4158-b6e1-aa4d64be3404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6827","nonce":3980647643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6829","nonce":3980647643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6833","nonce":3980647643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6831","nonce":3980647643}]},"public_addr":"172.21.15.8:6827/3980647643","cluster_addr":"172.21.15.8:6829/3980647643","heartbeat_back_addr":"172.21.15.8:6833/3980647643","heartbeat_front_addr":"172.21.15.8:6831/3980647643","state":["exists","up"]},{"osd":10,"uuid":"779fde04-620b-4b44-bd35-39be1470eec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6825","nonce":34112410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6827","nonce":34112410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6831","nonce":34112410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6829","nonce":34112410}]},"public_addr":"172.21.15.100:6825/34112410","cluster_addr":"172.21.15.100:6827/34112410","heartbeat_back_addr":"172.21.15.100:6831/34112410","heartbeat_front_addr":"172.21.15.100:6829/34112410","state":["exists","up"]},{"osd":11,"uuid":"6bbcb42f-aa99-44e4-9c3f-d818423eb5b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6825","nonce":3779371472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6827","nonce":3779371472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6831","nonce":3779371472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6829","nonce":3779371472}]},"public_addr":"172.21.15.186:6825/3779371472","cluster_addr":"172.21.15.186:6827/3779371472","heartbeat_back_addr":"172.21.15.186:6831/3779371472","heartbeat_front_addr":"172.21.15.186:6829/3779371472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:57:56.955667+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:58:18.433916+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:58:40.589590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:59:03.635858+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:59:25.544564+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:59:48.171593+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:00:10.876885+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:00:32.920759+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:00:55.273330+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:01:18.131720+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:01:40.259620+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:02:02.776536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/4074020814":"2023-12-18T11:56:27.362306+0000","172.21.15.8:6801/222068650":"2023-12-18T11:56:27.362306+0000","172.21.15.8:6801/4187398661":"2023-12-18T11:56:00.731492+0000","172.21.15.8:6800/222068650":"2023-12-18T11:56:27.362306+0000","172.21.15.8:6800/4187398661":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/2964092603":"2023-12-18T11:56:27.362306+0000","172.21.15.8:0/35186087":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/1429868241":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/174719729":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/2106317618":"2023-12-18T11:56:27.362306+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T12:02:08.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.571+0000 7f9d21e17700 1 -- 172.21.15.8:0/3580407759 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f9d040a1480 msgr2=0x7f9d040a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:08.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.571+0000 7f9d21e17700 1 --2- 172.21.15.8:0/3580407759 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f9d040a1480 0x7f9d040a3940 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9d0c005e10 tx=0x7f9d0c005d60 comp rx=0 tx=0).stop 2023-12-17T12:02:08.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.571+0000 7f9d21e17700 1 -- 172.21.15.8:0/3580407759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d1c1076f0 msgr2=0x7f9d1c199a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:08.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.571+0000 7f9d21e17700 1 --2- 172.21.15.8:0/3580407759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d1c1076f0 0x7f9d1c199a30 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9d14007930 tx=0x7f9d14007960 comp rx=0 tx=0).stop 2023-12-17T12:02:08.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.572+0000 7f9d21e17700 1 -- 172.21.15.8:0/3580407759 shutdown_connections 2023-12-17T12:02:08.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.572+0000 7f9d21e17700 1 --2- 172.21.15.8:0/3580407759 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f9d040a1480 0x7f9d040a3940 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:08.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.572+0000 7f9d21e17700 1 --2- 172.21.15.8:0/3580407759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9d1c1076f0 0x7f9d1c199a30 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:08.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.572+0000 7f9d21e17700 1 --2- 172.21.15.8:0/3580407759 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9d1c101680 0x7f9d1c19f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:08.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.572+0000 7f9d21e17700 1 --2- 172.21.15.8:0/3580407759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9d1c102040 0x7f9d1c19fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:08.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.572+0000 7f9d21e17700 1 -- 172.21.15.8:0/3580407759 >> 172.21.15.8:0/3580407759 conn(0x7f9d1c0787c0 msgr2=0x7f9d1c10ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:08.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.572+0000 7f9d21e17700 1 -- 172.21.15.8:0/3580407759 shutdown_connections 2023-12-17T12:02:08.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:08.572+0000 7f9d21e17700 1 -- 172.21.15.8:0/3580407759 wait complete. 2023-12-17T12:02:08.945 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:08 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/3580407759' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:02:08.976 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-17T11:58:43.972745+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-17T12:02:08.976 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph osd pool get .mgr pg_num 2023-12-17T12:02:08.977 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:08 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/3580407759' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:02:09.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:08 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/3580407759' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:02:09.394 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:02:09.933 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:09 smithi008 ceph-mon[36830]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:09.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:09 smithi186 ceph-mon[41182]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:10.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:09 smithi100 ceph-mon[41266]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:10.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.600+0000 7fdf369b6700 1 -- 172.21.15.8:0/1626655318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf30102040 msgr2=0x7fdf3010e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:10.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.600+0000 7fdf369b6700 1 --2- 172.21.15.8:0/1626655318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf30102040 0x7fdf3010e430 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fdf2800b0a0 tx=0x7fdf2800b3b0 comp rx=0 tx=0).stop 2023-12-17T12:02:10.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.600+0000 7fdf369b6700 1 -- 172.21.15.8:0/1626655318 shutdown_connections 2023-12-17T12:02:10.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.600+0000 7fdf369b6700 1 --2- 172.21.15.8:0/1626655318 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf30102040 0x7fdf3010e430 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:10.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.600+0000 7fdf369b6700 1 --2- 172.21.15.8:0/1626655318 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf301076f0 0x7fdf30107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:10.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.600+0000 7fdf369b6700 1 --2- 172.21.15.8:0/1626655318 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf30101680 0x7fdf30101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:10.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.600+0000 7fdf369b6700 1 -- 172.21.15.8:0/1626655318 >> 172.21.15.8:0/1626655318 conn(0x7fdf300787c0 msgr2=0x7fdf30078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:10.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.600+0000 7fdf369b6700 1 -- 172.21.15.8:0/1626655318 shutdown_connections 2023-12-17T12:02:10.603 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.600+0000 7fdf369b6700 1 -- 172.21.15.8:0/1626655318 wait complete. 2023-12-17T12:02:10.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.601+0000 7fdf369b6700 1 Processor -- start 2023-12-17T12:02:10.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.601+0000 7fdf369b6700 1 -- start start 2023-12-17T12:02:10.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.601+0000 7fdf369b6700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf30101680 0x7fdf3019f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:10.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.601+0000 7fdf369b6700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf30102040 0x7fdf3019fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:10.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.602+0000 7fdf369b6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf301076f0 0x7fdf301999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:10.604 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.602+0000 7fdf369b6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3019a050 con 0x7fdf301076f0 2023-12-17T12:02:10.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.602+0000 7fdf369b6700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3019a1c0 con 0x7fdf30101680 2023-12-17T12:02:10.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.602+0000 7fdf369b6700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3019a380 con 0x7fdf30102040 2023-12-17T12:02:10.605 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.602+0000 7fdf34f53700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf301076f0 0x7fdf301999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:10.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.602+0000 7fdf34f53700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf301076f0 0x7fdf301999f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50172/0 (socket says 172.21.15.8:50172) 2023-12-17T12:02:10.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.602+0000 7fdf2f7fe700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf30102040 0x7fdf3019fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:10.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.602+0000 7fdf34f53700 1 -- 172.21.15.8:0/743020084 learned_addr learned my addr 172.21.15.8:0/743020084 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:02:10.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.602+0000 7fdf2ffff700 1 --2- 172.21.15.8:0/743020084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf30101680 0x7fdf3019f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:10.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.602+0000 7fdf34f53700 1 -- 172.21.15.8:0/743020084 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf30102040 msgr2=0x7fdf3019fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:10.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.602+0000 7fdf34f53700 1 --2- 172.21.15.8:0/743020084 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf30102040 0x7fdf3019fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:10.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.602+0000 7fdf34f53700 1 -- 172.21.15.8:0/743020084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf30101680 msgr2=0x7fdf3019f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:10.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.602+0000 7fdf34f53700 1 --2- 172.21.15.8:0/743020084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf30101680 0x7fdf3019f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:10.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.602+0000 7fdf34f53700 1 -- 172.21.15.8:0/743020084 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf28009d00 con 0x7fdf301076f0 2023-12-17T12:02:10.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.602+0000 7fdf2ffff700 1 --2- 172.21.15.8:0/743020084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf30101680 0x7fdf3019f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T12:02:10.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.603+0000 7fdf34f53700 1 --2- 172.21.15.8:0/743020084 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf301076f0 0x7fdf301999f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdf2800b070 tx=0x7fdf2800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:10.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.603+0000 7fdf2d7fa700 1 -- 172.21.15.8:0/743020084 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2800e040 con 0x7fdf301076f0 2023-12-17T12:02:10.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.603+0000 7fdf2d7fa700 1 -- 172.21.15.8:0/743020084 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdf28003e90 con 0x7fdf301076f0 2023-12-17T12:02:10.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.603+0000 7fdf369b6700 1 -- 172.21.15.8:0/743020084 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf3019a600 con 0x7fdf301076f0 2023-12-17T12:02:10.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.603+0000 7fdf2d7fa700 1 -- 172.21.15.8:0/743020084 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf28005040 con 0x7fdf301076f0 2023-12-17T12:02:10.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.603+0000 7fdf369b6700 1 -- 172.21.15.8:0/743020084 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf301a68a0 con 0x7fdf301076f0 2023-12-17T12:02:10.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.604+0000 7fdf369b6700 1 -- 172.21.15.8:0/743020084 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf30104940 con 0x7fdf301076f0 2023-12-17T12:02:10.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.606+0000 7fdf2d7fa700 1 -- 172.21.15.8:0/743020084 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7fdf2801d610 con 0x7fdf301076f0 2023-12-17T12:02:10.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.607+0000 7fdf2d7fa700 1 --2- 172.21.15.8:0/743020084 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fdf180a1500 0x7fdf180a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:10.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.608+0000 7fdf2d7fa700 1 -- 172.21.15.8:0/743020084 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fdf280cd9c0 con 0x7fdf301076f0 2023-12-17T12:02:10.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.608+0000 7fdf2ffff700 1 --2- 172.21.15.8:0/743020084 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fdf180a1500 0x7fdf180a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:10.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.608+0000 7fdf2ffff700 1 --2- 172.21.15.8:0/743020084 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fdf180a1500 0x7fdf180a39c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdf20011490 tx=0x7fdf20009260 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:10.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.611+0000 7fdf2d7fa700 1 -- 172.21.15.8:0/743020084 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fdf280974b0 con 0x7fdf301076f0 2023-12-17T12:02:10.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.822+0000 7fdf369b6700 1 -- 172.21.15.8:0/743020084 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdf3019aeb0 con 0x7fdf301076f0 2023-12-17T12:02:10.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.823+0000 7fdf2d7fa700 1 -- 172.21.15.8:0/743020084 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdf28011390 con 0x7fdf301076f0 2023-12-17T12:02:10.826 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-12-17T12:02:10.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.825+0000 7fdf369b6700 1 -- 172.21.15.8:0/743020084 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fdf180a1500 msgr2=0x7fdf180a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:10.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.825+0000 7fdf369b6700 1 --2- 172.21.15.8:0/743020084 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fdf180a1500 0x7fdf180a39c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdf20011490 tx=0x7fdf20009260 comp rx=0 tx=0).stop 2023-12-17T12:02:10.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.825+0000 7fdf369b6700 1 -- 172.21.15.8:0/743020084 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf301076f0 msgr2=0x7fdf301999f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:10.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.825+0000 7fdf369b6700 1 --2- 172.21.15.8:0/743020084 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf301076f0 0x7fdf301999f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fdf2800b070 tx=0x7fdf2800be20 comp rx=0 tx=0).stop 2023-12-17T12:02:10.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.825+0000 7fdf369b6700 1 -- 172.21.15.8:0/743020084 shutdown_connections 2023-12-17T12:02:10.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.825+0000 7fdf369b6700 1 --2- 172.21.15.8:0/743020084 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fdf180a1500 0x7fdf180a39c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:10.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.825+0000 7fdf369b6700 1 --2- 172.21.15.8:0/743020084 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdf301076f0 0x7fdf301999f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:10.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.825+0000 7fdf369b6700 1 --2- 172.21.15.8:0/743020084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdf30101680 0x7fdf3019f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:10.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.825+0000 7fdf369b6700 1 --2- 172.21.15.8:0/743020084 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf30102040 0x7fdf3019fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:10.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.825+0000 7fdf369b6700 1 -- 172.21.15.8:0/743020084 >> 172.21.15.8:0/743020084 conn(0x7fdf300787c0 msgr2=0x7fdf3010caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:10.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.825+0000 7fdf369b6700 1 -- 172.21.15.8:0/743020084 shutdown_connections 2023-12-17T12:02:10.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:10.825+0000 7fdf369b6700 1 -- 172.21.15.8:0/743020084 wait complete. 2023-12-17T12:02:11.188 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:10 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/743020084' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-17T12:02:11.223 INFO:tasks.cephadm:Adding mds.a on smithi008 2023-12-17T12:02:11.223 INFO:tasks.cephadm:Adding mds.d on smithi008 2023-12-17T12:02:11.223 INFO:tasks.cephadm:Adding mds.g on smithi008 2023-12-17T12:02:11.223 INFO:tasks.cephadm:Adding mds.j on smithi008 2023-12-17T12:02:11.223 INFO:tasks.cephadm:Adding mds.b on smithi100 2023-12-17T12:02:11.223 INFO:tasks.cephadm:Adding mds.e on smithi100 2023-12-17T12:02:11.223 INFO:tasks.cephadm:Adding mds.h on smithi100 2023-12-17T12:02:11.224 INFO:tasks.cephadm:Adding mds.k on smithi100 2023-12-17T12:02:11.224 INFO:tasks.cephadm:Adding mds.c on smithi186 2023-12-17T12:02:11.224 INFO:tasks.cephadm:Adding mds.f on smithi186 2023-12-17T12:02:11.224 INFO:tasks.cephadm:Adding mds.i on smithi186 2023-12-17T12:02:11.224 INFO:tasks.cephadm:Adding mds.l on smithi186 2023-12-17T12:02:11.224 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph orch apply mds all '12;smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi100=b;smithi100=e;smithi100=h;smithi100=k;smithi186=c;smithi186=f;smithi186=i;smithi186=l' 2023-12-17T12:02:11.225 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:10 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/743020084' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-17T12:02:11.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:10 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/743020084' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-17T12:02:11.643 INFO:teuthology.orchestra.run.smithi186.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.c/config 2023-12-17T12:02:12.172 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:11 smithi186 ceph-mon[41182]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:12.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:11 smithi008 ceph-mon[36830]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:12.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:11 smithi100 ceph-mon[41266]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:12.860 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.858+0000 7f8594790700 1 -- 172.21.15.186:0/2665058530 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f858c1031c0 msgr2=0x7f858c109a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:12.860 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.858+0000 7f8594790700 1 --2- 172.21.15.186:0/2665058530 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f858c1031c0 0x7f858c109a70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f858400b0a0 tx=0x7f858400b3b0 comp rx=0 tx=0).stop 2023-12-17T12:02:12.861 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.858+0000 7f8594790700 1 -- 172.21.15.186:0/2665058530 shutdown_connections 2023-12-17T12:02:12.861 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.858+0000 7f8594790700 1 --2- 172.21.15.186:0/2665058530 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f858c1031c0 0x7f858c109a70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:12.861 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.858+0000 7f8594790700 1 --2- 172.21.15.186:0/2665058530 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f858c101620 0x7f858c101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:12.861 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.858+0000 7f8594790700 1 --2- 172.21.15.186:0/2665058530 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f858c102820 0x7f858c102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:12.861 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.858+0000 7f8594790700 1 -- 172.21.15.186:0/2665058530 >> 172.21.15.186:0/2665058530 conn(0x7f858c0fcbe0 msgr2=0x7f858c0ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:12.861 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.858+0000 7f8594790700 1 -- 172.21.15.186:0/2665058530 shutdown_connections 2023-12-17T12:02:12.861 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.858+0000 7f8594790700 1 -- 172.21.15.186:0/2665058530 wait complete. 2023-12-17T12:02:12.863 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.859+0000 7f8594790700 1 Processor -- start 2023-12-17T12:02:12.863 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.859+0000 7f8594790700 1 -- start start 2023-12-17T12:02:12.863 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.860+0000 7f8594790700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f858c101620 0x7f858c199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:12.864 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.860+0000 7f8594790700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f858c102820 0x7f858c199c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:12.864 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.860+0000 7f8594790700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f858c1031c0 0x7f858c1a0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:12.864 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.860+0000 7f8594790700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858c1a1280 con 0x7f858c102820 2023-12-17T12:02:12.864 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.860+0000 7f8594790700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858c1a13c0 con 0x7f858c1031c0 2023-12-17T12:02:12.864 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.860+0000 7f8594790700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858c1a1550 con 0x7f858c101620 2023-12-17T12:02:12.864 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.860+0000 7f859252c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f858c101620 0x7f858c199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:12.864 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.860+0000 7f859252c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f858c101620 0x7f858c199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:59982/0 (socket says 172.21.15.186:59982) 2023-12-17T12:02:12.864 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.860+0000 7f859252c700 1 -- 172.21.15.186:0/1397576164 learned_addr learned my addr 172.21.15.186:0/1397576164 (peer_addr_for_me v2:172.21.15.186:0/0) 2023-12-17T12:02:12.864 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.860+0000 7f8591d2b700 1 --2- 172.21.15.186:0/1397576164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f858c102820 0x7f858c199c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:12.864 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.860+0000 7f859252c700 1 -- 172.21.15.186:0/1397576164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f858c1031c0 msgr2=0x7f858c1a0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:12.864 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.860+0000 7f8592d2d700 1 --2- 172.21.15.186:0/1397576164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f858c1031c0 0x7f858c1a0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:12.864 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.860+0000 7f859252c700 1 --2- 172.21.15.186:0/1397576164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f858c1031c0 0x7f858c1a0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:12.865 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.860+0000 7f859252c700 1 -- 172.21.15.186:0/1397576164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f858c102820 msgr2=0x7f858c199c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:12.865 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.860+0000 7f859252c700 1 --2- 172.21.15.186:0/1397576164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f858c102820 0x7f858c199c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:12.865 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.860+0000 7f859252c700 1 -- 172.21.15.186:0/1397576164 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8584009d00 con 0x7f858c101620 2023-12-17T12:02:12.865 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.860+0000 7f8592d2d700 1 --2- 172.21.15.186:0/1397576164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f858c1031c0 0x7f858c1a0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T12:02:12.865 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.861+0000 7f859252c700 1 --2- 172.21.15.186:0/1397576164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f858c101620 0x7f858c199740 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f858800e9a0 tx=0x7f858800ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:12.865 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.861+0000 7f85837fe700 1 -- 172.21.15.186:0/1397576164 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8588009790 con 0x7f858c101620 2023-12-17T12:02:12.865 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.861+0000 7f85837fe700 1 -- 172.21.15.186:0/1397576164 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f85880044b0 con 0x7f858c101620 2023-12-17T12:02:12.865 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.861+0000 7f8594790700 1 -- 172.21.15.186:0/1397576164 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f858c1a1830 con 0x7f858c101620 2023-12-17T12:02:12.865 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.861+0000 7f85837fe700 1 -- 172.21.15.186:0/1397576164 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8588003d00 con 0x7f858c101620 2023-12-17T12:02:12.865 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.861+0000 7f8594790700 1 -- 172.21.15.186:0/1397576164 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f858c1a1d30 con 0x7f858c101620 2023-12-17T12:02:12.866 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.862+0000 7f8594790700 1 -- 172.21.15.186:0/1397576164 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f858c04f290 con 0x7f858c101620 2023-12-17T12:02:12.866 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.864+0000 7f85837fe700 1 -- 172.21.15.186:0/1397576164 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7f8588003e60 con 0x7f858c101620 2023-12-17T12:02:12.867 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.865+0000 7f85837fe700 1 --2- 172.21.15.186:0/1397576164 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f85780a1500 0x7f85780a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:12.867 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.865+0000 7f85837fe700 1 -- 172.21.15.186:0/1397576164 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f8588014070 con 0x7f858c101620 2023-12-17T12:02:12.868 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.866+0000 7f8591d2b700 1 --2- 172.21.15.186:0/1397576164 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f85780a1500 0x7f85780a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:12.868 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.866+0000 7f8591d2b700 1 --2- 172.21.15.186:0/1397576164 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f85780a1500 0x7f85780a39c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f857c005950 tx=0x7f857c0058e0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:12.871 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:12.869+0000 7f85837fe700 1 -- 172.21.15.186:0/1397576164 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f8588096670 con 0x7f858c101620 2023-12-17T12:02:13.079 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:13.077+0000 7f8594790700 1 -- 172.21.15.186:0/1397576164 --> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi100=b;smithi100=e;smithi100=h;smithi100=k;smithi186=c;smithi186=f;smithi186=i;smithi186=l", "target": ["mon-mgr", ""]}) v1 -- 0x7f858c074f20 con 0x7f85780a1500 2023-12-17T12:02:13.088 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:13.086+0000 7f85837fe700 1 -- 172.21.15.186:0/1397576164 <== mgr.14154 v2:172.21.15.8:6800/268548699 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7f858c074f20 con 0x7f85780a1500 2023-12-17T12:02:13.088 INFO:teuthology.orchestra.run.smithi186.stdout:Scheduled mds.all update... 2023-12-17T12:02:13.091 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:13.088+0000 7f8594790700 1 -- 172.21.15.186:0/1397576164 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f85780a1500 msgr2=0x7f85780a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:13.091 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:13.088+0000 7f8594790700 1 --2- 172.21.15.186:0/1397576164 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f85780a1500 0x7f85780a39c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f857c005950 tx=0x7f857c0058e0 comp rx=0 tx=0).stop 2023-12-17T12:02:13.091 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:13.088+0000 7f8594790700 1 -- 172.21.15.186:0/1397576164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f858c101620 msgr2=0x7f858c199740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:13.091 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:13.088+0000 7f8594790700 1 --2- 172.21.15.186:0/1397576164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f858c101620 0x7f858c199740 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f858800e9a0 tx=0x7f858800ed60 comp rx=0 tx=0).stop 2023-12-17T12:02:13.091 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:13.088+0000 7f8594790700 1 -- 172.21.15.186:0/1397576164 shutdown_connections 2023-12-17T12:02:13.091 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:13.089+0000 7f8594790700 1 --2- 172.21.15.186:0/1397576164 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f85780a1500 0x7f85780a39c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:13.091 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:13.089+0000 7f8594790700 1 --2- 172.21.15.186:0/1397576164 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f858c1031c0 0x7f858c1a0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:13.091 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:13.089+0000 7f8594790700 1 --2- 172.21.15.186:0/1397576164 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f858c101620 0x7f858c199740 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:13.091 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:13.089+0000 7f8594790700 1 --2- 172.21.15.186:0/1397576164 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f858c102820 0x7f858c199c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:13.092 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:13.089+0000 7f8594790700 1 -- 172.21.15.186:0/1397576164 >> 172.21.15.186:0/1397576164 conn(0x7f858c0fcbe0 msgr2=0x7f858c073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:13.092 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:13.089+0000 7f8594790700 1 -- 172.21.15.186:0/1397576164 shutdown_connections 2023-12-17T12:02:13.092 INFO:teuthology.orchestra.run.smithi186.stderr:2023-12-17T12:02:13.089+0000 7f8594790700 1 -- 172.21.15.186:0/1397576164 wait complete. 2023-12-17T12:02:13.545 DEBUG:teuthology.orchestra.run.smithi008:mds.a> sudo journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mds.a.service 2023-12-17T12:02:13.550 DEBUG:teuthology.orchestra.run.smithi008:mds.d> sudo journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mds.d.service 2023-12-17T12:02:13.595 DEBUG:teuthology.orchestra.run.smithi008:mds.g> sudo journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mds.g.service 2023-12-17T12:02:13.631 INFO:journalctl@ceph.mds.a.smithi008.stdout:-- Logs begin at Sun 2023-12-17 11:40:41 UTC. -- 2023-12-17T12:02:13.635 DEBUG:teuthology.orchestra.run.smithi008:mds.j> sudo journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mds.j.service 2023-12-17T12:02:13.671 INFO:journalctl@ceph.mds.d.smithi008.stdout:-- Logs begin at Sun 2023-12-17 11:40:41 UTC. -- 2023-12-17T12:02:13.675 DEBUG:teuthology.orchestra.run.smithi100:mds.b> sudo journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mds.b.service 2023-12-17T12:02:13.680 DEBUG:teuthology.orchestra.run.smithi100:mds.e> sudo journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mds.e.service 2023-12-17T12:02:13.706 INFO:journalctl@ceph.mds.g.smithi008.stdout:-- Logs begin at Sun 2023-12-17 11:40:41 UTC. -- 2023-12-17T12:02:13.724 DEBUG:teuthology.orchestra.run.smithi100:mds.h> sudo journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mds.h.service 2023-12-17T12:02:13.743 INFO:journalctl@ceph.mds.j.smithi008.stdout:-- Logs begin at Sun 2023-12-17 11:40:41 UTC. -- 2023-12-17T12:02:13.758 INFO:journalctl@ceph.mds.b.smithi100.stdout:-- Logs begin at Sun 2023-12-17 11:35:53 UTC. -- 2023-12-17T12:02:13.762 DEBUG:teuthology.orchestra.run.smithi100:mds.k> sudo journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mds.k.service 2023-12-17T12:02:13.795 INFO:journalctl@ceph.mds.e.smithi100.stdout:-- Logs begin at Sun 2023-12-17 11:35:53 UTC. -- 2023-12-17T12:02:13.799 DEBUG:teuthology.orchestra.run.smithi186:mds.c> sudo journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mds.c.service 2023-12-17T12:02:13.803 DEBUG:teuthology.orchestra.run.smithi186:mds.f> sudo journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mds.f.service 2023-12-17T12:02:13.832 INFO:journalctl@ceph.mds.h.smithi100.stdout:-- Logs begin at Sun 2023-12-17 11:35:53 UTC. -- 2023-12-17T12:02:13.849 DEBUG:teuthology.orchestra.run.smithi186:mds.i> sudo journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mds.i.service 2023-12-17T12:02:13.865 INFO:journalctl@ceph.mds.k.smithi100.stdout:-- Logs begin at Sun 2023-12-17 11:35:53 UTC. -- 2023-12-17T12:02:13.882 INFO:journalctl@ceph.mds.c.smithi186.stdout:-- Logs begin at Sun 2023-12-17 11:40:47 UTC. -- 2023-12-17T12:02:13.885 DEBUG:teuthology.orchestra.run.smithi186:mds.l> sudo journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mds.l.service 2023-12-17T12:02:13.922 INFO:journalctl@ceph.mds.f.smithi186.stdout:-- Logs begin at Sun 2023-12-17 11:40:47 UTC. -- 2023-12-17T12:02:13.925 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2023-12-17T12:02:13.926 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T12:02:13.956 INFO:journalctl@ceph.mds.i.smithi186.stdout:-- Logs begin at Sun 2023-12-17 11:40:47 UTC. -- 2023-12-17T12:02:13.994 INFO:journalctl@ceph.mds.l.smithi186.stdout:-- Logs begin at Sun 2023-12-17 11:40:47 UTC. -- 2023-12-17T12:02:14.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.145+0000 7fe4e0bff700 1 -- 172.21.15.8:0/3135586471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4dc0755b0 msgr2=0x7fe4dc073a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:14.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.145+0000 7fe4e0bff700 1 --2- 172.21.15.8:0/3135586471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4dc0755b0 0x7fe4dc073a00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc009990 tx=0x7fe4cc009ca0 comp rx=0 tx=0).stop 2023-12-17T12:02:14.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.145+0000 7fe4e0bff700 1 -- 172.21.15.8:0/3135586471 shutdown_connections 2023-12-17T12:02:14.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.145+0000 7fe4e0bff700 1 --2- 172.21.15.8:0/3135586471 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe4dc109370 0x7fe4dc10b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:14.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.145+0000 7fe4e0bff700 1 --2- 172.21.15.8:0/3135586471 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4dc0755b0 0x7fe4dc073a00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:14.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.145+0000 7fe4e0bff700 1 --2- 172.21.15.8:0/3135586471 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4dc073fd0 0x7fe4dc074450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:14.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.145+0000 7fe4e0bff700 1 -- 172.21.15.8:0/3135586471 >> 172.21.15.8:0/3135586471 conn(0x7fe4dc0fca30 msgr2=0x7fe4dc0fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:14.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.145+0000 7fe4e0bff700 1 -- 172.21.15.8:0/3135586471 shutdown_connections 2023-12-17T12:02:14.149 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.146+0000 7fe4e0bff700 1 -- 172.21.15.8:0/3135586471 wait complete. 2023-12-17T12:02:14.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.147+0000 7fe4e0bff700 1 Processor -- start 2023-12-17T12:02:14.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.147+0000 7fe4e0bff700 1 -- start start 2023-12-17T12:02:14.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.147+0000 7fe4e0bff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe4dc073fd0 0x7fe4dc199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:14.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.147+0000 7fe4e0bff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4dc0755b0 0x7fe4dc199ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:14.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.147+0000 7fe4e0bff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4dc109370 0x7fe4dc1a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:14.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.147+0000 7fe4e0bff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc1a10a0 con 0x7fe4dc0755b0 2023-12-17T12:02:14.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.147+0000 7fe4e0bff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc1a11e0 con 0x7fe4dc109370 2023-12-17T12:02:14.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.147+0000 7fe4e0bff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4dc1a1370 con 0x7fe4dc073fd0 2023-12-17T12:02:14.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.147+0000 7fe4d9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4dc0755b0 0x7fe4dc199ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:14.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.147+0000 7fe4d9d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4dc0755b0 0x7fe4dc199ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50932/0 (socket says 172.21.15.8:50932) 2023-12-17T12:02:14.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.147+0000 7fe4d9d9b700 1 -- 172.21.15.8:0/2532165762 learned_addr learned my addr 172.21.15.8:0/2532165762 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:02:14.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.148+0000 7fe4dad9d700 1 --2- 172.21.15.8:0/2532165762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4dc109370 0x7fe4dc1a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:14.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.148+0000 7fe4da59c700 1 --2- 172.21.15.8:0/2532165762 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe4dc073fd0 0x7fe4dc199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:14.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.148+0000 7fe4d9d9b700 1 -- 172.21.15.8:0/2532165762 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe4dc073fd0 msgr2=0x7fe4dc199570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:14.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.148+0000 7fe4d9d9b700 1 --2- 172.21.15.8:0/2532165762 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe4dc073fd0 0x7fe4dc199570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:14.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.148+0000 7fe4d9d9b700 1 -- 172.21.15.8:0/2532165762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4dc109370 msgr2=0x7fe4dc1a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:14.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.148+0000 7fe4d9d9b700 1 --2- 172.21.15.8:0/2532165762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4dc109370 0x7fe4dc1a0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:14.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.148+0000 7fe4d9d9b700 1 -- 172.21.15.8:0/2532165762 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4cc0095f0 con 0x7fe4dc0755b0 2023-12-17T12:02:14.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.148+0000 7fe4dad9d700 1 --2- 172.21.15.8:0/2532165762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4dc109370 0x7fe4dc1a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T12:02:14.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.148+0000 7fe4d9d9b700 1 --2- 172.21.15.8:0/2532165762 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4dc0755b0 0x7fe4dc199ab0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe4d000e9a0 tx=0x7fe4d000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:14.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.148+0000 7fe4cb7fe700 1 -- 172.21.15.8:0/2532165762 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d0009790 con 0x7fe4dc0755b0 2023-12-17T12:02:14.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.148+0000 7fe4cb7fe700 1 -- 172.21.15.8:0/2532165762 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe4d000cbd0 con 0x7fe4dc0755b0 2023-12-17T12:02:14.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.148+0000 7fe4e0bff700 1 -- 172.21.15.8:0/2532165762 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4dc1a1650 con 0x7fe4dc0755b0 2023-12-17T12:02:14.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.148+0000 7fe4cb7fe700 1 -- 172.21.15.8:0/2532165762 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4d0018680 con 0x7fe4dc0755b0 2023-12-17T12:02:14.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.149+0000 7fe4e0bff700 1 -- 172.21.15.8:0/2532165762 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4dc1a1b60 con 0x7fe4dc0755b0 2023-12-17T12:02:14.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.150+0000 7fe4e0bff700 1 -- 172.21.15.8:0/2532165762 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4dc108180 con 0x7fe4dc0755b0 2023-12-17T12:02:14.154 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.151+0000 7fe4cb7fe700 1 -- 172.21.15.8:0/2532165762 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7fe4d000cd40 con 0x7fe4dc0755b0 2023-12-17T12:02:14.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.154+0000 7fe4cb7fe700 1 --2- 172.21.15.8:0/2532165762 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fe4c40a1480 0x7fe4c40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:14.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.154+0000 7fe4cb7fe700 1 -- 172.21.15.8:0/2532165762 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe4d0014070 con 0x7fe4dc0755b0 2023-12-17T12:02:14.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.154+0000 7fe4da59c700 1 --2- 172.21.15.8:0/2532165762 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fe4c40a1480 0x7fe4c40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:14.157 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.154+0000 7fe4da59c700 1 --2- 172.21.15.8:0/2532165762 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fe4c40a1480 0x7fe4c40a3940 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc00b670 tx=0x7fe4cc005fb0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:14.160 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.158+0000 7fe4cb7fe700 1 -- 172.21.15.8:0/2532165762 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe4d00522f0 con 0x7fe4dc0755b0 2023-12-17T12:02:14.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:14 smithi008 ceph-mon[36830]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi100=b;smithi100=e;smithi100=h;smithi100=k;smithi186=c;smithi186=f;smithi186=i;smithi186=l", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:02:14.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:14 smithi008 ceph-mon[36830]: Saving service mds.all spec with placement smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi100=b;smithi100=e;smithi100=h;smithi100=k;smithi186=c;smithi186=f;smithi186=i;smithi186=l;count:12 2023-12-17T12:02:14.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:14 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:14.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:14 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:02:14.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:14 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:14.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:14 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:02:14.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:14 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:14.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:14 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:02:14.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:14 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T12:02:14.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:14 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:14.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:14 smithi008 ceph-mon[36830]: Deploying daemon mds.l on smithi186 2023-12-17T12:02:14.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:14 smithi008 ceph-mon[36830]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:14.365 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:14 smithi186 ceph-mon[41182]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi100=b;smithi100=e;smithi100=h;smithi100=k;smithi186=c;smithi186=f;smithi186=i;smithi186=l", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:02:14.365 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:14 smithi186 ceph-mon[41182]: Saving service mds.all spec with placement smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi100=b;smithi100=e;smithi100=h;smithi100=k;smithi186=c;smithi186=f;smithi186=i;smithi186=l;count:12 2023-12-17T12:02:14.365 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:14 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:14.365 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:14 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:02:14.365 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:14 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:14.365 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:14 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:02:14.366 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:14 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:14.366 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:14 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:02:14.366 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:14 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T12:02:14.366 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:14 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:14.366 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:14 smithi186 ceph-mon[41182]: Deploying daemon mds.l on smithi186 2023-12-17T12:02:14.366 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:14 smithi186 ceph-mon[41182]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:14.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.374+0000 7fe4e0bff700 1 -- 172.21.15.8:0/2532165762 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe4dc0679a0 con 0x7fe4dc0755b0 2023-12-17T12:02:14.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.375+0000 7fe4cb7fe700 1 -- 172.21.15.8:0/2532165762 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+18349 (secure 0 0 0) 0x7fe4d0096660 con 0x7fe4dc0755b0 2023-12-17T12:02:14.378 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:02:14.378 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":79,"fsid":"f43f508a-9cd2-11ee-95a5-87774f69a715","created":"2023-12-17T11:55:30.666634+0000","modified":"2023-12-17T12:02:05.664519+0000","last_up_change":"2023-12-17T12:02:04.656573+0000","last_in_change":"2023-12-17T12:01:45.526832+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:58:43.972745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1f8acaf-a47b-4b74-a78d-e0b6be49a10e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6803","nonce":297519189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6805","nonce":297519189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6809","nonce":297519189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6807","nonce":297519189}]},"public_addr":"172.21.15.8:6803/297519189","cluster_addr":"172.21.15.8:6805/297519189","heartbeat_back_addr":"172.21.15.8:6809/297519189","heartbeat_front_addr":"172.21.15.8:6807/297519189","state":["exists","up"]},{"osd":1,"uuid":"d7138889-77de-43ba-b36b-7628f6f66bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6801","nonce":2496516573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6803","nonce":2496516573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6807","nonce":2496516573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6805","nonce":2496516573}]},"public_addr":"172.21.15.100:6801/2496516573","cluster_addr":"172.21.15.100:6803/2496516573","heartbeat_back_addr":"172.21.15.100:6807/2496516573","heartbeat_front_addr":"172.21.15.100:6805/2496516573","state":["exists","up"]},{"osd":2,"uuid":"ff452a6b-a11e-47be-9eaf-ec1001b51447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6801","nonce":2454925270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6803","nonce":2454925270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6807","nonce":2454925270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6805","nonce":2454925270}]},"public_addr":"172.21.15.186:6801/2454925270","cluster_addr":"172.21.15.186:6803/2454925270","heartbeat_back_addr":"172.21.15.186:6807/2454925270","heartbeat_front_addr":"172.21.15.186:6805/2454925270","state":["exists","up"]},{"osd":3,"uuid":"d19ab765-df7b-48c7-9012-8a3ac7d81aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6811","nonce":1141622701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6813","nonce":1141622701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6817","nonce":1141622701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6815","nonce":1141622701}]},"public_addr":"172.21.15.8:6811/1141622701","cluster_addr":"172.21.15.8:6813/1141622701","heartbeat_back_addr":"172.21.15.8:6817/1141622701","heartbeat_front_addr":"172.21.15.8:6815/1141622701","state":["exists","up"]},{"osd":4,"uuid":"8ecc3a01-f19a-40a7-93a2-8870116afe6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6809","nonce":1902152516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6811","nonce":1902152516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6815","nonce":1902152516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6813","nonce":1902152516}]},"public_addr":"172.21.15.100:6809/1902152516","cluster_addr":"172.21.15.100:6811/1902152516","heartbeat_back_addr":"172.21.15.100:6815/1902152516","heartbeat_front_addr":"172.21.15.100:6813/1902152516","state":["exists","up"]},{"osd":5,"uuid":"ac057cc9-2a27-4216-a7ae-fc60d9796eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6809","nonce":648349934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6811","nonce":648349934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6815","nonce":648349934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6813","nonce":648349934}]},"public_addr":"172.21.15.186:6809/648349934","cluster_addr":"172.21.15.186:6811/648349934","heartbeat_back_addr":"172.21.15.186:6815/648349934","heartbeat_front_addr":"172.21.15.186:6813/648349934","state":["exists","up"]},{"osd":6,"uuid":"bb5325e0-fe12-4bbc-96a9-86c228106a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6819","nonce":3266909294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6821","nonce":3266909294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6825","nonce":3266909294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6823","nonce":3266909294}]},"public_addr":"172.21.15.8:6819/3266909294","cluster_addr":"172.21.15.8:6821/3266909294","heartbeat_back_addr":"172.21.15.8:6825/3266909294","heartbeat_front_addr":"172.21.15.8:6823/3266909294","state":["exists","up"]},{"osd":7,"uuid":"48939d99-29dd-436b-b9f1-fdfe1ee26315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6817","nonce":1631494583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6819","nonce":1631494583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6823","nonce":1631494583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6821","nonce":1631494583}]},"public_addr":"172.21.15.100:6817/1631494583","cluster_addr":"172.21.15.100:6819/1631494583","heartbeat_back_addr":"172.21.15.100:6823/1631494583","heartbeat_front_addr":"172.21.15.100:6821/1631494583","state":["exists","up"]},{"osd":8,"uuid":"e3414f7f-7665-406f-89ec-79cbb3d3e274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6817","nonce":3569004799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6819","nonce":3569004799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6823","nonce":3569004799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6821","nonce":3569004799}]},"public_addr":"172.21.15.186:6817/3569004799","cluster_addr":"172.21.15.186:6819/3569004799","heartbeat_back_addr":"172.21.15.186:6823/3569004799","heartbeat_front_addr":"172.21.15.186:6821/3569004799","state":["exists","up"]},{"osd":9,"uuid":"b04f519d-6e44-4158-b6e1-aa4d64be3404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6827","nonce":3980647643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6829","nonce":3980647643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6833","nonce":3980647643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6831","nonce":3980647643}]},"public_addr":"172.21.15.8:6827/3980647643","cluster_addr":"172.21.15.8:6829/3980647643","heartbeat_back_addr":"172.21.15.8:6833/3980647643","heartbeat_front_addr":"172.21.15.8:6831/3980647643","state":["exists","up"]},{"osd":10,"uuid":"779fde04-620b-4b44-bd35-39be1470eec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6825","nonce":34112410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6827","nonce":34112410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6831","nonce":34112410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6829","nonce":34112410}]},"public_addr":"172.21.15.100:6825/34112410","cluster_addr":"172.21.15.100:6827/34112410","heartbeat_back_addr":"172.21.15.100:6831/34112410","heartbeat_front_addr":"172.21.15.100:6829/34112410","state":["exists","up"]},{"osd":11,"uuid":"6bbcb42f-aa99-44e4-9c3f-d818423eb5b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6825","nonce":3779371472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6827","nonce":3779371472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6831","nonce":3779371472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6829","nonce":3779371472}]},"public_addr":"172.21.15.186:6825/3779371472","cluster_addr":"172.21.15.186:6827/3779371472","heartbeat_back_addr":"172.21.15.186:6831/3779371472","heartbeat_front_addr":"172.21.15.186:6829/3779371472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:57:56.955667+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:58:18.433916+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:58:40.589590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:59:03.635858+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:59:25.544564+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:59:48.171593+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:00:10.876885+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:00:32.920759+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:00:55.273330+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:01:18.131720+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:01:40.259620+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:02:02.776536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/4074020814":"2023-12-18T11:56:27.362306+0000","172.21.15.8:6801/222068650":"2023-12-18T11:56:27.362306+0000","172.21.15.8:6801/4187398661":"2023-12-18T11:56:00.731492+0000","172.21.15.8:6800/222068650":"2023-12-18T11:56:27.362306+0000","172.21.15.8:6800/4187398661":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/2964092603":"2023-12-18T11:56:27.362306+0000","172.21.15.8:0/35186087":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/1429868241":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/174719729":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/2106317618":"2023-12-18T11:56:27.362306+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T12:02:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.378+0000 7fe4e0bff700 1 -- 172.21.15.8:0/2532165762 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fe4c40a1480 msgr2=0x7fe4c40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.378+0000 7fe4e0bff700 1 --2- 172.21.15.8:0/2532165762 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fe4c40a1480 0x7fe4c40a3940 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc00b670 tx=0x7fe4cc005fb0 comp rx=0 tx=0).stop 2023-12-17T12:02:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.378+0000 7fe4e0bff700 1 -- 172.21.15.8:0/2532165762 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4dc0755b0 msgr2=0x7fe4dc199ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.378+0000 7fe4e0bff700 1 --2- 172.21.15.8:0/2532165762 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4dc0755b0 0x7fe4dc199ab0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe4d000e9a0 tx=0x7fe4d000ed60 comp rx=0 tx=0).stop 2023-12-17T12:02:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.378+0000 7fe4e0bff700 1 -- 172.21.15.8:0/2532165762 shutdown_connections 2023-12-17T12:02:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.378+0000 7fe4e0bff700 1 --2- 172.21.15.8:0/2532165762 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fe4c40a1480 0x7fe4c40a3940 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.378+0000 7fe4e0bff700 1 --2- 172.21.15.8:0/2532165762 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe4dc109370 0x7fe4dc1a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.378+0000 7fe4e0bff700 1 --2- 172.21.15.8:0/2532165762 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe4dc073fd0 0x7fe4dc199570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.378+0000 7fe4e0bff700 1 --2- 172.21.15.8:0/2532165762 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe4dc0755b0 0x7fe4dc199ab0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:14.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.378+0000 7fe4e0bff700 1 -- 172.21.15.8:0/2532165762 >> 172.21.15.8:0/2532165762 conn(0x7fe4dc0fca30 msgr2=0x7fe4dc1052c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:14.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.378+0000 7fe4e0bff700 1 -- 172.21.15.8:0/2532165762 shutdown_connections 2023-12-17T12:02:14.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.378+0000 7fe4e0bff700 1 -- 172.21.15.8:0/2532165762 wait complete. 2023-12-17T12:02:14.401 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-17T11:58:43.972745+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-17T12:02:14.401 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-17T12:02:14.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:14 smithi100 ceph-mon[41266]: from='client.24427 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi100=b;smithi100=e;smithi100=h;smithi100=k;smithi186=c;smithi186=f;smithi186=i;smithi186=l", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:02:14.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:14 smithi100 ceph-mon[41266]: Saving service mds.all spec with placement smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi100=b;smithi100=e;smithi100=h;smithi100=k;smithi186=c;smithi186=f;smithi186=i;smithi186=l;count:12 2023-12-17T12:02:14.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:14 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:14.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:14 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:02:14.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:14 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:14.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:14 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:02:14.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:14 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:14.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:14 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:02:14.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:14 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T12:02:14.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:14 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:14.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:14 smithi100 ceph-mon[41266]: Deploying daemon mds.l on smithi186 2023-12-17T12:02:14.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:14 smithi100 ceph-mon[41266]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:14.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.606+0000 7face13ff700 1 -- 172.21.15.8:0/1189256547 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facdc1015a0 msgr2=0x7facdc1019c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:14.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.606+0000 7face13ff700 1 --2- 172.21.15.8:0/1189256547 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facdc1015a0 0x7facdc1019c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7faccc0099c0 tx=0x7faccc009cd0 comp rx=0 tx=0).stop 2023-12-17T12:02:14.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.606+0000 7face13ff700 1 -- 172.21.15.8:0/1189256547 shutdown_connections 2023-12-17T12:02:14.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.606+0000 7face13ff700 1 --2- 172.21.15.8:0/1189256547 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facdc103130 0x7facdc1099e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:14.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.606+0000 7face13ff700 1 --2- 172.21.15.8:0/1189256547 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facdc1015a0 0x7facdc1019c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:14.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.606+0000 7face13ff700 1 --2- 172.21.15.8:0/1189256547 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facdc102790 0x7facdc102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:14.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.606+0000 7face13ff700 1 -- 172.21.15.8:0/1189256547 >> 172.21.15.8:0/1189256547 conn(0x7facdc0fcb10 msgr2=0x7facdc0fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:14.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.606+0000 7face13ff700 1 -- 172.21.15.8:0/1189256547 shutdown_connections 2023-12-17T12:02:14.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.606+0000 7face13ff700 1 -- 172.21.15.8:0/1189256547 wait complete. 2023-12-17T12:02:14.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.607+0000 7face13ff700 1 Processor -- start 2023-12-17T12:02:14.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.607+0000 7face13ff700 1 -- start start 2023-12-17T12:02:14.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.608+0000 7face13ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facdc1015a0 0x7facdc199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:14.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.608+0000 7face13ff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facdc102790 0x7facdc199c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:14.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.608+0000 7face13ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facdc103130 0x7facdc1a0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:14.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.608+0000 7face13ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facdc1a1230 con 0x7facdc1015a0 2023-12-17T12:02:14.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.608+0000 7face13ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facdc1a1370 con 0x7facdc103130 2023-12-17T12:02:14.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.608+0000 7face13ff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facdc1a1500 con 0x7facdc102790 2023-12-17T12:02:14.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.608+0000 7facdaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facdc1015a0 0x7facdc199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:14.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.608+0000 7facdaffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facdc1015a0 0x7facdc199750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50950/0 (socket says 172.21.15.8:50950) 2023-12-17T12:02:14.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.608+0000 7facdaffd700 1 -- 172.21.15.8:0/1744689708 learned_addr learned my addr 172.21.15.8:0/1744689708 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:02:14.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.608+0000 7facda7fc700 1 --2- 172.21.15.8:0/1744689708 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facdc102790 0x7facdc199c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:14.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.608+0000 7facdb7fe700 1 --2- 172.21.15.8:0/1744689708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facdc103130 0x7facdc1a0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:14.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.608+0000 7facdaffd700 1 -- 172.21.15.8:0/1744689708 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facdc102790 msgr2=0x7facdc199c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:14.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.608+0000 7facdaffd700 1 --2- 172.21.15.8:0/1744689708 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facdc102790 0x7facdc199c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:14.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.608+0000 7facdaffd700 1 -- 172.21.15.8:0/1744689708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facdc103130 msgr2=0x7facdc1a0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:14.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.608+0000 7facdaffd700 1 --2- 172.21.15.8:0/1744689708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facdc103130 0x7facdc1a0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:14.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.608+0000 7facdaffd700 1 -- 172.21.15.8:0/1744689708 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faccc0095f0 con 0x7facdc1015a0 2023-12-17T12:02:14.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.609+0000 7facdaffd700 1 --2- 172.21.15.8:0/1744689708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facdc1015a0 0x7facdc199750 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7faccc009fd0 tx=0x7faccc00fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:14.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.609+0000 7facc3fff700 1 -- 172.21.15.8:0/1744689708 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc01d070 con 0x7facdc1015a0 2023-12-17T12:02:14.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.609+0000 7facc3fff700 1 -- 172.21.15.8:0/1744689708 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faccc00bd10 con 0x7facdc1015a0 2023-12-17T12:02:14.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.609+0000 7face13ff700 1 -- 172.21.15.8:0/1744689708 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facdc1a1780 con 0x7facdc1015a0 2023-12-17T12:02:14.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.609+0000 7facc3fff700 1 -- 172.21.15.8:0/1744689708 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faccc004ba0 con 0x7facdc1015a0 2023-12-17T12:02:14.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.609+0000 7face13ff700 1 -- 172.21.15.8:0/1744689708 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facdc1a1ba0 con 0x7facdc1015a0 2023-12-17T12:02:14.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.610+0000 7face13ff700 1 -- 172.21.15.8:0/1744689708 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facdc068310 con 0x7facdc1015a0 2023-12-17T12:02:14.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.612+0000 7facc3fff700 1 -- 172.21.15.8:0/1744689708 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7faccc004d00 con 0x7facdc1015a0 2023-12-17T12:02:14.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.613+0000 7facc3fff700 1 --2- 172.21.15.8:0/1744689708 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7facc40a1480 0x7facc40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:14.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.613+0000 7facc3fff700 1 -- 172.21.15.8:0/1744689708 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7faccc0cdb30 con 0x7facdc1015a0 2023-12-17T12:02:14.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.614+0000 7facda7fc700 1 --2- 172.21.15.8:0/1744689708 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7facc40a1480 0x7facc40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:14.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.614+0000 7facda7fc700 1 --2- 172.21.15.8:0/1744689708 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7facc40a1480 0x7facc40a3940 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7facd0005950 tx=0x7facd000b410 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:14.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.615+0000 7facc3fff700 1 -- 172.21.15.8:0/1744689708 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7faccc097620 con 0x7facdc1015a0 2023-12-17T12:02:14.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.831+0000 7face13ff700 1 -- 172.21.15.8:0/1744689708 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7facdc10ce60 con 0x7facdc1015a0 2023-12-17T12:02:14.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.832+0000 7facc3fff700 1 -- 172.21.15.8:0/1744689708 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7faccc0a1070 con 0x7facdc1015a0 2023-12-17T12:02:14.834 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-12-17T12:02:14.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.834+0000 7face13ff700 1 -- 172.21.15.8:0/1744689708 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7facc40a1480 msgr2=0x7facc40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:14.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.834+0000 7face13ff700 1 --2- 172.21.15.8:0/1744689708 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7facc40a1480 0x7facc40a3940 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7facd0005950 tx=0x7facd000b410 comp rx=0 tx=0).stop 2023-12-17T12:02:14.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.834+0000 7face13ff700 1 -- 172.21.15.8:0/1744689708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facdc1015a0 msgr2=0x7facdc199750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:14.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.834+0000 7face13ff700 1 --2- 172.21.15.8:0/1744689708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facdc1015a0 0x7facdc199750 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7faccc009fd0 tx=0x7faccc00fa00 comp rx=0 tx=0).stop 2023-12-17T12:02:14.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.834+0000 7face13ff700 1 -- 172.21.15.8:0/1744689708 shutdown_connections 2023-12-17T12:02:14.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.834+0000 7face13ff700 1 --2- 172.21.15.8:0/1744689708 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7facc40a1480 0x7facc40a3940 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:14.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.834+0000 7face13ff700 1 --2- 172.21.15.8:0/1744689708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7facdc103130 0x7facdc1a0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:14.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.834+0000 7face13ff700 1 --2- 172.21.15.8:0/1744689708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7facdc1015a0 0x7facdc199750 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:14.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.834+0000 7face13ff700 1 --2- 172.21.15.8:0/1744689708 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7facdc102790 0x7facdc199c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:14.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.834+0000 7face13ff700 1 -- 172.21.15.8:0/1744689708 >> 172.21.15.8:0/1744689708 conn(0x7facdc0fcb10 msgr2=0x7facdc107f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:14.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.834+0000 7face13ff700 1 -- 172.21.15.8:0/1744689708 shutdown_connections 2023-12-17T12:02:14.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:14.834+0000 7face13ff700 1 -- 172.21.15.8:0/1744689708 wait complete. 2023-12-17T12:02:14.856 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-17T12:02:15.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.059+0000 7f94c49ff700 1 -- 172.21.15.8:0/2755053203 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94c0104830 msgr2=0x7f94c0106c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:15.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.059+0000 7f94c49ff700 1 --2- 172.21.15.8:0/2755053203 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94c0104830 0x7f94c0106c20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f94a8009990 tx=0x7f94a8009ca0 comp rx=0 tx=0).stop 2023-12-17T12:02:15.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.059+0000 7f94c49ff700 1 -- 172.21.15.8:0/2755053203 shutdown_connections 2023-12-17T12:02:15.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.059+0000 7f94c49ff700 1 --2- 172.21.15.8:0/2755053203 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94c0107160 0x7f94c01095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:15.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.059+0000 7f94c49ff700 1 --2- 172.21.15.8:0/2755053203 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f94c0101f00 0x7f94c01042f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:15.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.059+0000 7f94c49ff700 1 --2- 172.21.15.8:0/2755053203 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94c0104830 0x7f94c0106c20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:15.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.059+0000 7f94c49ff700 1 -- 172.21.15.8:0/2755053203 >> 172.21.15.8:0/2755053203 conn(0x7f94c00fb8f0 msgr2=0x7f94c00fdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:15.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.059+0000 7f94c49ff700 1 -- 172.21.15.8:0/2755053203 shutdown_connections 2023-12-17T12:02:15.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.059+0000 7f94c49ff700 1 -- 172.21.15.8:0/2755053203 wait complete. 2023-12-17T12:02:15.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.060+0000 7f94c49ff700 1 Processor -- start 2023-12-17T12:02:15.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.060+0000 7f94c49ff700 1 -- start start 2023-12-17T12:02:15.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.061+0000 7f94c49ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94c0101f00 0x7f94c0199500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:15.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.061+0000 7f94c49ff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f94c0104830 0x7f94c0199a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:15.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.061+0000 7f94c49ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94c0107160 0x7f94c01a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:15.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.061+0000 7f94c49ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c01a1030 con 0x7f94c0107160 2023-12-17T12:02:15.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.061+0000 7f94c49ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c01a1170 con 0x7f94c0101f00 2023-12-17T12:02:15.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.061+0000 7f94c49ff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94c01a1300 con 0x7f94c0104830 2023-12-17T12:02:15.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.061+0000 7f94bed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94c0107160 0x7f94c01a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:15.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.061+0000 7f94bed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94c0107160 0x7f94c01a0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:50966/0 (socket says 172.21.15.8:50966) 2023-12-17T12:02:15.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.061+0000 7f94bed9d700 1 -- 172.21.15.8:0/1730044492 learned_addr learned my addr 172.21.15.8:0/1730044492 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:02:15.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.061+0000 7f94be59c700 1 --2- 172.21.15.8:0/1730044492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94c0101f00 0x7f94c0199500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:15.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.061+0000 7f94b7fff700 1 --2- 172.21.15.8:0/1730044492 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f94c0104830 0x7f94c0199a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:15.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.061+0000 7f94bed9d700 1 -- 172.21.15.8:0/1730044492 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f94c0104830 msgr2=0x7f94c0199a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:15.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.061+0000 7f94bed9d700 1 --2- 172.21.15.8:0/1730044492 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f94c0104830 0x7f94c0199a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:15.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.061+0000 7f94bed9d700 1 -- 172.21.15.8:0/1730044492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94c0101f00 msgr2=0x7f94c0199500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:15.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.061+0000 7f94bed9d700 1 --2- 172.21.15.8:0/1730044492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94c0101f00 0x7f94c0199500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:15.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.061+0000 7f94bed9d700 1 -- 172.21.15.8:0/1730044492 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a80095f0 con 0x7f94c0107160 2023-12-17T12:02:15.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.062+0000 7f94bed9d700 1 --2- 172.21.15.8:0/1730044492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94c0107160 0x7f94c01a0a60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f94b800ef30 tx=0x7f94b800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:15.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.062+0000 7f94b77fe700 1 -- 172.21.15.8:0/1730044492 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b8018070 con 0x7f94c0107160 2023-12-17T12:02:15.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.062+0000 7f94c49ff700 1 -- 172.21.15.8:0/1730044492 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94c01a1580 con 0x7f94c0107160 2023-12-17T12:02:15.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.062+0000 7f94b77fe700 1 -- 172.21.15.8:0/1730044492 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f94b800f040 con 0x7f94c0107160 2023-12-17T12:02:15.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.062+0000 7f94b77fe700 1 -- 172.21.15.8:0/1730044492 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94b800cbc0 con 0x7f94c0107160 2023-12-17T12:02:15.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.062+0000 7f94c49ff700 1 -- 172.21.15.8:0/1730044492 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94c01a1a40 con 0x7f94c0107160 2023-12-17T12:02:15.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.063+0000 7f94c49ff700 1 -- 172.21.15.8:0/1730044492 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94c0108d60 con 0x7f94c0107160 2023-12-17T12:02:15.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.065+0000 7f94b77fe700 1 -- 172.21.15.8:0/1730044492 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7f94b800cd60 con 0x7f94c0107160 2023-12-17T12:02:15.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.067+0000 7f94b77fe700 1 --2- 172.21.15.8:0/1730044492 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f94ac0a1480 0x7f94ac0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:15.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.067+0000 7f94b77fe700 1 -- 172.21.15.8:0/1730044492 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f94b80cca20 con 0x7f94c0107160 2023-12-17T12:02:15.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.067+0000 7f94be59c700 1 --2- 172.21.15.8:0/1730044492 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f94ac0a1480 0x7f94ac0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:15.070 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.067+0000 7f94be59c700 1 --2- 172.21.15.8:0/1730044492 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f94ac0a1480 0x7f94ac0a3940 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f94b0009c60 tx=0x7f94b0009260 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:15.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.069+0000 7f94b77fe700 1 -- 172.21.15.8:0/1730044492 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f94b8096510 con 0x7f94c0107160 2023-12-17T12:02:15.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.328+0000 7f94c49ff700 1 -- 172.21.15.8:0/1730044492 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94c0068230 con 0x7f94c0107160 2023-12-17T12:02:15.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.328+0000 7f94b77fe700 1 -- 172.21.15.8:0/1730044492 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+535 (secure 0 0 0) 0x7f94b8099b30 con 0x7f94c0107160 2023-12-17T12:02:15.331 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:02:15.331 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-12-17T12:02:15.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.331+0000 7f94c49ff700 1 -- 172.21.15.8:0/1730044492 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f94ac0a1480 msgr2=0x7f94ac0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:15.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.331+0000 7f94c49ff700 1 --2- 172.21.15.8:0/1730044492 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f94ac0a1480 0x7f94ac0a3940 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f94b0009c60 tx=0x7f94b0009260 comp rx=0 tx=0).stop 2023-12-17T12:02:15.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.331+0000 7f94c49ff700 1 -- 172.21.15.8:0/1730044492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94c0107160 msgr2=0x7f94c01a0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:15.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.331+0000 7f94c49ff700 1 --2- 172.21.15.8:0/1730044492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94c0107160 0x7f94c01a0a60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f94b800ef30 tx=0x7f94b800c3a0 comp rx=0 tx=0).stop 2023-12-17T12:02:15.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.331+0000 7f94c49ff700 1 -- 172.21.15.8:0/1730044492 shutdown_connections 2023-12-17T12:02:15.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.331+0000 7f94c49ff700 1 --2- 172.21.15.8:0/1730044492 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f94ac0a1480 0x7f94ac0a3940 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:15.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.331+0000 7f94c49ff700 1 --2- 172.21.15.8:0/1730044492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94c0107160 0x7f94c01a0a60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:15.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.331+0000 7f94c49ff700 1 --2- 172.21.15.8:0/1730044492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94c0101f00 0x7f94c0199500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:15.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.331+0000 7f94c49ff700 1 --2- 172.21.15.8:0/1730044492 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f94c0104830 0x7f94c0199a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:15.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.331+0000 7f94c49ff700 1 -- 172.21.15.8:0/1730044492 >> 172.21.15.8:0/1730044492 conn(0x7f94c00fb8f0 msgr2=0x7f94c0101530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:15.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.331+0000 7f94c49ff700 1 -- 172.21.15.8:0/1730044492 shutdown_connections 2023-12-17T12:02:15.334 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:15.331+0000 7f94c49ff700 1 -- 172.21.15.8:0/1730044492 wait complete. 2023-12-17T12:02:15.335 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 1 2023-12-17T12:02:15.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:15 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/2532165762' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:02:15.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:15 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/1744689708' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-17T12:02:15.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:15 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/2532165762' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:02:15.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:15 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/1744689708' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-17T12:02:15.477 INFO:journalctl@ceph.mds.l.smithi186.stdout:Dec 17 12:02:15 smithi186 systemd[1]: Starting Ceph mds.l for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:02:15.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:15 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/2532165762' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:02:15.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:15 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/1744689708' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-17T12:02:15.976 INFO:journalctl@ceph.mds.l.smithi186.stdout:Dec 17 12:02:15 smithi186 bash[76644]: f74281d83bf735fdb64c02eb4b374f379c56b9c6899482a7290f11429f184aa2 2023-12-17T12:02:15.976 INFO:journalctl@ceph.mds.l.smithi186.stdout:Dec 17 12:02:15 smithi186 systemd[1]: Started Ceph mds.l for f43f508a-9cd2-11ee-95a5-87774f69a715. 2023-12-17T12:02:15.976 INFO:journalctl@ceph.mds.l.smithi186.stdout:Dec 17 12:02:15 smithi186 ceph-mds[76682]: -- 172.21.15.186:0/2984978739 <== mon.1 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564e980a7520 con 0x564e9807e800 2023-12-17T12:02:15.976 INFO:journalctl@ceph.mds.l.smithi186.stdout:Dec 17 12:02:15 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-l[76659]: starting mds.l at 2023-12-17T12:02:16.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:16 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/1730044492' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:16.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:16 smithi100 ceph-mon[41266]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:16.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:16 smithi100 ceph-mon[41266]: mds.? [v2:172.21.15.186:6832/582753561,v1:172.21.15.186:6833/582753561] up:boot 2023-12-17T12:02:16.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:16 smithi100 ceph-mon[41266]: fsmap 1 up:standby 2023-12-17T12:02:16.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:16 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-12-17T12:02:16.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:16 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:16.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:16 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:16.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:16 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:16.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:16 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:02:16.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:16 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T12:02:16.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:16 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:16.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:16 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/1730044492' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:16.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:16 smithi186 ceph-mon[41182]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:16.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:16 smithi186 ceph-mon[41182]: mds.? [v2:172.21.15.186:6832/582753561,v1:172.21.15.186:6833/582753561] up:boot 2023-12-17T12:02:16.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:16 smithi186 ceph-mon[41182]: fsmap 1 up:standby 2023-12-17T12:02:16.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:16 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-12-17T12:02:16.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:16 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:16.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:16 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:16.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:16 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:16.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:16 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:02:16.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:16 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T12:02:16.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:16 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:16.499 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:16 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/1730044492' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:16.499 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:16 smithi008 ceph-mon[36830]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:16.499 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:16 smithi008 ceph-mon[36830]: mds.? [v2:172.21.15.186:6832/582753561,v1:172.21.15.186:6833/582753561] up:boot 2023-12-17T12:02:16.499 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:16 smithi008 ceph-mon[36830]: fsmap 1 up:standby 2023-12-17T12:02:16.499 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:16 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-12-17T12:02:16.499 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:16 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:16.499 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:16 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:16.499 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:16 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:16.499 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:16 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:02:16.499 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:16 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T12:02:16.499 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:16 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:17.353 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-17T12:02:17.384 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:17 smithi100 ceph-mon[41266]: Deploying daemon mds.k on smithi100 2023-12-17T12:02:17.421 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:17 smithi008 ceph-mon[36830]: Deploying daemon mds.k on smithi100 2023-12-17T12:02:17.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:17 smithi186 ceph-mon[41182]: Deploying daemon mds.k on smithi100 2023-12-17T12:02:17.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.567+0000 7f4fd01ff700 1 -- 172.21.15.8:0/4097810138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4fc8075610 msgr2=0x7f4fc8073a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:17.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.567+0000 7f4fd01ff700 1 --2- 172.21.15.8:0/4097810138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4fc8075610 0x7f4fc8073a60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4fc4009990 tx=0x7f4fc4009ca0 comp rx=0 tx=0).stop 2023-12-17T12:02:17.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.567+0000 7f4fd01ff700 1 -- 172.21.15.8:0/4097810138 shutdown_connections 2023-12-17T12:02:17.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.567+0000 7f4fd01ff700 1 --2- 172.21.15.8:0/4097810138 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4fc8109360 0x7f4fc810b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:17.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.567+0000 7f4fd01ff700 1 --2- 172.21.15.8:0/4097810138 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4fc8075610 0x7f4fc8073a60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:17.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.567+0000 7f4fd01ff700 1 --2- 172.21.15.8:0/4097810138 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fc8074030 0x7f4fc80744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:17.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.567+0000 7f4fd01ff700 1 -- 172.21.15.8:0/4097810138 >> 172.21.15.8:0/4097810138 conn(0x7f4fc80fca10 msgr2=0x7f4fc80fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:17.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.567+0000 7f4fd01ff700 1 -- 172.21.15.8:0/4097810138 shutdown_connections 2023-12-17T12:02:17.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.567+0000 7f4fd01ff700 1 -- 172.21.15.8:0/4097810138 wait complete. 2023-12-17T12:02:17.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.568+0000 7f4fd01ff700 1 Processor -- start 2023-12-17T12:02:17.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.569+0000 7f4fd01ff700 1 -- start start 2023-12-17T12:02:17.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.569+0000 7f4fd01ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4fc8074030 0x7f4fc8199580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:17.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.569+0000 7f4fd01ff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fc8075610 0x7f4fc8199ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:17.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.569+0000 7f4fd01ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4fc8109360 0x7f4fc81a0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:17.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.569+0000 7f4fd01ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc81a1060 con 0x7f4fc8109360 2023-12-17T12:02:17.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.569+0000 7f4fd01ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc81a11a0 con 0x7f4fc8074030 2023-12-17T12:02:17.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.569+0000 7f4fd01ff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fc81a1330 con 0x7f4fc8075610 2023-12-17T12:02:17.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.569+0000 7f4fce79c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4fc8109360 0x7f4fc81a0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:17.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.569+0000 7f4fcdf9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4fc8074030 0x7f4fc8199580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:17.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.569+0000 7f4fcdf9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4fc8074030 0x7f4fc8199580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.8:35368/0 (socket says 172.21.15.8:35368) 2023-12-17T12:02:17.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.569+0000 7f4fcdf9b700 1 -- 172.21.15.8:0/3329243273 learned_addr learned my addr 172.21.15.8:0/3329243273 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:02:17.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.569+0000 7f4fcd79a700 1 --2- 172.21.15.8:0/3329243273 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fc8075610 0x7f4fc8199ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:17.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.569+0000 7f4fce79c700 1 -- 172.21.15.8:0/3329243273 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fc8075610 msgr2=0x7f4fc8199ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:17.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.569+0000 7f4fce79c700 1 --2- 172.21.15.8:0/3329243273 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fc8075610 0x7f4fc8199ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:17.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.569+0000 7f4fce79c700 1 -- 172.21.15.8:0/3329243273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4fc8074030 msgr2=0x7f4fc8199580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:17.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.569+0000 7f4fce79c700 1 --2- 172.21.15.8:0/3329243273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4fc8074030 0x7f4fc8199580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:17.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.570+0000 7f4fce79c700 1 -- 172.21.15.8:0/3329243273 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fc40095f0 con 0x7f4fc8109360 2023-12-17T12:02:17.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.570+0000 7f4fcdf9b700 1 --2- 172.21.15.8:0/3329243273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4fc8074030 0x7f4fc8199580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T12:02:17.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.570+0000 7f4fce79c700 1 --2- 172.21.15.8:0/3329243273 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4fc8109360 0x7f4fc81a0a90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4fc000efc0 tx=0x7f4fc000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:17.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.570+0000 7f4fbeffd700 1 -- 172.21.15.8:0/3329243273 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0018070 con 0x7f4fc8109360 2023-12-17T12:02:17.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.570+0000 7f4fbeffd700 1 -- 172.21.15.8:0/3329243273 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4fc000f040 con 0x7f4fc8109360 2023-12-17T12:02:17.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.570+0000 7f4fbeffd700 1 -- 172.21.15.8:0/3329243273 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fc000cc50 con 0x7f4fc8109360 2023-12-17T12:02:17.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.570+0000 7f4fd01ff700 1 -- 172.21.15.8:0/3329243273 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fc81a15b0 con 0x7f4fc8109360 2023-12-17T12:02:17.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.570+0000 7f4fd01ff700 1 -- 172.21.15.8:0/3329243273 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fc81a1a70 con 0x7f4fc8109360 2023-12-17T12:02:17.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.571+0000 7f4fd01ff700 1 -- 172.21.15.8:0/3329243273 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fc8108120 con 0x7f4fc8109360 2023-12-17T12:02:17.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.573+0000 7f4fbeffd700 1 -- 172.21.15.8:0/3329243273 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7f4fc0003a00 con 0x7f4fc8109360 2023-12-17T12:02:17.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.576+0000 7f4fbeffd700 1 --2- 172.21.15.8:0/3329243273 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4fb40a1480 0x7f4fb40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:17.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.576+0000 7f4fbeffd700 1 -- 172.21.15.8:0/3329243273 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f4fc00cce20 con 0x7f4fc8109360 2023-12-17T12:02:17.578 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.576+0000 7f4fcdf9b700 1 --2- 172.21.15.8:0/3329243273 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4fb40a1480 0x7f4fb40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:17.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.576+0000 7f4fcdf9b700 1 --2- 172.21.15.8:0/3329243273 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4fb40a1480 0x7f4fb40a3940 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4fc400b2e0 tx=0x7f4fc400b610 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:17.580 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.578+0000 7f4fbeffd700 1 -- 172.21.15.8:0/3329243273 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4fc0096910 con 0x7f4fc8109360 2023-12-17T12:02:17.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.840+0000 7f4fd01ff700 1 -- 172.21.15.8:0/3329243273 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4fc8068230 con 0x7f4fc8109360 2023-12-17T12:02:17.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.841+0000 7f4fbeffd700 1 -- 172.21.15.8:0/3329243273 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1325 (secure 0 0 0) 0x7f4fc0099f30 con 0x7f4fc8109360 2023-12-17T12:02:17.844 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:02:17.844 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/582753561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":582753561},{"type":"v1","addr":"172.21.15.186:6833","nonce":582753561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-12-17T12:02:17.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.843+0000 7f4fd01ff700 1 -- 172.21.15.8:0/3329243273 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4fb40a1480 msgr2=0x7f4fb40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:17.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.843+0000 7f4fd01ff700 1 --2- 172.21.15.8:0/3329243273 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4fb40a1480 0x7f4fb40a3940 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4fc400b2e0 tx=0x7f4fc400b610 comp rx=0 tx=0).stop 2023-12-17T12:02:17.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.843+0000 7f4fd01ff700 1 -- 172.21.15.8:0/3329243273 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4fc8109360 msgr2=0x7f4fc81a0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:17.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.843+0000 7f4fd01ff700 1 --2- 172.21.15.8:0/3329243273 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4fc8109360 0x7f4fc81a0a90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4fc000efc0 tx=0x7f4fc000c3a0 comp rx=0 tx=0).stop 2023-12-17T12:02:17.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.843+0000 7f4fd01ff700 1 -- 172.21.15.8:0/3329243273 shutdown_connections 2023-12-17T12:02:17.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.843+0000 7f4fd01ff700 1 --2- 172.21.15.8:0/3329243273 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4fb40a1480 0x7f4fb40a3940 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:17.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.843+0000 7f4fd01ff700 1 --2- 172.21.15.8:0/3329243273 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4fc8109360 0x7f4fc81a0a90 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:17.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.843+0000 7f4fd01ff700 1 --2- 172.21.15.8:0/3329243273 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4fc8074030 0x7f4fc8199580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:17.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.843+0000 7f4fd01ff700 1 --2- 172.21.15.8:0/3329243273 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fc8075610 0x7f4fc8199ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:17.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.843+0000 7f4fd01ff700 1 -- 172.21.15.8:0/3329243273 >> 172.21.15.8:0/3329243273 conn(0x7f4fc80fca10 msgr2=0x7f4fc8105260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:17.846 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.843+0000 7f4fd01ff700 1 -- 172.21.15.8:0/3329243273 shutdown_connections 2023-12-17T12:02:17.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:17.843+0000 7f4fd01ff700 1 -- 172.21.15.8:0/3329243273 wait complete. 2023-12-17T12:02:17.847 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 2 2023-12-17T12:02:17.916 INFO:journalctl@ceph.mds.k.smithi100.stdout:Dec 17 12:02:17 smithi100 systemd[1]: Starting Ceph mds.k for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:02:18.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:18 smithi100 ceph-mon[41266]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:18.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:18 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/3329243273' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:18.416 INFO:journalctl@ceph.mds.k.smithi100.stdout:Dec 17 12:02:18 smithi100 ceph-mds[75416]: -- 172.21.15.100:0/1314264354 <== mon.2 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55585cac9520 con 0x55585caa0800 2023-12-17T12:02:18.416 INFO:journalctl@ceph.mds.k.smithi100.stdout:Dec 17 12:02:18 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-k[75393]: starting mds.k at 2023-12-17T12:02:18.416 INFO:journalctl@ceph.mds.k.smithi100.stdout:Dec 17 12:02:18 smithi100 bash[75378]: 124c246cf92c8e7184a47ce17cc1663250b58bc2cb4b01e7aff27d065c08113f 2023-12-17T12:02:18.416 INFO:journalctl@ceph.mds.k.smithi100.stdout:Dec 17 12:02:18 smithi100 systemd[1]: Started Ceph mds.k for f43f508a-9cd2-11ee-95a5-87774f69a715. 2023-12-17T12:02:18.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:18 smithi186 ceph-mon[41182]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:18.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:18 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/3329243273' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:18.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:18 smithi008 ceph-mon[36830]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:18.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:18 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/3329243273' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:19.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:19 smithi008 ceph-mon[36830]: mds.? [v2:172.21.15.100:6832/305815776,v1:172.21.15.100:6833/305815776] up:boot 2023-12-17T12:02:19.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:19 smithi008 ceph-mon[36830]: fsmap 2 up:standby 2023-12-17T12:02:19.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:19 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-12-17T12:02:19.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:19 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:19.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:19 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:19.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:19 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:19.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:19 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:02:19.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:19 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T12:02:19.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:19 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:19.247 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:19 smithi008 ceph-mon[36830]: Deploying daemon mds.j on smithi008 2023-12-17T12:02:19.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:19 smithi100 ceph-mon[41266]: mds.? [v2:172.21.15.100:6832/305815776,v1:172.21.15.100:6833/305815776] up:boot 2023-12-17T12:02:19.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:19 smithi100 ceph-mon[41266]: fsmap 2 up:standby 2023-12-17T12:02:19.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:19 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-12-17T12:02:19.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:19 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:19.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:19 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:19.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:19 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:19.417 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:19 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:02:19.417 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:19 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T12:02:19.417 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:19 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:19.417 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:19 smithi100 ceph-mon[41266]: Deploying daemon mds.j on smithi008 2023-12-17T12:02:19.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:19 smithi186 ceph-mon[41182]: mds.? [v2:172.21.15.100:6832/305815776,v1:172.21.15.100:6833/305815776] up:boot 2023-12-17T12:02:19.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:19 smithi186 ceph-mon[41182]: fsmap 2 up:standby 2023-12-17T12:02:19.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:19 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-12-17T12:02:19.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:19 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:19.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:19 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:19.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:19 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:19.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:19 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:02:19.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:19 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T12:02:19.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:19 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:19.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:19 smithi186 ceph-mon[41182]: Deploying daemon mds.j on smithi008 2023-12-17T12:02:19.866 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-17T12:02:20.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.249+0000 7f90b05ff700 1 -- 172.21.15.8:0/887356621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90a81014a0 msgr2=0x7f90a81018c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:20.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.249+0000 7f90b05ff700 1 --2- 172.21.15.8:0/887356621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90a81014a0 0x7f90a81018c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f90a40099c0 tx=0x7f90a4009cd0 comp rx=0 tx=0).stop 2023-12-17T12:02:20.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.249+0000 7f90b05ff700 1 -- 172.21.15.8:0/887356621 shutdown_connections 2023-12-17T12:02:20.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.249+0000 7f90b05ff700 1 --2- 172.21.15.8:0/887356621 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f90a8103030 0x7f90a81098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:20.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.249+0000 7f90b05ff700 1 --2- 172.21.15.8:0/887356621 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90a81014a0 0x7f90a81018c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:20.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.249+0000 7f90b05ff700 1 --2- 172.21.15.8:0/887356621 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90a8102690 0x7f90a8102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:20.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.249+0000 7f90b05ff700 1 -- 172.21.15.8:0/887356621 >> 172.21.15.8:0/887356621 conn(0x7f90a80fca30 msgr2=0x7f90a80fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:20.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.249+0000 7f90b05ff700 1 -- 172.21.15.8:0/887356621 shutdown_connections 2023-12-17T12:02:20.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.249+0000 7f90b05ff700 1 -- 172.21.15.8:0/887356621 wait complete. 2023-12-17T12:02:20.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.250+0000 7f90b05ff700 1 Processor -- start 2023-12-17T12:02:20.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.250+0000 7f90b05ff700 1 -- start start 2023-12-17T12:02:20.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.251+0000 7f90b05ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90a81014a0 0x7f90a81995b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:20.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.251+0000 7f90b05ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90a8102690 0x7f90a8199af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:20.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.251+0000 7f90b05ff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f90a8103030 0x7f90a81a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:20.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.251+0000 7f90b05ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a81a10e0 con 0x7f90a81014a0 2023-12-17T12:02:20.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.251+0000 7f90b05ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a81a1220 con 0x7f90a8102690 2023-12-17T12:02:20.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.251+0000 7f90b05ff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a81a13b0 con 0x7f90a8103030 2023-12-17T12:02:20.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.251+0000 7f90ae39b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90a81014a0 0x7f90a81995b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:20.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.251+0000 7f90ae39b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90a81014a0 0x7f90a81995b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51008/0 (socket says 172.21.15.8:51008) 2023-12-17T12:02:20.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.251+0000 7f90ae39b700 1 -- 172.21.15.8:0/1481187765 learned_addr learned my addr 172.21.15.8:0/1481187765 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:02:20.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.251+0000 7f90adb9a700 1 --2- 172.21.15.8:0/1481187765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90a8102690 0x7f90a8199af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:20.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.251+0000 7f90aeb9c700 1 --2- 172.21.15.8:0/1481187765 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f90a8103030 0x7f90a81a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:20.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.252+0000 7f90ae39b700 1 -- 172.21.15.8:0/1481187765 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f90a8103030 msgr2=0x7f90a81a0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:20.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.252+0000 7f90ae39b700 1 --2- 172.21.15.8:0/1481187765 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f90a8103030 0x7f90a81a0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:20.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.252+0000 7f90ae39b700 1 -- 172.21.15.8:0/1481187765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90a8102690 msgr2=0x7f90a8199af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:20.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.252+0000 7f90ae39b700 1 --2- 172.21.15.8:0/1481187765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90a8102690 0x7f90a8199af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:20.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.252+0000 7f90ae39b700 1 -- 172.21.15.8:0/1481187765 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a40095f0 con 0x7f90a81014a0 2023-12-17T12:02:20.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.252+0000 7f90adb9a700 1 --2- 172.21.15.8:0/1481187765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90a8102690 0x7f90a8199af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T12:02:20.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.252+0000 7f90ae39b700 1 --2- 172.21.15.8:0/1481187765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90a81014a0 0x7f90a81995b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f90a4009f50 tx=0x7f90a4003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:20.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.252+0000 7f909f7fe700 1 -- 172.21.15.8:0/1481187765 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a401d070 con 0x7f90a81014a0 2023-12-17T12:02:20.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.252+0000 7f909f7fe700 1 -- 172.21.15.8:0/1481187765 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f90a400bda0 con 0x7f90a81014a0 2023-12-17T12:02:20.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.252+0000 7f90b05ff700 1 -- 172.21.15.8:0/1481187765 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a81a1630 con 0x7f90a81014a0 2023-12-17T12:02:20.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.252+0000 7f909f7fe700 1 -- 172.21.15.8:0/1481187765 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a4022cd0 con 0x7f90a81014a0 2023-12-17T12:02:20.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.252+0000 7f90b05ff700 1 -- 172.21.15.8:0/1481187765 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a81a1ab0 con 0x7f90a81014a0 2023-12-17T12:02:20.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.254+0000 7f90b05ff700 1 -- 172.21.15.8:0/1481187765 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a80679a0 con 0x7f90a81014a0 2023-12-17T12:02:20.257 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.255+0000 7f909f7fe700 1 -- 172.21.15.8:0/1481187765 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7f90a4022470 con 0x7f90a81014a0 2023-12-17T12:02:20.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.257+0000 7f909f7fe700 1 --2- 172.21.15.8:0/1481187765 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f90940a1500 0x7f90940a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:20.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.258+0000 7f909f7fe700 1 -- 172.21.15.8:0/1481187765 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f90a40cdbe0 con 0x7f90a81014a0 2023-12-17T12:02:20.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.258+0000 7f90adb9a700 1 --2- 172.21.15.8:0/1481187765 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f90940a1500 0x7f90940a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:20.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.258+0000 7f90adb9a700 1 --2- 172.21.15.8:0/1481187765 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f90940a1500 0x7f90940a39c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9098005950 tx=0x7f909800b410 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:20.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.264+0000 7f909f7fe700 1 -- 172.21.15.8:0/1481187765 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f90a40976d0 con 0x7f90a81014a0 2023-12-17T12:02:20.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:20 smithi100 ceph-mon[41266]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:20.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:20 smithi186 ceph-mon[41182]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:20.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:20 smithi008 ceph-mon[36830]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:20.495 INFO:journalctl@ceph.mds.j.smithi008.stdout:Dec 17 12:02:20 smithi008 systemd[1]: Starting Ceph mds.j for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:02:20.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.544+0000 7f90b05ff700 1 -- 172.21.15.8:0/1481187765 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90a810cbb0 con 0x7f90a81014a0 2023-12-17T12:02:20.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.545+0000 7f909f7fe700 1 -- 172.21.15.8:0/1481187765 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2116 (secure 0 0 0) 0x7f90a409acf0 con 0x7f90a81014a0 2023-12-17T12:02:20.548 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:02:20.548 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/582753561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":582753561},{"type":"v1","addr":"172.21.15.186:6833","nonce":582753561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/305815776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":305815776},{"type":"v1","addr":"172.21.15.100:6833","nonce":305815776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-12-17T12:02:20.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.547+0000 7f90b05ff700 1 -- 172.21.15.8:0/1481187765 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f90940a1500 msgr2=0x7f90940a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:20.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.547+0000 7f90b05ff700 1 --2- 172.21.15.8:0/1481187765 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f90940a1500 0x7f90940a39c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9098005950 tx=0x7f909800b410 comp rx=0 tx=0).stop 2023-12-17T12:02:20.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.547+0000 7f90b05ff700 1 -- 172.21.15.8:0/1481187765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90a81014a0 msgr2=0x7f90a81995b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:20.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.547+0000 7f90b05ff700 1 --2- 172.21.15.8:0/1481187765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90a81014a0 0x7f90a81995b0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f90a4009f50 tx=0x7f90a4003a50 comp rx=0 tx=0).stop 2023-12-17T12:02:20.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.547+0000 7f90b05ff700 1 -- 172.21.15.8:0/1481187765 shutdown_connections 2023-12-17T12:02:20.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.547+0000 7f90b05ff700 1 --2- 172.21.15.8:0/1481187765 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f90940a1500 0x7f90940a39c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:20.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.547+0000 7f90b05ff700 1 --2- 172.21.15.8:0/1481187765 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f90a8103030 0x7f90a81a0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:20.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.547+0000 7f90b05ff700 1 --2- 172.21.15.8:0/1481187765 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f90a81014a0 0x7f90a81995b0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:20.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.547+0000 7f90b05ff700 1 --2- 172.21.15.8:0/1481187765 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f90a8102690 0x7f90a8199af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:20.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.547+0000 7f90b05ff700 1 -- 172.21.15.8:0/1481187765 >> 172.21.15.8:0/1481187765 conn(0x7f90a80fca30 msgr2=0x7f90a8107e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:20.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.548+0000 7f90b05ff700 1 -- 172.21.15.8:0/1481187765 shutdown_connections 2023-12-17T12:02:20.551 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:20.548+0000 7f90b05ff700 1 -- 172.21.15.8:0/1481187765 wait complete. 2023-12-17T12:02:20.551 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 3 2023-12-17T12:02:20.996 INFO:journalctl@ceph.mds.j.smithi008.stdout:Dec 17 12:02:20 smithi008 bash[86814]: d4a162633facf03f2ad3963d19d0b46b6ac0b2f73d0a78bd6d146d56fe3690e3 2023-12-17T12:02:20.996 INFO:journalctl@ceph.mds.j.smithi008.stdout:Dec 17 12:02:20 smithi008 systemd[1]: Started Ceph mds.j for f43f508a-9cd2-11ee-95a5-87774f69a715. 2023-12-17T12:02:20.996 INFO:journalctl@ceph.mds.j.smithi008.stdout:Dec 17 12:02:20 smithi008 ceph-mds[86854]: -- 172.21.15.8:0/1820221550 <== mon.0 v2:172.21.15.8:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a442a1d520 con 0x55a4429f5000 2023-12-17T12:02:20.996 INFO:journalctl@ceph.mds.j.smithi008.stdout:Dec 17 12:02:20 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-j[86829]: starting mds.j at 2023-12-17T12:02:21.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:21 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/1481187765' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:21.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:21 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:21.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:21 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:21.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:21 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:21.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:21 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:02:21.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:21 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T12:02:21.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:21 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:21.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:21 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/1481187765' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:21.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:21 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:21.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:21 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:21.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:21 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:21.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:21 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:02:21.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:21 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T12:02:21.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:21 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:21.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:21 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/1481187765' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:21.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:21 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:21.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:21 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:21.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:21 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:21.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:21 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:02:21.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:21 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T12:02:21.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:21 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:22.440 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:22 smithi008 ceph-mon[36830]: Deploying daemon mds.d on smithi008 2023-12-17T12:02:22.440 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:22 smithi008 ceph-mon[36830]: mds.? [v2:172.21.15.8:6834/2669069079,v1:172.21.15.8:6835/2669069079] up:boot 2023-12-17T12:02:22.440 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:22 smithi008 ceph-mon[36830]: fsmap 3 up:standby 2023-12-17T12:02:22.440 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:22 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-12-17T12:02:22.440 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:22 smithi008 ceph-mon[36830]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:22.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:22 smithi186 ceph-mon[41182]: Deploying daemon mds.d on smithi008 2023-12-17T12:02:22.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:22 smithi186 ceph-mon[41182]: mds.? [v2:172.21.15.8:6834/2669069079,v1:172.21.15.8:6835/2669069079] up:boot 2023-12-17T12:02:22.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:22 smithi186 ceph-mon[41182]: fsmap 3 up:standby 2023-12-17T12:02:22.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:22 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-12-17T12:02:22.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:22 smithi186 ceph-mon[41182]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:22.571 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-17T12:02:22.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:22 smithi100 ceph-mon[41266]: Deploying daemon mds.d on smithi008 2023-12-17T12:02:22.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:22 smithi100 ceph-mon[41266]: mds.? [v2:172.21.15.8:6834/2669069079,v1:172.21.15.8:6835/2669069079] up:boot 2023-12-17T12:02:22.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:22 smithi100 ceph-mon[41266]: fsmap 3 up:standby 2023-12-17T12:02:22.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:22 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-12-17T12:02:22.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:22 smithi100 ceph-mon[41266]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:22.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.841+0000 7fc1d77ff700 1 -- 172.21.15.8:0/308942375 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1d010da70 msgr2=0x7fc1d010fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:22.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.841+0000 7fc1d77ff700 1 --2- 172.21.15.8:0/308942375 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1d010da70 0x7fc1d010fe60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fc1c800b0a0 tx=0x7fc1c800b3b0 comp rx=0 tx=0).stop 2023-12-17T12:02:22.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.841+0000 7fc1d77ff700 1 -- 172.21.15.8:0/308942375 shutdown_connections 2023-12-17T12:02:22.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.841+0000 7fc1d77ff700 1 --2- 172.21.15.8:0/308942375 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1d010da70 0x7fc1d010fe60 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:22.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.841+0000 7fc1d77ff700 1 --2- 172.21.15.8:0/308942375 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1d0075610 0x7fc1d0073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:22.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.841+0000 7fc1d77ff700 1 --2- 172.21.15.8:0/308942375 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1d0074030 0x7fc1d00744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:22.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.841+0000 7fc1d77ff700 1 -- 172.21.15.8:0/308942375 >> 172.21.15.8:0/308942375 conn(0x7fc1d00fca10 msgr2=0x7fc1d00fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:22.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.841+0000 7fc1d77ff700 1 -- 172.21.15.8:0/308942375 shutdown_connections 2023-12-17T12:02:22.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.842+0000 7fc1d77ff700 1 -- 172.21.15.8:0/308942375 wait complete. 2023-12-17T12:02:22.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.843+0000 7fc1d77ff700 1 Processor -- start 2023-12-17T12:02:22.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.843+0000 7fc1d77ff700 1 -- start start 2023-12-17T12:02:22.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.843+0000 7fc1d77ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1d0074030 0x7fc1d019da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:22.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.843+0000 7fc1d77ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1d0075610 0x7fc1d019df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:22.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.843+0000 7fc1d77ff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1d010da70 0x7fc1d01a4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:22.847 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.843+0000 7fc1d77ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d01a5530 con 0x7fc1d0075610 2023-12-17T12:02:22.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.843+0000 7fc1d77ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d01a5670 con 0x7fc1d0074030 2023-12-17T12:02:22.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.843+0000 7fc1d77ff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d01a5800 con 0x7fc1d010da70 2023-12-17T12:02:22.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.844+0000 7fc1d4d9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1d0075610 0x7fc1d019df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:22.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.844+0000 7fc1d559b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1d0074030 0x7fc1d019da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:22.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.844+0000 7fc1d4d9a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1d0075610 0x7fc1d019df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42826/0 (socket says 172.21.15.8:42826) 2023-12-17T12:02:22.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.844+0000 7fc1d4d9a700 1 -- 172.21.15.8:0/527251382 learned_addr learned my addr 172.21.15.8:0/527251382 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:02:22.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.844+0000 7fc1d5d9c700 1 --2- 172.21.15.8:0/527251382 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1d010da70 0x7fc1d01a4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:22.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.844+0000 7fc1d559b700 1 -- 172.21.15.8:0/527251382 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1d010da70 msgr2=0x7fc1d01a4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:22.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.844+0000 7fc1d559b700 1 --2- 172.21.15.8:0/527251382 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1d010da70 0x7fc1d01a4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:22.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.844+0000 7fc1d559b700 1 -- 172.21.15.8:0/527251382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1d0075610 msgr2=0x7fc1d019df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:22.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.844+0000 7fc1d559b700 1 --2- 172.21.15.8:0/527251382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1d0075610 0x7fc1d019df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:22.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.844+0000 7fc1d559b700 1 -- 172.21.15.8:0/527251382 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1c8009d00 con 0x7fc1d0074030 2023-12-17T12:02:22.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.844+0000 7fc1d4d9a700 1 --2- 172.21.15.8:0/527251382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1d0075610 0x7fc1d019df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T12:02:22.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.844+0000 7fc1d559b700 1 --2- 172.21.15.8:0/527251382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1d0074030 0x7fc1d019da00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc00e9f0 tx=0x7fc1cc00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:22.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.845+0000 7fc1c67fc700 1 -- 172.21.15.8:0/527251382 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc0096d0 con 0x7fc1d0074030 2023-12-17T12:02:22.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.845+0000 7fc1c67fc700 1 -- 172.21.15.8:0/527251382 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc1cc00cbd0 con 0x7fc1d0074030 2023-12-17T12:02:22.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.845+0000 7fc1c67fc700 1 -- 172.21.15.8:0/527251382 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1cc018680 con 0x7fc1d0074030 2023-12-17T12:02:22.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.845+0000 7fc1d77ff700 1 -- 172.21.15.8:0/527251382 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1d01a5ae0 con 0x7fc1d0074030 2023-12-17T12:02:22.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.845+0000 7fc1d77ff700 1 -- 172.21.15.8:0/527251382 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1d01a5fa0 con 0x7fc1d0074030 2023-12-17T12:02:22.849 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.846+0000 7fc1d77ff700 1 -- 172.21.15.8:0/527251382 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1d0103cd0 con 0x7fc1d0074030 2023-12-17T12:02:22.851 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.849+0000 7fc1c67fc700 1 -- 172.21.15.8:0/527251382 <== mon.2 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7fc1cc00cd40 con 0x7fc1d0074030 2023-12-17T12:02:22.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.850+0000 7fc1c67fc700 1 --2- 172.21.15.8:0/527251382 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fc1bc0a1500 0x7fc1bc0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:22.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.851+0000 7fc1c67fc700 1 -- 172.21.15.8:0/527251382 <== mon.2 v2:172.21.15.100:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc1cc014070 con 0x7fc1d0074030 2023-12-17T12:02:22.853 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.851+0000 7fc1d4d9a700 1 --2- 172.21.15.8:0/527251382 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fc1bc0a1500 0x7fc1bc0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:22.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.851+0000 7fc1d4d9a700 1 --2- 172.21.15.8:0/527251382 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fc1bc0a1500 0x7fc1bc0a39c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0005950 tx=0x7fc1c0009260 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:22.854 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:22.852+0000 7fc1c67fc700 1 -- 172.21.15.8:0/527251382 <== mon.2 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fc1cc096830 con 0x7fc1d0074030 2023-12-17T12:02:22.995 INFO:journalctl@ceph.mds.d.smithi008.stdout:Dec 17 12:02:22 smithi008 systemd[1]: Starting Ceph mds.d for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:02:23.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:23.124+0000 7fc1d77ff700 1 -- 172.21.15.8:0/527251382 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1d0068230 con 0x7fc1d0074030 2023-12-17T12:02:23.127 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:23.125+0000 7fc1c67fc700 1 -- 172.21.15.8:0/527251382 <== mon.2 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2904 (secure 0 0 0) 0x7fc1cc026b70 con 0x7fc1d0074030 2023-12-17T12:02:23.128 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:02:23.128 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2669069079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2669069079},{"type":"v1","addr":"172.21.15.8:6835","nonce":2669069079}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/582753561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":582753561},{"type":"v1","addr":"172.21.15.186:6833","nonce":582753561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/305815776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":305815776},{"type":"v1","addr":"172.21.15.100:6833","nonce":305815776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-12-17T12:02:23.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:23.128+0000 7fc1d77ff700 1 -- 172.21.15.8:0/527251382 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fc1bc0a1500 msgr2=0x7fc1bc0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:23.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:23.128+0000 7fc1d77ff700 1 --2- 172.21.15.8:0/527251382 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fc1bc0a1500 0x7fc1bc0a39c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fc1c0005950 tx=0x7fc1c0009260 comp rx=0 tx=0).stop 2023-12-17T12:02:23.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:23.128+0000 7fc1d77ff700 1 -- 172.21.15.8:0/527251382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1d0074030 msgr2=0x7fc1d019da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:23.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:23.128+0000 7fc1d77ff700 1 --2- 172.21.15.8:0/527251382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1d0074030 0x7fc1d019da00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc1cc00e9f0 tx=0x7fc1cc00ed00 comp rx=0 tx=0).stop 2023-12-17T12:02:23.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:23.128+0000 7fc1d77ff700 1 -- 172.21.15.8:0/527251382 shutdown_connections 2023-12-17T12:02:23.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:23.128+0000 7fc1d77ff700 1 --2- 172.21.15.8:0/527251382 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fc1bc0a1500 0x7fc1bc0a39c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:23.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:23.128+0000 7fc1d77ff700 1 --2- 172.21.15.8:0/527251382 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc1d010da70 0x7fc1d01a4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:23.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:23.128+0000 7fc1d77ff700 1 --2- 172.21.15.8:0/527251382 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc1d0074030 0x7fc1d019da00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:23.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:23.128+0000 7fc1d77ff700 1 --2- 172.21.15.8:0/527251382 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc1d0075610 0x7fc1d019df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:23.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:23.128+0000 7fc1d77ff700 1 -- 172.21.15.8:0/527251382 >> 172.21.15.8:0/527251382 conn(0x7fc1d00fca10 msgr2=0x7fc1d0100e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:23.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:23.128+0000 7fc1d77ff700 1 -- 172.21.15.8:0/527251382 shutdown_connections 2023-12-17T12:02:23.131 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:23.128+0000 7fc1d77ff700 1 -- 172.21.15.8:0/527251382 wait complete. 2023-12-17T12:02:23.132 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 4 2023-12-17T12:02:23.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:23 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/527251382' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:23.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:23 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/527251382' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:23.496 INFO:journalctl@ceph.mds.d.smithi008.stdout:Dec 17 12:02:23 smithi008 bash[87198]: 9328ef9d947c99f40c54a7352338477fe6a5f1f641a7a6cbb333c4e5a98a5bc0 2023-12-17T12:02:23.496 INFO:journalctl@ceph.mds.d.smithi008.stdout:Dec 17 12:02:23 smithi008 systemd[1]: Started Ceph mds.d for f43f508a-9cd2-11ee-95a5-87774f69a715. 2023-12-17T12:02:23.496 INFO:journalctl@ceph.mds.d.smithi008.stdout:Dec 17 12:02:23 smithi008 ceph-mds[87237]: -- 172.21.15.8:0/1974600983 <== mon.0 v2:172.21.15.8:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56089ebc7520 con 0x56089eb9e800 2023-12-17T12:02:23.496 INFO:journalctl@ceph.mds.d.smithi008.stdout:Dec 17 12:02:23 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-d[87212]: starting mds.d at 2023-12-17T12:02:23.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:23 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/527251382' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:24.624 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:24 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:24.624 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:24 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:24.624 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:24 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:24.624 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:24 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:02:24.624 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:24 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T12:02:24.624 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:24 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:24.624 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:24 smithi100 ceph-mon[41266]: Deploying daemon mds.e on smithi100 2023-12-17T12:02:24.624 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:24 smithi100 ceph-mon[41266]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:24.624 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:24 smithi100 ceph-mon[41266]: mds.? [v2:172.21.15.8:6836/4241050553,v1:172.21.15.8:6837/4241050553] up:boot 2023-12-17T12:02:24.624 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:24 smithi100 ceph-mon[41266]: fsmap 4 up:standby 2023-12-17T12:02:24.624 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:24 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-12-17T12:02:24.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:24 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:24.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:24 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:24.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:24 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:24.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:24 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:02:24.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:24 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T12:02:24.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:24 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:24.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:24 smithi186 ceph-mon[41182]: Deploying daemon mds.e on smithi100 2023-12-17T12:02:24.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:24 smithi186 ceph-mon[41182]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:24.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:24 smithi186 ceph-mon[41182]: mds.? [v2:172.21.15.8:6836/4241050553,v1:172.21.15.8:6837/4241050553] up:boot 2023-12-17T12:02:24.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:24 smithi186 ceph-mon[41182]: fsmap 4 up:standby 2023-12-17T12:02:24.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:24 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-12-17T12:02:24.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:24 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:24.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:24 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:24.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:24 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:24.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:24 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:02:24.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:24 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T12:02:24.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:24 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:24.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:24 smithi008 ceph-mon[36830]: Deploying daemon mds.e on smithi100 2023-12-17T12:02:24.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:24 smithi008 ceph-mon[36830]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:24.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:24 smithi008 ceph-mon[36830]: mds.? [v2:172.21.15.8:6836/4241050553,v1:172.21.15.8:6837/4241050553] up:boot 2023-12-17T12:02:24.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:24 smithi008 ceph-mon[36830]: fsmap 4 up:standby 2023-12-17T12:02:24.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:24 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-12-17T12:02:25.151 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-17T12:02:25.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.365+0000 7fedc9dff700 1 -- 172.21.15.8:0/3079209377 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedc41014a0 msgr2=0x7fedc41018c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:25.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.365+0000 7fedc9dff700 1 --2- 172.21.15.8:0/3079209377 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedc41014a0 0x7fedc41018c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fedb40099c0 tx=0x7fedb4009cd0 comp rx=0 tx=0).stop 2023-12-17T12:02:25.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.365+0000 7fedc9dff700 1 -- 172.21.15.8:0/3079209377 shutdown_connections 2023-12-17T12:02:25.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.365+0000 7fedc9dff700 1 --2- 172.21.15.8:0/3079209377 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fedc4103030 0x7fedc41098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:25.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.365+0000 7fedc9dff700 1 --2- 172.21.15.8:0/3079209377 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedc41014a0 0x7fedc41018c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:25.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.365+0000 7fedc9dff700 1 --2- 172.21.15.8:0/3079209377 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedc4102690 0x7fedc4102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:25.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.365+0000 7fedc9dff700 1 -- 172.21.15.8:0/3079209377 >> 172.21.15.8:0/3079209377 conn(0x7fedc40fca10 msgr2=0x7fedc40fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:25.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.365+0000 7fedc9dff700 1 -- 172.21.15.8:0/3079209377 shutdown_connections 2023-12-17T12:02:25.368 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.365+0000 7fedc9dff700 1 -- 172.21.15.8:0/3079209377 wait complete. 2023-12-17T12:02:25.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.366+0000 7fedc9dff700 1 Processor -- start 2023-12-17T12:02:25.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.366+0000 7fedc9dff700 1 -- start start 2023-12-17T12:02:25.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.366+0000 7fedc9dff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedc41014a0 0x7fedc4199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:25.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.366+0000 7fedc9dff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fedc4102690 0x7fedc4199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:25.370 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.366+0000 7fedc9dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedc4103030 0x7fedc41a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:25.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.366+0000 7fedc9dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc41a10c0 con 0x7fedc4103030 2023-12-17T12:02:25.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.366+0000 7fedc9dff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc41a1200 con 0x7fedc41014a0 2023-12-17T12:02:25.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.366+0000 7fedc9dff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc41a1390 con 0x7fedc4102690 2023-12-17T12:02:25.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.367+0000 7fedc3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedc4103030 0x7fedc41a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:25.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.367+0000 7fedc3fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedc4103030 0x7fedc41a0af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42862/0 (socket says 172.21.15.8:42862) 2023-12-17T12:02:25.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.367+0000 7fedc3fff700 1 -- 172.21.15.8:0/2940355999 learned_addr learned my addr 172.21.15.8:0/2940355999 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:02:25.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.367+0000 7fedc37fe700 1 --2- 172.21.15.8:0/2940355999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedc41014a0 0x7fedc4199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:25.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.367+0000 7fedc2ffd700 1 --2- 172.21.15.8:0/2940355999 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fedc4102690 0x7fedc4199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:25.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.367+0000 7fedc3fff700 1 -- 172.21.15.8:0/2940355999 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fedc4102690 msgr2=0x7fedc4199ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:25.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.367+0000 7fedc3fff700 1 --2- 172.21.15.8:0/2940355999 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fedc4102690 0x7fedc4199ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:25.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.367+0000 7fedc3fff700 1 -- 172.21.15.8:0/2940355999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedc41014a0 msgr2=0x7fedc4199590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:25.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.367+0000 7fedc3fff700 1 --2- 172.21.15.8:0/2940355999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedc41014a0 0x7fedc4199590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:25.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.367+0000 7fedc3fff700 1 -- 172.21.15.8:0/2940355999 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb40095f0 con 0x7fedc4103030 2023-12-17T12:02:25.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.367+0000 7fedc37fe700 1 --2- 172.21.15.8:0/2940355999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedc41014a0 0x7fedc4199590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T12:02:25.371 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.367+0000 7fedc3fff700 1 --2- 172.21.15.8:0/2940355999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedc4103030 0x7fedc41a0af0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fedbc007ee0 tx=0x7fedbc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:25.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.368+0000 7fedc0ff9700 1 -- 172.21.15.8:0/2940355999 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedbc017070 con 0x7fedc4103030 2023-12-17T12:02:25.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.368+0000 7fedc0ff9700 1 -- 172.21.15.8:0/2940355999 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fedbc00f040 con 0x7fedc4103030 2023-12-17T12:02:25.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.368+0000 7fedc9dff700 1 -- 172.21.15.8:0/2940355999 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedc41a1670 con 0x7fedc4103030 2023-12-17T12:02:25.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.368+0000 7fedc0ff9700 1 -- 172.21.15.8:0/2940355999 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedbc005570 con 0x7fedc4103030 2023-12-17T12:02:25.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.368+0000 7fedc9dff700 1 -- 172.21.15.8:0/2940355999 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc41a1b80 con 0x7fedc4103030 2023-12-17T12:02:25.372 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.369+0000 7fedc9dff700 1 -- 172.21.15.8:0/2940355999 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedc4068230 con 0x7fedc4103030 2023-12-17T12:02:25.373 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.371+0000 7fedc0ff9700 1 -- 172.21.15.8:0/2940355999 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7fedbc00db20 con 0x7fedc4103030 2023-12-17T12:02:25.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.372+0000 7fedc0ff9700 1 --2- 172.21.15.8:0/2940355999 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fedac0a1500 0x7fedac0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:25.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.372+0000 7fedc0ff9700 1 -- 172.21.15.8:0/2940355999 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fedbc0cbff0 con 0x7fedc4103030 2023-12-17T12:02:25.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.372+0000 7fedc37fe700 1 --2- 172.21.15.8:0/2940355999 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fedac0a1500 0x7fedac0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:25.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.373+0000 7fedc37fe700 1 --2- 172.21.15.8:0/2940355999 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fedac0a1500 0x7fedac0a39c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fedb4000c00 tx=0x7fedb4003680 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:25.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.377+0000 7fedc0ff9700 1 -- 172.21.15.8:0/2940355999 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fedbc0ff2f0 con 0x7fedc4103030 2023-12-17T12:02:25.638 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.636+0000 7fedc9dff700 1 -- 172.21.15.8:0/2940355999 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fedc410cd80 con 0x7fedc4103030 2023-12-17T12:02:25.639 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.636+0000 7fedc0ff9700 1 -- 172.21.15.8:0/2940355999 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3692 (secure 0 0 0) 0x7fedbc095a90 con 0x7fedc4103030 2023-12-17T12:02:25.639 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:02:25.639 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2669069079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2669069079},{"type":"v1","addr":"172.21.15.8:6835","nonce":2669069079}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/4241050553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":4241050553},{"type":"v1","addr":"172.21.15.8:6837","nonce":4241050553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/582753561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":582753561},{"type":"v1","addr":"172.21.15.186:6833","nonce":582753561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/305815776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":305815776},{"type":"v1","addr":"172.21.15.100:6833","nonce":305815776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-12-17T12:02:25.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.639+0000 7fedc9dff700 1 -- 172.21.15.8:0/2940355999 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fedac0a1500 msgr2=0x7fedac0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:25.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.639+0000 7fedc9dff700 1 --2- 172.21.15.8:0/2940355999 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fedac0a1500 0x7fedac0a39c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fedb4000c00 tx=0x7fedb4003680 comp rx=0 tx=0).stop 2023-12-17T12:02:25.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.639+0000 7fedc9dff700 1 -- 172.21.15.8:0/2940355999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedc4103030 msgr2=0x7fedc41a0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:25.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.639+0000 7fedc9dff700 1 --2- 172.21.15.8:0/2940355999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedc4103030 0x7fedc41a0af0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fedbc007ee0 tx=0x7fedbc00d3b0 comp rx=0 tx=0).stop 2023-12-17T12:02:25.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.639+0000 7fedc9dff700 1 -- 172.21.15.8:0/2940355999 shutdown_connections 2023-12-17T12:02:25.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.639+0000 7fedc9dff700 1 --2- 172.21.15.8:0/2940355999 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fedac0a1500 0x7fedac0a39c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:25.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.639+0000 7fedc9dff700 1 --2- 172.21.15.8:0/2940355999 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fedc4103030 0x7fedc41a0af0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:25.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.639+0000 7fedc9dff700 1 --2- 172.21.15.8:0/2940355999 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fedc41014a0 0x7fedc4199590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:25.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.639+0000 7fedc9dff700 1 --2- 172.21.15.8:0/2940355999 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fedc4102690 0x7fedc4199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:25.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.639+0000 7fedc9dff700 1 -- 172.21.15.8:0/2940355999 >> 172.21.15.8:0/2940355999 conn(0x7fedc40fca10 msgr2=0x7fedc4107eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:25.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.639+0000 7fedc9dff700 1 -- 172.21.15.8:0/2940355999 shutdown_connections 2023-12-17T12:02:25.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:25.639+0000 7fedc9dff700 1 -- 172.21.15.8:0/2940355999 wait complete. 2023-12-17T12:02:25.643 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 5 2023-12-17T12:02:25.845 INFO:journalctl@ceph.mds.e.smithi100.stdout:Dec 17 12:02:25 smithi100 systemd[1]: Starting Ceph mds.e for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:02:26.225 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:25 smithi186 ceph-mon[41182]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:26.226 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:25 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/2940355999' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:26.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:25 smithi008 ceph-mon[36830]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:26.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:25 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/2940355999' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:26.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:25 smithi100 ceph-mon[41266]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:26.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:25 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/2940355999' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:26.416 INFO:journalctl@ceph.mds.e.smithi100.stdout:Dec 17 12:02:25 smithi100 bash[75719]: c048b02a68c2bfc4f6a04c2b8ef03b939ef5e536c69c2277c7514df75d7c6db0 2023-12-17T12:02:26.416 INFO:journalctl@ceph.mds.e.smithi100.stdout:Dec 17 12:02:25 smithi100 systemd[1]: Started Ceph mds.e for f43f508a-9cd2-11ee-95a5-87774f69a715. 2023-12-17T12:02:26.416 INFO:journalctl@ceph.mds.e.smithi100.stdout:Dec 17 12:02:25 smithi100 ceph-mds[75757]: -- 172.21.15.100:0/2895077658 <== mon.2 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f3ebbf3520 con 0x55f3ebbcac00 2023-12-17T12:02:26.416 INFO:journalctl@ceph.mds.e.smithi100.stdout:Dec 17 12:02:26 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-e[75734]: starting mds.e at 2023-12-17T12:02:27.338 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:27.338 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:27.338 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:27.338 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:02:27.338 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T12:02:27.338 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:27.338 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:27 smithi186 ceph-mon[41182]: Deploying daemon mds.f on smithi186 2023-12-17T12:02:27.338 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:27 smithi186 ceph-mon[41182]: mds.? [v2:172.21.15.100:6834/2140351853,v1:172.21.15.100:6835/2140351853] up:boot 2023-12-17T12:02:27.338 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:27 smithi186 ceph-mon[41182]: fsmap 5 up:standby 2023-12-17T12:02:27.339 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-12-17T12:02:27.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:27.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:27.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:27.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:02:27.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T12:02:27.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:27.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:27 smithi100 ceph-mon[41266]: Deploying daemon mds.f on smithi186 2023-12-17T12:02:27.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:27 smithi100 ceph-mon[41266]: mds.? [v2:172.21.15.100:6834/2140351853,v1:172.21.15.100:6835/2140351853] up:boot 2023-12-17T12:02:27.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:27 smithi100 ceph-mon[41266]: fsmap 5 up:standby 2023-12-17T12:02:27.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-12-17T12:02:27.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:27.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:27.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:27.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:02:27.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T12:02:27.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:27.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:27 smithi008 ceph-mon[36830]: Deploying daemon mds.f on smithi186 2023-12-17T12:02:27.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:27 smithi008 ceph-mon[36830]: mds.? [v2:172.21.15.100:6834/2140351853,v1:172.21.15.100:6835/2140351853] up:boot 2023-12-17T12:02:27.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:27 smithi008 ceph-mon[36830]: fsmap 5 up:standby 2023-12-17T12:02:27.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-12-17T12:02:27.662 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-17T12:02:27.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.874+0000 7f9cc51ff700 1 -- 172.21.15.8:0/2146064835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cc0103030 msgr2=0x7f9cc01098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:27.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.874+0000 7f9cc51ff700 1 --2- 172.21.15.8:0/2146064835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cc0103030 0x7f9cc01098e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9cb800b0d0 tx=0x7f9cb800b3e0 comp rx=0 tx=0).stop 2023-12-17T12:02:27.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.874+0000 7f9cc51ff700 1 -- 172.21.15.8:0/2146064835 shutdown_connections 2023-12-17T12:02:27.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.874+0000 7f9cc51ff700 1 --2- 172.21.15.8:0/2146064835 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cc0103030 0x7f9cc01098e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:27.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.874+0000 7f9cc51ff700 1 --2- 172.21.15.8:0/2146064835 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9cc01014a0 0x7f9cc01018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:27.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.874+0000 7f9cc51ff700 1 --2- 172.21.15.8:0/2146064835 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cc0102690 0x7f9cc0102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:27.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.874+0000 7f9cc51ff700 1 -- 172.21.15.8:0/2146064835 >> 172.21.15.8:0/2146064835 conn(0x7f9cc00fca10 msgr2=0x7f9cc00fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:27.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.874+0000 7f9cc51ff700 1 -- 172.21.15.8:0/2146064835 shutdown_connections 2023-12-17T12:02:27.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.874+0000 7f9cc51ff700 1 -- 172.21.15.8:0/2146064835 wait complete. 2023-12-17T12:02:27.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.875+0000 7f9cc51ff700 1 Processor -- start 2023-12-17T12:02:27.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.875+0000 7f9cc51ff700 1 -- start start 2023-12-17T12:02:27.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.875+0000 7f9cc51ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cc01014a0 0x7f9cc01995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:27.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.875+0000 7f9cc51ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cc0102690 0x7f9cc0199b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:27.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.875+0000 7f9cc51ff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9cc0103030 0x7f9cc01a0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:27.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.875+0000 7f9cc51ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc01a10b0 con 0x7f9cc0102690 2023-12-17T12:02:27.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.875+0000 7f9cc51ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc01a11f0 con 0x7f9cc01014a0 2023-12-17T12:02:27.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.875+0000 7f9cc51ff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cc01a1380 con 0x7f9cc0103030 2023-12-17T12:02:27.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.875+0000 7f9cbe59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cc0102690 0x7f9cc0199b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:27.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.876+0000 7f9cbe59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cc0102690 0x7f9cc0199b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42878/0 (socket says 172.21.15.8:42878) 2023-12-17T12:02:27.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.876+0000 7f9cbe59c700 1 -- 172.21.15.8:0/3892031863 learned_addr learned my addr 172.21.15.8:0/3892031863 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:02:27.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.876+0000 7f9cbf59e700 1 --2- 172.21.15.8:0/3892031863 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9cc0103030 0x7f9cc01a0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:27.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.876+0000 7f9cbed9d700 1 --2- 172.21.15.8:0/3892031863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cc01014a0 0x7f9cc01995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:27.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.876+0000 7f9cbe59c700 1 -- 172.21.15.8:0/3892031863 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9cc0103030 msgr2=0x7f9cc01a0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:27.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.876+0000 7f9cbe59c700 1 --2- 172.21.15.8:0/3892031863 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9cc0103030 0x7f9cc01a0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:27.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.876+0000 7f9cbe59c700 1 -- 172.21.15.8:0/3892031863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cc01014a0 msgr2=0x7f9cc01995d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:27.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.876+0000 7f9cbe59c700 1 --2- 172.21.15.8:0/3892031863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cc01014a0 0x7f9cc01995d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:27.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.876+0000 7f9cbe59c700 1 -- 172.21.15.8:0/3892031863 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb8009d00 con 0x7f9cc0102690 2023-12-17T12:02:27.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.876+0000 7f9cbf59e700 1 --2- 172.21.15.8:0/3892031863 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9cc0103030 0x7f9cc01a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T12:02:27.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.876+0000 7f9cbe59c700 1 --2- 172.21.15.8:0/3892031863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cc0102690 0x7f9cc0199b10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9cb400c9b0 tx=0x7f9cb400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:27.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.876+0000 7f9ca7fff700 1 -- 172.21.15.8:0/3892031863 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb4007b00 con 0x7f9cc0102690 2023-12-17T12:02:27.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.876+0000 7f9ca7fff700 1 -- 172.21.15.8:0/3892031863 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9cb400ce50 con 0x7f9cc0102690 2023-12-17T12:02:27.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.876+0000 7f9ca7fff700 1 -- 172.21.15.8:0/3892031863 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb4018420 con 0x7f9cc0102690 2023-12-17T12:02:27.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.877+0000 7f9cc51ff700 1 -- 172.21.15.8:0/3892031863 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc01a1660 con 0x7f9cc0102690 2023-12-17T12:02:27.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.877+0000 7f9cc51ff700 1 -- 172.21.15.8:0/3892031863 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cc01a1b20 con 0x7f9cc0102690 2023-12-17T12:02:27.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.878+0000 7f9cc51ff700 1 -- 172.21.15.8:0/3892031863 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cc0068230 con 0x7f9cc0102690 2023-12-17T12:02:27.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.879+0000 7f9ca7fff700 1 -- 172.21.15.8:0/3892031863 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7f9cb400f450 con 0x7f9cc0102690 2023-12-17T12:02:27.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.882+0000 7f9ca7fff700 1 --2- 172.21.15.8:0/3892031863 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f9ca80a1480 0x7f9ca80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:27.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.882+0000 7f9ca7fff700 1 -- 172.21.15.8:0/3892031863 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f9cb40cc860 con 0x7f9cc0102690 2023-12-17T12:02:27.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.882+0000 7f9cbed9d700 1 --2- 172.21.15.8:0/3892031863 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f9ca80a1480 0x7f9ca80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:27.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.883+0000 7f9cbed9d700 1 --2- 172.21.15.8:0/3892031863 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f9ca80a1480 0x7f9ca80a3940 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9cc01024f0 tx=0x7f9cb0009260 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:27.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:27.886+0000 7f9ca7fff700 1 -- 172.21.15.8:0/3892031863 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f9cb40962c0 con 0x7f9cc0102690 2023-12-17T12:02:28.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:28.145+0000 7f9cc51ff700 1 -- 172.21.15.8:0/3892031863 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9cc010cb70 con 0x7f9cc0102690 2023-12-17T12:02:28.148 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:28.145+0000 7f9ca7fff700 1 -- 172.21.15.8:0/3892031863 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4486 (secure 0 0 0) 0x7f9cb400f700 con 0x7f9cc0102690 2023-12-17T12:02:28.148 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:02:28.148 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2669069079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2669069079},{"type":"v1","addr":"172.21.15.8:6835","nonce":2669069079}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/4241050553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":4241050553},{"type":"v1","addr":"172.21.15.8:6837","nonce":4241050553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/582753561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":582753561},{"type":"v1","addr":"172.21.15.186:6833","nonce":582753561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/305815776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":305815776},{"type":"v1","addr":"172.21.15.100:6833","nonce":305815776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24503,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2140351853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2140351853},{"type":"v1","addr":"172.21.15.100:6835","nonce":2140351853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[]} 2023-12-17T12:02:28.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:28.147+0000 7f9cc51ff700 1 -- 172.21.15.8:0/3892031863 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f9ca80a1480 msgr2=0x7f9ca80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:28.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:28.147+0000 7f9cc51ff700 1 --2- 172.21.15.8:0/3892031863 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f9ca80a1480 0x7f9ca80a3940 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9cc01024f0 tx=0x7f9cb0009260 comp rx=0 tx=0).stop 2023-12-17T12:02:28.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:28.147+0000 7f9cc51ff700 1 -- 172.21.15.8:0/3892031863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cc0102690 msgr2=0x7f9cc0199b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:28.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:28.147+0000 7f9cc51ff700 1 --2- 172.21.15.8:0/3892031863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cc0102690 0x7f9cc0199b10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f9cb400c9b0 tx=0x7f9cb400ccc0 comp rx=0 tx=0).stop 2023-12-17T12:02:28.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:28.148+0000 7f9cc51ff700 1 -- 172.21.15.8:0/3892031863 shutdown_connections 2023-12-17T12:02:28.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:28.148+0000 7f9cc51ff700 1 --2- 172.21.15.8:0/3892031863 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f9ca80a1480 0x7f9ca80a3940 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:28.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:28.148+0000 7f9cc51ff700 1 --2- 172.21.15.8:0/3892031863 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9cc0103030 0x7f9cc01a0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:28.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:28.148+0000 7f9cc51ff700 1 --2- 172.21.15.8:0/3892031863 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9cc01014a0 0x7f9cc01995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:28.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:28.148+0000 7f9cc51ff700 1 --2- 172.21.15.8:0/3892031863 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9cc0102690 0x7f9cc0199b10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:28.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:28.148+0000 7f9cc51ff700 1 -- 172.21.15.8:0/3892031863 >> 172.21.15.8:0/3892031863 conn(0x7f9cc00fca10 msgr2=0x7f9cc0073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:28.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:28.148+0000 7f9cc51ff700 1 -- 172.21.15.8:0/3892031863 shutdown_connections 2023-12-17T12:02:28.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:28.148+0000 7f9cc51ff700 1 -- 172.21.15.8:0/3892031863 wait complete. 2023-12-17T12:02:28.152 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 6 2023-12-17T12:02:28.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:28 smithi100 ceph-mon[41266]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:28.427 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:28 smithi186 ceph-mon[41182]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:28.427 INFO:journalctl@ceph.mds.f.smithi186.stdout:Dec 17 12:02:28 smithi186 systemd[1]: Starting Ceph mds.f for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:02:28.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:28 smithi008 ceph-mon[36830]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:28.976 INFO:journalctl@ceph.mds.f.smithi186.stdout:Dec 17 12:02:28 smithi186 bash[76983]: c89469eb6730bb51d7f3863f4340ef01678ca77856b13ee5c523cb9ba4558053 2023-12-17T12:02:28.976 INFO:journalctl@ceph.mds.f.smithi186.stdout:Dec 17 12:02:28 smithi186 systemd[1]: Started Ceph mds.f for f43f508a-9cd2-11ee-95a5-87774f69a715. 2023-12-17T12:02:28.976 INFO:journalctl@ceph.mds.f.smithi186.stdout:Dec 17 12:02:28 smithi186 ceph-mds[77021]: -- 172.21.15.186:0/1437688654 <== mon.1 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5641271a5520 con 0x56412717d000 2023-12-17T12:02:28.976 INFO:journalctl@ceph.mds.f.smithi186.stdout:Dec 17 12:02:28 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-f[76998]: starting mds.f at 2023-12-17T12:02:29.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:29 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/3892031863' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:29.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:29 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:29.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:29 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:29.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:29 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:29.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:29 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:02:29.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:29 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T12:02:29.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:29 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:29.439 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:29 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/3892031863' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:29.439 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:29 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:29.439 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:29 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:29.439 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:29 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:29.439 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:29 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:02:29.439 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:29 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T12:02:29.439 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:29 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:29.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:29 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/3892031863' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:29.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:29 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:29.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:29 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:29.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:29 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:29.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:29 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:02:29.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:29 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T12:02:29.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:29 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:30.170 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-17T12:02:30.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.381+0000 7f1d22dff700 1 -- 172.21.15.8:0/1796464336 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d1c102690 msgr2=0x7f1d1c102af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:30.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.381+0000 7f1d22dff700 1 --2- 172.21.15.8:0/1796464336 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d1c102690 0x7f1d1c102af0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1d080099c0 tx=0x7f1d08009cd0 comp rx=0 tx=0).stop 2023-12-17T12:02:30.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.381+0000 7f1d22dff700 1 -- 172.21.15.8:0/1796464336 shutdown_connections 2023-12-17T12:02:30.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.381+0000 7f1d22dff700 1 --2- 172.21.15.8:0/1796464336 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d1c103030 0x7f1d1c1098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:30.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.381+0000 7f1d22dff700 1 --2- 172.21.15.8:0/1796464336 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d1c1014a0 0x7f1d1c1018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:30.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.381+0000 7f1d22dff700 1 --2- 172.21.15.8:0/1796464336 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d1c102690 0x7f1d1c102af0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:30.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.381+0000 7f1d22dff700 1 -- 172.21.15.8:0/1796464336 >> 172.21.15.8:0/1796464336 conn(0x7f1d1c0fca10 msgr2=0x7f1d1c0fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:30.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.381+0000 7f1d22dff700 1 -- 172.21.15.8:0/1796464336 shutdown_connections 2023-12-17T12:02:30.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.382+0000 7f1d22dff700 1 -- 172.21.15.8:0/1796464336 wait complete. 2023-12-17T12:02:30.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.382+0000 7f1d22dff700 1 Processor -- start 2023-12-17T12:02:30.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.383+0000 7f1d22dff700 1 -- start start 2023-12-17T12:02:30.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.383+0000 7f1d22dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d1c1014a0 0x7f1d1c197390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:30.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.383+0000 7f1d22dff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d1c102690 0x7f1d1c1978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:30.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.383+0000 7f1d22dff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d1c103030 0x7f1d1c19e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:30.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.383+0000 7f1d22dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c19ee70 con 0x7f1d1c1014a0 2023-12-17T12:02:30.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.383+0000 7f1d22dff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c19efb0 con 0x7f1d1c103030 2023-12-17T12:02:30.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.383+0000 7f1d22dff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1c19f140 con 0x7f1d1c102690 2023-12-17T12:02:30.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.383+0000 7f1d20b9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d1c1014a0 0x7f1d1c197390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:30.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.383+0000 7f1d20b9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d1c1014a0 0x7f1d1c197390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:42906/0 (socket says 172.21.15.8:42906) 2023-12-17T12:02:30.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.383+0000 7f1d20b9b700 1 -- 172.21.15.8:0/1416396706 learned_addr learned my addr 172.21.15.8:0/1416396706 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:02:30.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.383+0000 7f1d1bfff700 1 --2- 172.21.15.8:0/1416396706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d1c102690 0x7f1d1c1978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:30.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.383+0000 7f1d2139c700 1 --2- 172.21.15.8:0/1416396706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d1c103030 0x7f1d1c19e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:30.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.384+0000 7f1d20b9b700 1 -- 172.21.15.8:0/1416396706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d1c102690 msgr2=0x7f1d1c1978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:30.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.384+0000 7f1d20b9b700 1 --2- 172.21.15.8:0/1416396706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d1c102690 0x7f1d1c1978d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:30.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.384+0000 7f1d20b9b700 1 -- 172.21.15.8:0/1416396706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d1c103030 msgr2=0x7f1d1c19e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:30.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.384+0000 7f1d20b9b700 1 --2- 172.21.15.8:0/1416396706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d1c103030 0x7f1d1c19e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:30.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.384+0000 7f1d20b9b700 1 -- 172.21.15.8:0/1416396706 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d080095f0 con 0x7f1d1c1014a0 2023-12-17T12:02:30.388 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.384+0000 7f1d2139c700 1 --2- 172.21.15.8:0/1416396706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d1c103030 0x7f1d1c19e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T12:02:30.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.384+0000 7f1d20b9b700 1 --2- 172.21.15.8:0/1416396706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d1c1014a0 0x7f1d1c197390 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1d1000d980 tx=0x7f1d1000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:30.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.384+0000 7f1d19ffb700 1 -- 172.21.15.8:0/1416396706 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d10004020 con 0x7f1d1c1014a0 2023-12-17T12:02:30.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.384+0000 7f1d19ffb700 1 -- 172.21.15.8:0/1416396706 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1d10009730 con 0x7f1d1c1014a0 2023-12-17T12:02:30.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.384+0000 7f1d22dff700 1 -- 172.21.15.8:0/1416396706 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d1c19f420 con 0x7f1d1c1014a0 2023-12-17T12:02:30.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.384+0000 7f1d19ffb700 1 -- 172.21.15.8:0/1416396706 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d10003a00 con 0x7f1d1c1014a0 2023-12-17T12:02:30.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.384+0000 7f1d22dff700 1 -- 172.21.15.8:0/1416396706 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d1c19f980 con 0x7f1d1c1014a0 2023-12-17T12:02:30.389 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.385+0000 7f1d22dff700 1 -- 172.21.15.8:0/1416396706 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d1c108990 con 0x7f1d1c1014a0 2023-12-17T12:02:30.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.387+0000 7f1d19ffb700 1 -- 172.21.15.8:0/1416396706 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7f1d100098a0 con 0x7f1d1c1014a0 2023-12-17T12:02:30.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.389+0000 7f1d19ffb700 1 --2- 172.21.15.8:0/1416396706 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f1d0c0a1500 0x7f1d0c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:30.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.389+0000 7f1d19ffb700 1 -- 172.21.15.8:0/1416396706 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f1d100cc8e0 con 0x7f1d1c1014a0 2023-12-17T12:02:30.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.389+0000 7f1d1bfff700 1 --2- 172.21.15.8:0/1416396706 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f1d0c0a1500 0x7f1d0c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:30.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.390+0000 7f1d1bfff700 1 --2- 172.21.15.8:0/1416396706 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f1d0c0a1500 0x7f1d0c0a39c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1d0800b580 tx=0x7f1d08005e80 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:30.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.391+0000 7f1d19ffb700 1 -- 172.21.15.8:0/1416396706 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f1d100963c0 con 0x7f1d1c1014a0 2023-12-17T12:02:30.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:30 smithi100 ceph-mon[41266]: Deploying daemon mds.c on smithi186 2023-12-17T12:02:30.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:30 smithi100 ceph-mon[41266]: mds.? [v2:172.21.15.186:6834/2765387309,v1:172.21.15.186:6835/2765387309] up:boot 2023-12-17T12:02:30.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:30 smithi100 ceph-mon[41266]: fsmap 6 up:standby 2023-12-17T12:02:30.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:30 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-12-17T12:02:30.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:30 smithi100 ceph-mon[41266]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:30.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:30 smithi186 ceph-mon[41182]: Deploying daemon mds.c on smithi186 2023-12-17T12:02:30.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:30 smithi186 ceph-mon[41182]: mds.? [v2:172.21.15.186:6834/2765387309,v1:172.21.15.186:6835/2765387309] up:boot 2023-12-17T12:02:30.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:30 smithi186 ceph-mon[41182]: fsmap 6 up:standby 2023-12-17T12:02:30.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:30 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-12-17T12:02:30.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:30 smithi186 ceph-mon[41182]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:30.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:30 smithi008 ceph-mon[36830]: Deploying daemon mds.c on smithi186 2023-12-17T12:02:30.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:30 smithi008 ceph-mon[36830]: mds.? [v2:172.21.15.186:6834/2765387309,v1:172.21.15.186:6835/2765387309] up:boot 2023-12-17T12:02:30.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:30 smithi008 ceph-mon[36830]: fsmap 6 up:standby 2023-12-17T12:02:30.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:30 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-12-17T12:02:30.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:30 smithi008 ceph-mon[36830]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:30.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.651+0000 7f1d22dff700 1 -- 172.21.15.8:0/1416396706 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1d1c068230 con 0x7f1d1c1014a0 2023-12-17T12:02:30.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.652+0000 7f1d19ffb700 1 -- 172.21.15.8:0/1416396706 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5280 (secure 0 0 0) 0x7f1d100999e0 con 0x7f1d1c1014a0 2023-12-17T12:02:30.654 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:02:30.654 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2669069079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2669069079},{"type":"v1","addr":"172.21.15.8:6835","nonce":2669069079}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/4241050553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":4241050553},{"type":"v1","addr":"172.21.15.8:6837","nonce":4241050553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14640,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/2765387309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2765387309},{"type":"v1","addr":"172.21.15.186:6835","nonce":2765387309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/582753561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":582753561},{"type":"v1","addr":"172.21.15.186:6833","nonce":582753561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/305815776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":305815776},{"type":"v1","addr":"172.21.15.100:6833","nonce":305815776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24503,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2140351853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2140351853},{"type":"v1","addr":"172.21.15.100:6835","nonce":2140351853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6}],"filesystems":[]} 2023-12-17T12:02:30.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.654+0000 7f1d22dff700 1 -- 172.21.15.8:0/1416396706 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f1d0c0a1500 msgr2=0x7f1d0c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:30.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.654+0000 7f1d22dff700 1 --2- 172.21.15.8:0/1416396706 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f1d0c0a1500 0x7f1d0c0a39c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1d0800b580 tx=0x7f1d08005e80 comp rx=0 tx=0).stop 2023-12-17T12:02:30.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.654+0000 7f1d22dff700 1 -- 172.21.15.8:0/1416396706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d1c1014a0 msgr2=0x7f1d1c197390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:30.657 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.654+0000 7f1d22dff700 1 --2- 172.21.15.8:0/1416396706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d1c1014a0 0x7f1d1c197390 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1d1000d980 tx=0x7f1d1000dc90 comp rx=0 tx=0).stop 2023-12-17T12:02:30.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.654+0000 7f1d22dff700 1 -- 172.21.15.8:0/1416396706 shutdown_connections 2023-12-17T12:02:30.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.654+0000 7f1d22dff700 1 --2- 172.21.15.8:0/1416396706 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f1d0c0a1500 0x7f1d0c0a39c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:30.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.654+0000 7f1d22dff700 1 --2- 172.21.15.8:0/1416396706 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d1c103030 0x7f1d1c19e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:30.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.654+0000 7f1d22dff700 1 --2- 172.21.15.8:0/1416396706 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d1c1014a0 0x7f1d1c197390 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:30.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.654+0000 7f1d22dff700 1 --2- 172.21.15.8:0/1416396706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d1c102690 0x7f1d1c1978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:30.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.654+0000 7f1d22dff700 1 -- 172.21.15.8:0/1416396706 >> 172.21.15.8:0/1416396706 conn(0x7f1d1c0fca10 msgr2=0x7f1d1c105ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:30.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.654+0000 7f1d22dff700 1 -- 172.21.15.8:0/1416396706 shutdown_connections 2023-12-17T12:02:30.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:30.655+0000 7f1d22dff700 1 -- 172.21.15.8:0/1416396706 wait complete. 2023-12-17T12:02:30.658 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 7 2023-12-17T12:02:30.731 INFO:journalctl@ceph.mds.c.smithi186.stdout:Dec 17 12:02:30 smithi186 systemd[1]: Starting Ceph mds.c for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:02:31.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:31 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/1416396706' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:31.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:31 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/1416396706' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:31.476 INFO:journalctl@ceph.mds.c.smithi186.stdout:Dec 17 12:02:31 smithi186 bash[77323]: 01f0e96d76022def25cdb8bcfac6f9c87d83f790b1d039d4f704b9a7f6afeb3b 2023-12-17T12:02:31.476 INFO:journalctl@ceph.mds.c.smithi186.stdout:Dec 17 12:02:31 smithi186 systemd[1]: Started Ceph mds.c for f43f508a-9cd2-11ee-95a5-87774f69a715. 2023-12-17T12:02:31.476 INFO:journalctl@ceph.mds.c.smithi186.stdout:Dec 17 12:02:31 smithi186 ceph-mds[77361]: -- 172.21.15.186:0/222660204 <== mon.1 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556b85425520 con 0x556b853fc800 2023-12-17T12:02:31.476 INFO:journalctl@ceph.mds.c.smithi186.stdout:Dec 17 12:02:31 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-c[77338]: starting mds.c at 2023-12-17T12:02:31.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:31 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/1416396706' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:32.665 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:32 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:32.665 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:32 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:32.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:32 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:32.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:32 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:02:32.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:32 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T12:02:32.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:32 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:32.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:32 smithi100 ceph-mon[41266]: Deploying daemon mds.h on smithi100 2023-12-17T12:02:32.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:32 smithi100 ceph-mon[41266]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:32.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:32 smithi100 ceph-mon[41266]: mds.? [v2:172.21.15.186:6836/822451724,v1:172.21.15.186:6837/822451724] up:boot 2023-12-17T12:02:32.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:32 smithi100 ceph-mon[41266]: fsmap 7 up:standby 2023-12-17T12:02:32.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:32 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-12-17T12:02:32.678 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-17T12:02:32.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:32 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:32.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:32 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:32.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:32 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:32.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:32 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:02:32.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:32 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T12:02:32.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:32 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:32.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:32 smithi186 ceph-mon[41182]: Deploying daemon mds.h on smithi100 2023-12-17T12:02:32.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:32 smithi186 ceph-mon[41182]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:32.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:32 smithi186 ceph-mon[41182]: mds.? [v2:172.21.15.186:6836/822451724,v1:172.21.15.186:6837/822451724] up:boot 2023-12-17T12:02:32.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:32 smithi186 ceph-mon[41182]: fsmap 7 up:standby 2023-12-17T12:02:32.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:32 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-12-17T12:02:32.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:32 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:32.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:32 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:32.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:32 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:32.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:32 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:02:32.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:32 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T12:02:32.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:32 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:32.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:32 smithi008 ceph-mon[36830]: Deploying daemon mds.h on smithi100 2023-12-17T12:02:32.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:32 smithi008 ceph-mon[36830]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:32.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:32 smithi008 ceph-mon[36830]: mds.? [v2:172.21.15.186:6836/822451724,v1:172.21.15.186:6837/822451724] up:boot 2023-12-17T12:02:32.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:32 smithi008 ceph-mon[36830]: fsmap 7 up:standby 2023-12-17T12:02:32.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:32 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-12-17T12:02:32.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.890+0000 7f6b253ff700 1 -- 172.21.15.8:0/4154120239 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b201014a0 msgr2=0x7f6b201018c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:32.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.890+0000 7f6b253ff700 1 --2- 172.21.15.8:0/4154120239 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b201014a0 0x7f6b201018c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6b100099c0 tx=0x7f6b10009cd0 comp rx=0 tx=0).stop 2023-12-17T12:02:32.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.890+0000 7f6b253ff700 1 -- 172.21.15.8:0/4154120239 shutdown_connections 2023-12-17T12:02:32.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.890+0000 7f6b253ff700 1 --2- 172.21.15.8:0/4154120239 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b20103030 0x7f6b201098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:32.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.890+0000 7f6b253ff700 1 --2- 172.21.15.8:0/4154120239 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b201014a0 0x7f6b201018c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:32.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.890+0000 7f6b253ff700 1 --2- 172.21.15.8:0/4154120239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b20102690 0x7f6b20102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:32.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.890+0000 7f6b253ff700 1 -- 172.21.15.8:0/4154120239 >> 172.21.15.8:0/4154120239 conn(0x7f6b200fca10 msgr2=0x7f6b200fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:32.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.890+0000 7f6b253ff700 1 -- 172.21.15.8:0/4154120239 shutdown_connections 2023-12-17T12:02:32.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.890+0000 7f6b253ff700 1 -- 172.21.15.8:0/4154120239 wait complete. 2023-12-17T12:02:32.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.891+0000 7f6b253ff700 1 Processor -- start 2023-12-17T12:02:32.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.891+0000 7f6b253ff700 1 -- start start 2023-12-17T12:02:32.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.892+0000 7f6b253ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b201014a0 0x7f6b20197420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:32.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.892+0000 7f6b253ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b20102690 0x7f6b20197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:32.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.892+0000 7f6b253ff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b20103030 0x7f6b2019e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:32.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.892+0000 7f6b253ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2019ef00 con 0x7f6b20102690 2023-12-17T12:02:32.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.892+0000 7f6b253ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2019f040 con 0x7f6b201014a0 2023-12-17T12:02:32.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.892+0000 7f6b253ff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2019f1d0 con 0x7f6b20103030 2023-12-17T12:02:32.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.892+0000 7f6b1e7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b20102690 0x7f6b20197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:32.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.892+0000 7f6b1e7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b20102690 0x7f6b20197960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33942/0 (socket says 172.21.15.8:33942) 2023-12-17T12:02:32.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.892+0000 7f6b1e7fc700 1 -- 172.21.15.8:0/1297256544 learned_addr learned my addr 172.21.15.8:0/1297256544 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:02:32.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.892+0000 7f6b1effd700 1 --2- 172.21.15.8:0/1297256544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b201014a0 0x7f6b20197420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:32.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.892+0000 7f6b1f7fe700 1 --2- 172.21.15.8:0/1297256544 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b20103030 0x7f6b2019e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:32.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.892+0000 7f6b1e7fc700 1 -- 172.21.15.8:0/1297256544 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b20103030 msgr2=0x7f6b2019e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:32.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.892+0000 7f6b1e7fc700 1 --2- 172.21.15.8:0/1297256544 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b20103030 0x7f6b2019e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:32.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.892+0000 7f6b1e7fc700 1 -- 172.21.15.8:0/1297256544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b201014a0 msgr2=0x7f6b20197420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:32.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.892+0000 7f6b1e7fc700 1 --2- 172.21.15.8:0/1297256544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b201014a0 0x7f6b20197420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:32.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.892+0000 7f6b1e7fc700 1 -- 172.21.15.8:0/1297256544 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b100095f0 con 0x7f6b20102690 2023-12-17T12:02:32.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.893+0000 7f6b1e7fc700 1 --2- 172.21.15.8:0/1297256544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b20102690 0x7f6b20197960 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6b1400d950 tx=0x7f6b1400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:32.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.893+0000 7f6b07fff700 1 -- 172.21.15.8:0/1297256544 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1400f890 con 0x7f6b20102690 2023-12-17T12:02:32.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.893+0000 7f6b07fff700 1 -- 172.21.15.8:0/1297256544 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6b1400fe80 con 0x7f6b20102690 2023-12-17T12:02:32.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.893+0000 7f6b253ff700 1 -- 172.21.15.8:0/1297256544 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b2019f4b0 con 0x7f6b20102690 2023-12-17T12:02:32.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.893+0000 7f6b07fff700 1 -- 172.21.15.8:0/1297256544 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1400e3b0 con 0x7f6b20102690 2023-12-17T12:02:32.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.893+0000 7f6b253ff700 1 -- 172.21.15.8:0/1297256544 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b2019fa10 con 0x7f6b20102690 2023-12-17T12:02:32.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.894+0000 7f6b253ff700 1 -- 172.21.15.8:0/1297256544 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b20108a10 con 0x7f6b20102690 2023-12-17T12:02:32.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.896+0000 7f6b07fff700 1 -- 172.21.15.8:0/1297256544 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7f6b14010460 con 0x7f6b20102690 2023-12-17T12:02:32.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.898+0000 7f6b07fff700 1 --2- 172.21.15.8:0/1297256544 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f6b080a1500 0x7f6b080a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:32.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.899+0000 7f6b07fff700 1 -- 172.21.15.8:0/1297256544 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f6b140cc640 con 0x7f6b20102690 2023-12-17T12:02:32.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.899+0000 7f6b1effd700 1 --2- 172.21.15.8:0/1297256544 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f6b080a1500 0x7f6b080a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:32.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.899+0000 7f6b1effd700 1 --2- 172.21.15.8:0/1297256544 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f6b080a1500 0x7f6b080a39c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6b10006010 tx=0x7f6b10003740 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:32.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:32.903+0000 7f6b07fff700 1 -- 172.21.15.8:0/1297256544 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f6b140960a0 con 0x7f6b20102690 2023-12-17T12:02:33.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:33.162+0000 7f6b253ff700 1 -- 172.21.15.8:0/1297256544 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b20068230 con 0x7f6b20102690 2023-12-17T12:02:33.165 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:33.162+0000 7f6b07fff700 1 -- 172.21.15.8:0/1297256544 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+6071 (secure 0 0 0) 0x7f6b140996c0 con 0x7f6b20102690 2023-12-17T12:02:33.166 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:02:33.166 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2669069079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2669069079},{"type":"v1","addr":"172.21.15.8:6835","nonce":2669069079}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/4241050553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":4241050553},{"type":"v1","addr":"172.21.15.8:6837","nonce":4241050553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14640,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/2765387309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2765387309},{"type":"v1","addr":"172.21.15.186:6835","nonce":2765387309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/582753561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":582753561},{"type":"v1","addr":"172.21.15.186:6833","nonce":582753561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/305815776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":305815776},{"type":"v1","addr":"172.21.15.100:6833","nonce":305815776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24503,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2140351853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2140351853},{"type":"v1","addr":"172.21.15.100:6835","nonce":2140351853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24520,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/822451724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":822451724},{"type":"v1","addr":"172.21.15.186:6837","nonce":822451724}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8}],"filesystems":[]} 2023-12-17T12:02:33.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:33.165+0000 7f6b253ff700 1 -- 172.21.15.8:0/1297256544 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f6b080a1500 msgr2=0x7f6b080a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:33.168 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:33.165+0000 7f6b253ff700 1 --2- 172.21.15.8:0/1297256544 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f6b080a1500 0x7f6b080a39c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6b10006010 tx=0x7f6b10003740 comp rx=0 tx=0).stop 2023-12-17T12:02:33.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:33.165+0000 7f6b253ff700 1 -- 172.21.15.8:0/1297256544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b20102690 msgr2=0x7f6b20197960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:33.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:33.165+0000 7f6b253ff700 1 --2- 172.21.15.8:0/1297256544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b20102690 0x7f6b20197960 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6b1400d950 tx=0x7f6b1400dc60 comp rx=0 tx=0).stop 2023-12-17T12:02:33.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:33.165+0000 7f6b253ff700 1 -- 172.21.15.8:0/1297256544 shutdown_connections 2023-12-17T12:02:33.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:33.165+0000 7f6b253ff700 1 --2- 172.21.15.8:0/1297256544 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f6b080a1500 0x7f6b080a39c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:33.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:33.165+0000 7f6b253ff700 1 --2- 172.21.15.8:0/1297256544 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6b20103030 0x7f6b2019e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:33.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:33.165+0000 7f6b253ff700 1 --2- 172.21.15.8:0/1297256544 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6b201014a0 0x7f6b20197420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:33.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:33.165+0000 7f6b253ff700 1 --2- 172.21.15.8:0/1297256544 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6b20102690 0x7f6b20197960 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:33.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:33.165+0000 7f6b253ff700 1 -- 172.21.15.8:0/1297256544 >> 172.21.15.8:0/1297256544 conn(0x7f6b200fca10 msgr2=0x7f6b20105b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:33.169 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:33.165+0000 7f6b253ff700 1 -- 172.21.15.8:0/1297256544 shutdown_connections 2023-12-17T12:02:33.170 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:33.165+0000 7f6b253ff700 1 -- 172.21.15.8:0/1297256544 wait complete. 2023-12-17T12:02:33.170 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 8 2023-12-17T12:02:33.245 INFO:journalctl@ceph.mds.h.smithi100.stdout:Dec 17 12:02:33 smithi100 systemd[1]: Starting Ceph mds.h for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:02:33.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:33 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/1297256544' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:33.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:33 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/1297256544' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:33.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:33 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/1297256544' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:34.166 INFO:journalctl@ceph.mds.h.smithi100.stdout:Dec 17 12:02:33 smithi100 bash[76059]: e25781acc9a77284e3ee6c5e81ab2b0b77b60cb55baa6514d6974ee7e92776a5 2023-12-17T12:02:34.166 INFO:journalctl@ceph.mds.h.smithi100.stdout:Dec 17 12:02:33 smithi100 systemd[1]: Started Ceph mds.h for f43f508a-9cd2-11ee-95a5-87774f69a715. 2023-12-17T12:02:34.166 INFO:journalctl@ceph.mds.h.smithi100.stdout:Dec 17 12:02:33 smithi100 ceph-mds[76097]: -- 172.21.15.100:0/160014177 <== mon.2 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5573ab2f1520 con 0x5573ab2c8c00 2023-12-17T12:02:34.166 INFO:journalctl@ceph.mds.h.smithi100.stdout:Dec 17 12:02:33 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-h[76074]: starting mds.h at 2023-12-17T12:02:34.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:34 smithi100 ceph-mon[41266]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:34.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:34 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:34.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:34 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:34.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:34 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:34.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:34 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:02:34.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:34 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T12:02:34.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:34 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:34.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:34 smithi186 ceph-mon[41182]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:34.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:34 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:34.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:34 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:34.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:34 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:34.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:34 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:02:34.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:34 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T12:02:34.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:34 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:34.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:34 smithi008 ceph-mon[36830]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:34.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:34 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:34.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:34 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:34.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:34 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:34.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:34 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:02:34.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:34 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T12:02:34.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:34 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:35.188 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-17T12:02:35.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.400+0000 7f9f1c9ff700 1 -- 172.21.15.8:0/1091661481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f18102690 msgr2=0x7f9f18102af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:35.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.400+0000 7f9f1c9ff700 1 --2- 172.21.15.8:0/1091661481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f18102690 0x7f9f18102af0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9f000099c0 tx=0x7f9f00009cd0 comp rx=0 tx=0).stop 2023-12-17T12:02:35.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.400+0000 7f9f1c9ff700 1 -- 172.21.15.8:0/1091661481 shutdown_connections 2023-12-17T12:02:35.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.400+0000 7f9f1c9ff700 1 --2- 172.21.15.8:0/1091661481 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f18103030 0x7f9f181098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:35.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.400+0000 7f9f1c9ff700 1 --2- 172.21.15.8:0/1091661481 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f181014a0 0x7f9f181018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:35.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.400+0000 7f9f1c9ff700 1 --2- 172.21.15.8:0/1091661481 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f18102690 0x7f9f18102af0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:35.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.400+0000 7f9f1c9ff700 1 -- 172.21.15.8:0/1091661481 >> 172.21.15.8:0/1091661481 conn(0x7f9f180fca10 msgr2=0x7f9f180fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:35.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.400+0000 7f9f1c9ff700 1 -- 172.21.15.8:0/1091661481 shutdown_connections 2023-12-17T12:02:35.404 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.401+0000 7f9f1c9ff700 1 -- 172.21.15.8:0/1091661481 wait complete. 2023-12-17T12:02:35.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.402+0000 7f9f1c9ff700 1 Processor -- start 2023-12-17T12:02:35.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.402+0000 7f9f1c9ff700 1 -- start start 2023-12-17T12:02:35.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.403+0000 7f9f1c9ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f181014a0 0x7f9f18199560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:35.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.403+0000 7f9f1c9ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f18102690 0x7f9f18199aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:35.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.403+0000 7f9f1c9ff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f18103030 0x7f9f181a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:35.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.403+0000 7f9f1c9ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f181a1090 con 0x7f9f18102690 2023-12-17T12:02:35.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.403+0000 7f9f1c9ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f181a11d0 con 0x7f9f181014a0 2023-12-17T12:02:35.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.403+0000 7f9f1c9ff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f181a1360 con 0x7f9f18103030 2023-12-17T12:02:35.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.403+0000 7f9f0ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f18102690 0x7f9f18199aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:35.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.403+0000 7f9f1659c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f181014a0 0x7f9f18199560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:35.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.403+0000 7f9f0ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f18102690 0x7f9f18199aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33948/0 (socket says 172.21.15.8:33948) 2023-12-17T12:02:35.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.403+0000 7f9f0ffff700 1 -- 172.21.15.8:0/2841779770 learned_addr learned my addr 172.21.15.8:0/2841779770 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:02:35.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.403+0000 7f9f16d9d700 1 --2- 172.21.15.8:0/2841779770 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f18103030 0x7f9f181a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:35.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.403+0000 7f9f0ffff700 1 -- 172.21.15.8:0/2841779770 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f18103030 msgr2=0x7f9f181a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:35.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.403+0000 7f9f0ffff700 1 --2- 172.21.15.8:0/2841779770 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f18103030 0x7f9f181a0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:35.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.403+0000 7f9f0ffff700 1 -- 172.21.15.8:0/2841779770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f181014a0 msgr2=0x7f9f18199560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:35.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.403+0000 7f9f0ffff700 1 --2- 172.21.15.8:0/2841779770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f181014a0 0x7f9f18199560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:35.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.403+0000 7f9f0ffff700 1 -- 172.21.15.8:0/2841779770 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f000095f0 con 0x7f9f18102690 2023-12-17T12:02:35.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.404+0000 7f9f0ffff700 1 --2- 172.21.15.8:0/2841779770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f18102690 0x7f9f18199aa0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9f00009fd0 tx=0x7f9f0000fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:35.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.404+0000 7f9f0f7fe700 1 -- 172.21.15.8:0/2841779770 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f0001d070 con 0x7f9f18102690 2023-12-17T12:02:35.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.404+0000 7f9f0f7fe700 1 -- 172.21.15.8:0/2841779770 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9f0000bd10 con 0x7f9f18102690 2023-12-17T12:02:35.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.405+0000 7f9f1c9ff700 1 -- 172.21.15.8:0/2841779770 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f181a15e0 con 0x7f9f18102690 2023-12-17T12:02:35.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.405+0000 7f9f0f7fe700 1 -- 172.21.15.8:0/2841779770 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f00004ae0 con 0x7f9f18102690 2023-12-17T12:02:35.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.405+0000 7f9f1c9ff700 1 -- 172.21.15.8:0/2841779770 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f181a1a60 con 0x7f9f18102690 2023-12-17T12:02:35.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.406+0000 7f9f1c9ff700 1 -- 172.21.15.8:0/2841779770 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f18068230 con 0x7f9f18102690 2023-12-17T12:02:35.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.408+0000 7f9f0f7fe700 1 -- 172.21.15.8:0/2841779770 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7f9f00004c40 con 0x7f9f18102690 2023-12-17T12:02:35.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.410+0000 7f9f0f7fe700 1 --2- 172.21.15.8:0/2841779770 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f9f040a1500 0x7f9f040a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:35.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.410+0000 7f9f0f7fe700 1 -- 172.21.15.8:0/2841779770 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f9f000cd5e0 con 0x7f9f18102690 2023-12-17T12:02:35.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.410+0000 7f9f1659c700 1 --2- 172.21.15.8:0/2841779770 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f9f040a1500 0x7f9f040a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:35.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.411+0000 7f9f1659c700 1 --2- 172.21.15.8:0/2841779770 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f9f040a1500 0x7f9f040a39c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9f181024f0 tx=0x7f9f08007400 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:35.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.414+0000 7f9f0f7fe700 1 -- 172.21.15.8:0/2841779770 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f9f000970d0 con 0x7f9f18102690 2023-12-17T12:02:35.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:35 smithi186 ceph-mon[41182]: Deploying daemon mds.i on smithi186 2023-12-17T12:02:35.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:35 smithi186 ceph-mon[41182]: mds.? [v2:172.21.15.100:6836/4176831844,v1:172.21.15.100:6837/4176831844] up:boot 2023-12-17T12:02:35.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:35 smithi186 ceph-mon[41182]: fsmap 8 up:standby 2023-12-17T12:02:35.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:35 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-12-17T12:02:35.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:35 smithi100 ceph-mon[41266]: Deploying daemon mds.i on smithi186 2023-12-17T12:02:35.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:35 smithi100 ceph-mon[41266]: mds.? [v2:172.21.15.100:6836/4176831844,v1:172.21.15.100:6837/4176831844] up:boot 2023-12-17T12:02:35.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:35 smithi100 ceph-mon[41266]: fsmap 8 up:standby 2023-12-17T12:02:35.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:35 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-12-17T12:02:35.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.676+0000 7f9f1c9ff700 1 -- 172.21.15.8:0/2841779770 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f1810cd90 con 0x7f9f18102690 2023-12-17T12:02:35.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.677+0000 7f9f0f7fe700 1 -- 172.21.15.8:0/2841779770 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6865 (secure 0 0 0) 0x7f9f0009a6f0 con 0x7f9f18102690 2023-12-17T12:02:35.680 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:02:35.680 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2669069079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2669069079},{"type":"v1","addr":"172.21.15.8:6835","nonce":2669069079}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/4241050553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":4241050553},{"type":"v1","addr":"172.21.15.8:6837","nonce":4241050553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14640,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/2765387309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2765387309},{"type":"v1","addr":"172.21.15.186:6835","nonce":2765387309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/582753561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":582753561},{"type":"v1","addr":"172.21.15.186:6833","nonce":582753561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/305815776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":305815776},{"type":"v1","addr":"172.21.15.100:6833","nonce":305815776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24503,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2140351853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2140351853},{"type":"v1","addr":"172.21.15.100:6835","nonce":2140351853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24520,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/822451724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":822451724},{"type":"v1","addr":"172.21.15.186:6837","nonce":822451724}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24530,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/4176831844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":4176831844},{"type":"v1","addr":"172.21.15.100:6837","nonce":4176831844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9}],"filesystems":[]} 2023-12-17T12:02:35.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.679+0000 7f9f1c9ff700 1 -- 172.21.15.8:0/2841779770 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f9f040a1500 msgr2=0x7f9f040a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:35.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.679+0000 7f9f1c9ff700 1 --2- 172.21.15.8:0/2841779770 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f9f040a1500 0x7f9f040a39c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9f181024f0 tx=0x7f9f08007400 comp rx=0 tx=0).stop 2023-12-17T12:02:35.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.679+0000 7f9f1c9ff700 1 -- 172.21.15.8:0/2841779770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f18102690 msgr2=0x7f9f18199aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:35.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.679+0000 7f9f1c9ff700 1 --2- 172.21.15.8:0/2841779770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f18102690 0x7f9f18199aa0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9f00009fd0 tx=0x7f9f0000fa00 comp rx=0 tx=0).stop 2023-12-17T12:02:35.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.679+0000 7f9f1c9ff700 1 -- 172.21.15.8:0/2841779770 shutdown_connections 2023-12-17T12:02:35.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.679+0000 7f9f1c9ff700 1 --2- 172.21.15.8:0/2841779770 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f9f040a1500 0x7f9f040a39c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:35.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.679+0000 7f9f1c9ff700 1 --2- 172.21.15.8:0/2841779770 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9f18103030 0x7f9f181a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:35.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.679+0000 7f9f1c9ff700 1 --2- 172.21.15.8:0/2841779770 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9f181014a0 0x7f9f18199560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:35.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.679+0000 7f9f1c9ff700 1 --2- 172.21.15.8:0/2841779770 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9f18102690 0x7f9f18199aa0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:35.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.679+0000 7f9f1c9ff700 1 -- 172.21.15.8:0/2841779770 >> 172.21.15.8:0/2841779770 conn(0x7f9f180fca10 msgr2=0x7f9f18073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:35.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.679+0000 7f9f1c9ff700 1 -- 172.21.15.8:0/2841779770 shutdown_connections 2023-12-17T12:02:35.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:35.679+0000 7f9f1c9ff700 1 -- 172.21.15.8:0/2841779770 wait complete. 2023-12-17T12:02:35.683 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 9 2023-12-17T12:02:35.698 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:35 smithi008 ceph-mon[36830]: Deploying daemon mds.i on smithi186 2023-12-17T12:02:35.698 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:35 smithi008 ceph-mon[36830]: mds.? [v2:172.21.15.100:6836/4176831844,v1:172.21.15.100:6837/4176831844] up:boot 2023-12-17T12:02:35.698 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:35 smithi008 ceph-mon[36830]: fsmap 8 up:standby 2023-12-17T12:02:35.699 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:35 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-12-17T12:02:35.832 INFO:journalctl@ceph.mds.i.smithi186.stdout:Dec 17 12:02:35 smithi186 systemd[1]: Starting Ceph mds.i for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:02:36.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:36 smithi100 ceph-mon[41266]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:36.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:36 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/2841779770' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:36.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:36 smithi186 ceph-mon[41182]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:36.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:36 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/2841779770' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:36.726 INFO:journalctl@ceph.mds.i.smithi186.stdout:Dec 17 12:02:36 smithi186 ceph-mds[77701]: -- 172.21.15.186:0/2560774761 <== mon.1 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e843269520 con 0x55e843240c00 2023-12-17T12:02:36.726 INFO:journalctl@ceph.mds.i.smithi186.stdout:Dec 17 12:02:36 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-i[77678]: starting mds.i at 2023-12-17T12:02:36.726 INFO:journalctl@ceph.mds.i.smithi186.stdout:Dec 17 12:02:36 smithi186 bash[77663]: cfa1f1028193d4b09bab4dcc38e614a0a12022f2b889c3fd8e5544235b383f64 2023-12-17T12:02:36.726 INFO:journalctl@ceph.mds.i.smithi186.stdout:Dec 17 12:02:36 smithi186 systemd[1]: Started Ceph mds.i for f43f508a-9cd2-11ee-95a5-87774f69a715. 2023-12-17T12:02:36.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:36 smithi008 ceph-mon[36830]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:36.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:36 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/2841779770' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:37.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:37 smithi100 ceph-mon[41266]: mds.? [v2:172.21.15.186:6838/91602342,v1:172.21.15.186:6839/91602342] up:boot 2023-12-17T12:02:37.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:37 smithi100 ceph-mon[41266]: fsmap 9 up:standby 2023-12-17T12:02:37.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:37 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-12-17T12:02:37.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:37 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:37.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:37 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:37.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:37 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:37.667 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:37 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:02:37.667 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:37 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T12:02:37.667 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:37 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:37.667 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:37 smithi100 ceph-mon[41266]: Deploying daemon mds.g on smithi008 2023-12-17T12:02:37.701 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-17T12:02:37.710 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:37 smithi008 ceph-mon[36830]: mds.? [v2:172.21.15.186:6838/91602342,v1:172.21.15.186:6839/91602342] up:boot 2023-12-17T12:02:37.710 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:37 smithi008 ceph-mon[36830]: fsmap 9 up:standby 2023-12-17T12:02:37.710 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:37 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-12-17T12:02:37.710 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:37 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:37.710 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:37 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:37.711 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:37 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:37.711 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:37 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:02:37.711 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:37 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T12:02:37.711 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:37 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:37.711 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:37 smithi008 ceph-mon[36830]: Deploying daemon mds.g on smithi008 2023-12-17T12:02:37.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:37 smithi186 ceph-mon[41182]: mds.? [v2:172.21.15.186:6838/91602342,v1:172.21.15.186:6839/91602342] up:boot 2023-12-17T12:02:37.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:37 smithi186 ceph-mon[41182]: fsmap 9 up:standby 2023-12-17T12:02:37.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:37 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-12-17T12:02:37.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:37 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:37.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:37 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:37.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:37 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:37.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:37 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:02:37.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:37 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T12:02:37.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:37 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:37.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:37 smithi186 ceph-mon[41182]: Deploying daemon mds.g on smithi008 2023-12-17T12:02:37.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.930+0000 7f64db3ff700 1 -- 172.21.15.8:0/3884328296 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64d41014a0 msgr2=0x7f64d41018c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:37.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.930+0000 7f64db3ff700 1 --2- 172.21.15.8:0/3884328296 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64d41014a0 0x7f64d41018c0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f64d00099c0 tx=0x7f64d0009cd0 comp rx=0 tx=0).stop 2023-12-17T12:02:37.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.930+0000 7f64db3ff700 1 -- 172.21.15.8:0/3884328296 shutdown_connections 2023-12-17T12:02:37.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.930+0000 7f64db3ff700 1 --2- 172.21.15.8:0/3884328296 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64d4103030 0x7f64d41098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:37.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.930+0000 7f64db3ff700 1 --2- 172.21.15.8:0/3884328296 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64d41014a0 0x7f64d41018c0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:37.933 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.930+0000 7f64db3ff700 1 --2- 172.21.15.8:0/3884328296 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64d4102690 0x7f64d4102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:37.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.930+0000 7f64db3ff700 1 -- 172.21.15.8:0/3884328296 >> 172.21.15.8:0/3884328296 conn(0x7f64d40fca10 msgr2=0x7f64d40fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:37.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.930+0000 7f64db3ff700 1 -- 172.21.15.8:0/3884328296 shutdown_connections 2023-12-17T12:02:37.934 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.930+0000 7f64db3ff700 1 -- 172.21.15.8:0/3884328296 wait complete. 2023-12-17T12:02:37.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.931+0000 7f64db3ff700 1 Processor -- start 2023-12-17T12:02:37.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.931+0000 7f64db3ff700 1 -- start start 2023-12-17T12:02:37.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.932+0000 7f64db3ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64d41014a0 0x7f64d41973a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:37.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.932+0000 7f64db3ff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64d4102690 0x7f64d41978e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:37.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.932+0000 7f64db3ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64d4103030 0x7f64d419e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:37.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.932+0000 7f64db3ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d419eed0 con 0x7f64d41014a0 2023-12-17T12:02:37.936 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.932+0000 7f64db3ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d419f010 con 0x7f64d4103030 2023-12-17T12:02:37.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.932+0000 7f64db3ff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d419f1a0 con 0x7f64d4102690 2023-12-17T12:02:37.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.932+0000 7f64d919b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64d41014a0 0x7f64d41973a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:37.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.932+0000 7f64d919b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64d41014a0 0x7f64d41973a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33964/0 (socket says 172.21.15.8:33964) 2023-12-17T12:02:37.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.932+0000 7f64d919b700 1 -- 172.21.15.8:0/641465939 learned_addr learned my addr 172.21.15.8:0/641465939 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:02:37.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.932+0000 7f64d999c700 1 --2- 172.21.15.8:0/641465939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64d4103030 0x7f64d419e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:37.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.932+0000 7f64d899a700 1 --2- 172.21.15.8:0/641465939 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64d4102690 0x7f64d41978e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:37.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.932+0000 7f64d919b700 1 -- 172.21.15.8:0/641465939 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64d4102690 msgr2=0x7f64d41978e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:37.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.932+0000 7f64d919b700 1 --2- 172.21.15.8:0/641465939 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64d4102690 0x7f64d41978e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:37.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.933+0000 7f64d919b700 1 -- 172.21.15.8:0/641465939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64d4103030 msgr2=0x7f64d419e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:37.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.933+0000 7f64d919b700 1 --2- 172.21.15.8:0/641465939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64d4103030 0x7f64d419e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:37.937 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.933+0000 7f64d919b700 1 -- 172.21.15.8:0/641465939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d00095f0 con 0x7f64d41014a0 2023-12-17T12:02:37.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.933+0000 7f64d919b700 1 --2- 172.21.15.8:0/641465939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64d41014a0 0x7f64d41973a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f64d0009fd0 tx=0x7f64d000fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:37.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.933+0000 7f64ca7fc700 1 -- 172.21.15.8:0/641465939 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d001d070 con 0x7f64d41014a0 2023-12-17T12:02:37.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.933+0000 7f64ca7fc700 1 -- 172.21.15.8:0/641465939 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f64d000bd10 con 0x7f64d41014a0 2023-12-17T12:02:37.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.933+0000 7f64ca7fc700 1 -- 172.21.15.8:0/641465939 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d0004b30 con 0x7f64d41014a0 2023-12-17T12:02:37.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.933+0000 7f64db3ff700 1 -- 172.21.15.8:0/641465939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64d419f420 con 0x7f64d41014a0 2023-12-17T12:02:37.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.933+0000 7f64db3ff700 1 -- 172.21.15.8:0/641465939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64d419f7f0 con 0x7f64d41014a0 2023-12-17T12:02:37.938 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.935+0000 7f64db3ff700 1 -- 172.21.15.8:0/641465939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64d4108960 con 0x7f64d41014a0 2023-12-17T12:02:37.939 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.936+0000 7f64ca7fc700 1 -- 172.21.15.8:0/641465939 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7f64d0004c90 con 0x7f64d41014a0 2023-12-17T12:02:37.940 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.938+0000 7f64ca7fc700 1 --2- 172.21.15.8:0/641465939 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f64c00a1500 0x7f64c00a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:37.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.938+0000 7f64ca7fc700 1 -- 172.21.15.8:0/641465939 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f64d00cd5e0 con 0x7f64d41014a0 2023-12-17T12:02:37.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.938+0000 7f64d899a700 1 --2- 172.21.15.8:0/641465939 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f64c00a1500 0x7f64c00a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:37.941 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.939+0000 7f64d899a700 1 --2- 172.21.15.8:0/641465939 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f64c00a1500 0x7f64c00a39c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f64c4009c60 tx=0x7f64c4009260 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:37.944 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:37.942+0000 7f64ca7fc700 1 -- 172.21.15.8:0/641465939 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f64d00970d0 con 0x7f64d41014a0 2023-12-17T12:02:38.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:38.225+0000 7f64db3ff700 1 -- 172.21.15.8:0/641465939 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64d4068230 con 0x7f64d41014a0 2023-12-17T12:02:38.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:38.225+0000 7f64ca7fc700 1 -- 172.21.15.8:0/641465939 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7655 (secure 0 0 0) 0x7f64d009a6f0 con 0x7f64d41014a0 2023-12-17T12:02:38.228 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:02:38.229 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2669069079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2669069079},{"type":"v1","addr":"172.21.15.8:6835","nonce":2669069079}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/4241050553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":4241050553},{"type":"v1","addr":"172.21.15.8:6837","nonce":4241050553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14640,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/2765387309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2765387309},{"type":"v1","addr":"172.21.15.186:6835","nonce":2765387309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/582753561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":582753561},{"type":"v1","addr":"172.21.15.186:6833","nonce":582753561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/305815776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":305815776},{"type":"v1","addr":"172.21.15.100:6833","nonce":305815776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24503,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2140351853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2140351853},{"type":"v1","addr":"172.21.15.100:6835","nonce":2140351853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24520,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/822451724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":822451724},{"type":"v1","addr":"172.21.15.186:6837","nonce":822451724}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24530,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/4176831844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":4176831844},{"type":"v1","addr":"172.21.15.100:6837","nonce":4176831844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24541,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6839/91602342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":91602342},{"type":"v1","addr":"172.21.15.186:6839","nonce":91602342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-12-17T12:02:38.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:38.228+0000 7f64db3ff700 1 -- 172.21.15.8:0/641465939 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f64c00a1500 msgr2=0x7f64c00a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:38.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:38.228+0000 7f64db3ff700 1 --2- 172.21.15.8:0/641465939 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f64c00a1500 0x7f64c00a39c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f64c4009c60 tx=0x7f64c4009260 comp rx=0 tx=0).stop 2023-12-17T12:02:38.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:38.228+0000 7f64db3ff700 1 -- 172.21.15.8:0/641465939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64d41014a0 msgr2=0x7f64d41973a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:38.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:38.228+0000 7f64db3ff700 1 --2- 172.21.15.8:0/641465939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64d41014a0 0x7f64d41973a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f64d0009fd0 tx=0x7f64d000fa00 comp rx=0 tx=0).stop 2023-12-17T12:02:38.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:38.228+0000 7f64db3ff700 1 -- 172.21.15.8:0/641465939 shutdown_connections 2023-12-17T12:02:38.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:38.228+0000 7f64db3ff700 1 --2- 172.21.15.8:0/641465939 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f64c00a1500 0x7f64c00a39c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:38.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:38.228+0000 7f64db3ff700 1 --2- 172.21.15.8:0/641465939 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64d4103030 0x7f64d419e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:38.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:38.228+0000 7f64db3ff700 1 --2- 172.21.15.8:0/641465939 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f64d41014a0 0x7f64d41973a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:38.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:38.228+0000 7f64db3ff700 1 --2- 172.21.15.8:0/641465939 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f64d4102690 0x7f64d41978e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:38.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:38.228+0000 7f64db3ff700 1 -- 172.21.15.8:0/641465939 >> 172.21.15.8:0/641465939 conn(0x7f64d40fca10 msgr2=0x7f64d4105aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:38.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:38.228+0000 7f64db3ff700 1 -- 172.21.15.8:0/641465939 shutdown_connections 2023-12-17T12:02:38.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:38.228+0000 7f64db3ff700 1 -- 172.21.15.8:0/641465939 wait complete. 2023-12-17T12:02:38.232 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 10 2023-12-17T12:02:38.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:38 smithi186 ceph-mon[41182]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:38.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:38 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/641465939' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:38.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:38 smithi008 ceph-mon[36830]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:38.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:38 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/641465939' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:38.746 INFO:journalctl@ceph.mds.g.smithi008.stdout:Dec 17 12:02:38 smithi008 systemd[1]: Starting Ceph mds.g for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:02:38.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:38 smithi100 ceph-mon[41266]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:38.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:38 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/641465939' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:39.246 INFO:journalctl@ceph.mds.g.smithi008.stdout:Dec 17 12:02:38 smithi008 bash[87812]: 505787166cde18d787bd494bbf91e44d6d89f80a8b4a390af39b038a48b663e8 2023-12-17T12:02:39.246 INFO:journalctl@ceph.mds.g.smithi008.stdout:Dec 17 12:02:38 smithi008 systemd[1]: Started Ceph mds.g for f43f508a-9cd2-11ee-95a5-87774f69a715. 2023-12-17T12:02:39.246 INFO:journalctl@ceph.mds.g.smithi008.stdout:Dec 17 12:02:38 smithi008 ceph-mds[87850]: -- 172.21.15.8:0/3129759341 <== mon.0 v2:172.21.15.8:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55711c8a7520 con 0x55711c87e800 2023-12-17T12:02:39.246 INFO:journalctl@ceph.mds.g.smithi008.stdout:Dec 17 12:02:38 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-g[87827]: starting mds.g at 2023-12-17T12:02:40.199 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:40 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:40.199 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:40 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:40.199 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:40 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:40.199 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:40 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:02:40.199 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:40 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T12:02:40.199 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:40 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:40.199 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:40 smithi008 ceph-mon[36830]: Deploying daemon mds.a on smithi008 2023-12-17T12:02:40.199 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:40 smithi008 ceph-mon[36830]: mds.? [v2:172.21.15.8:6838/487046247,v1:172.21.15.8:6839/487046247] up:boot 2023-12-17T12:02:40.200 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:40 smithi008 ceph-mon[36830]: fsmap 10 up:standby 2023-12-17T12:02:40.200 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:40 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-12-17T12:02:40.200 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:40 smithi008 ceph-mon[36830]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:40.252 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-17T12:02:40.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:40 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:40.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:40 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:40.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:40 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:40.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:40 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:02:40.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:40 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T12:02:40.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:40 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:40.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:40 smithi100 ceph-mon[41266]: Deploying daemon mds.a on smithi008 2023-12-17T12:02:40.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:40 smithi100 ceph-mon[41266]: mds.? [v2:172.21.15.8:6838/487046247,v1:172.21.15.8:6839/487046247] up:boot 2023-12-17T12:02:40.417 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:40 smithi100 ceph-mon[41266]: fsmap 10 up:standby 2023-12-17T12:02:40.417 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:40 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-12-17T12:02:40.417 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:40 smithi100 ceph-mon[41266]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:40.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.463+0000 7f2875bff700 1 -- 172.21.15.8:0/2582582887 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2870103030 msgr2=0x7f28701098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:40.466 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.463+0000 7f2875bff700 1 --2- 172.21.15.8:0/2582582887 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2870103030 0x7f28701098e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f286800b0d0 tx=0x7f286800b3e0 comp rx=0 tx=0).stop 2023-12-17T12:02:40.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.463+0000 7f2875bff700 1 -- 172.21.15.8:0/2582582887 shutdown_connections 2023-12-17T12:02:40.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.463+0000 7f2875bff700 1 --2- 172.21.15.8:0/2582582887 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2870103030 0x7f28701098e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:40.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.463+0000 7f2875bff700 1 --2- 172.21.15.8:0/2582582887 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f28701014a0 0x7f28701018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:40.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.463+0000 7f2875bff700 1 --2- 172.21.15.8:0/2582582887 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2870102690 0x7f2870102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:40.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.463+0000 7f2875bff700 1 -- 172.21.15.8:0/2582582887 >> 172.21.15.8:0/2582582887 conn(0x7f28700fca10 msgr2=0x7f28700fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:40.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.463+0000 7f2875bff700 1 -- 172.21.15.8:0/2582582887 shutdown_connections 2023-12-17T12:02:40.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.463+0000 7f2875bff700 1 -- 172.21.15.8:0/2582582887 wait complete. 2023-12-17T12:02:40.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.465+0000 7f2875bff700 1 Processor -- start 2023-12-17T12:02:40.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.465+0000 7f2875bff700 1 -- start start 2023-12-17T12:02:40.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.465+0000 7f2875bff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28701014a0 0x7f2870107180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:40.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.465+0000 7f2875bff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2870102690 0x7f28701076c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:40.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.465+0000 7f2875bff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2870103030 0x7f2870103d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:40.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.465+0000 7f2875bff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28701044b0 con 0x7f28701014a0 2023-12-17T12:02:40.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.465+0000 7f2875bff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2870104620 con 0x7f2870103030 2023-12-17T12:02:40.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.465+0000 7f2875bff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28701047e0 con 0x7f2870102690 2023-12-17T12:02:40.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.465+0000 7f286f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28701014a0 0x7f2870107180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:40.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.465+0000 7f286f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28701014a0 0x7f2870107180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34016/0 (socket says 172.21.15.8:34016) 2023-12-17T12:02:40.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.465+0000 7f286f7fe700 1 -- 172.21.15.8:0/2443357146 learned_addr learned my addr 172.21.15.8:0/2443357146 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:02:40.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.466+0000 7f286effd700 1 --2- 172.21.15.8:0/2443357146 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2870102690 0x7f28701076c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:40.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.466+0000 7f286f7fe700 1 -- 172.21.15.8:0/2443357146 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2870102690 msgr2=0x7f28701076c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:40.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.466+0000 7f286f7fe700 1 --2- 172.21.15.8:0/2443357146 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2870102690 0x7f28701076c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:40.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.466+0000 7f286f7fe700 1 -- 172.21.15.8:0/2443357146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2870103030 msgr2=0x7f2870103d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:40.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.466+0000 7f286f7fe700 1 --2- 172.21.15.8:0/2443357146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2870103030 0x7f2870103d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:40.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.466+0000 7f286f7fe700 1 -- 172.21.15.8:0/2443357146 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2868009d00 con 0x7f28701014a0 2023-12-17T12:02:40.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.466+0000 7f286f7fe700 1 --2- 172.21.15.8:0/2443357146 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28701014a0 0x7f2870107180 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f286000e970 tx=0x7f286000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:40.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.466+0000 7f286cff9700 1 -- 172.21.15.8:0/2443357146 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2860009790 con 0x7f28701014a0 2023-12-17T12:02:40.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.466+0000 7f286cff9700 1 -- 172.21.15.8:0/2443357146 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f28600044b0 con 0x7f28701014a0 2023-12-17T12:02:40.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.466+0000 7f286cff9700 1 -- 172.21.15.8:0/2443357146 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2860003dd0 con 0x7f28701014a0 2023-12-17T12:02:40.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.466+0000 7f2875bff700 1 -- 172.21.15.8:0/2443357146 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28701a5b50 con 0x7f28701014a0 2023-12-17T12:02:40.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.466+0000 7f2875bff700 1 -- 172.21.15.8:0/2443357146 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28701a6060 con 0x7f28701014a0 2023-12-17T12:02:40.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.467+0000 7f2875bff700 1 -- 172.21.15.8:0/2443357146 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2870068230 con 0x7f28701014a0 2023-12-17T12:02:40.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.469+0000 7f286cff9700 1 -- 172.21.15.8:0/2443357146 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7f2860003f30 con 0x7f28701014a0 2023-12-17T12:02:40.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.470+0000 7f286cff9700 1 --2- 172.21.15.8:0/2443357146 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f28580a1500 0x7f28580a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:40.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.471+0000 7f286cff9700 1 -- 172.21.15.8:0/2443357146 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f2860014070 con 0x7f28701014a0 2023-12-17T12:02:40.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.471+0000 7f286effd700 1 --2- 172.21.15.8:0/2443357146 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f28580a1500 0x7f28580a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:40.474 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.471+0000 7f286effd700 1 --2- 172.21.15.8:0/2443357146 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f28580a1500 0x7f28580a39c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2864005fd0 tx=0x7f2864005f60 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:40.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:40 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:40.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:40 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:40.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:40 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:40.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:40 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:02:40.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:40 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T12:02:40.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:40 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:40.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:40 smithi186 ceph-mon[41182]: Deploying daemon mds.a on smithi008 2023-12-17T12:02:40.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:40 smithi186 ceph-mon[41182]: mds.? [v2:172.21.15.8:6838/487046247,v1:172.21.15.8:6839/487046247] up:boot 2023-12-17T12:02:40.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:40 smithi186 ceph-mon[41182]: fsmap 10 up:standby 2023-12-17T12:02:40.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:40 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-12-17T12:02:40.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:40 smithi186 ceph-mon[41182]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:40.477 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.474+0000 7f286cff9700 1 -- 172.21.15.8:0/2443357146 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f28600965d0 con 0x7f28701014a0 2023-12-17T12:02:40.757 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.755+0000 7f2875bff700 1 -- 172.21.15.8:0/2443357146 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28701a6250 con 0x7f28701014a0 2023-12-17T12:02:40.758 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.756+0000 7f286cff9700 1 -- 172.21.15.8:0/2443357146 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8441 (secure 0 0 0) 0x7f2860099bf0 con 0x7f28701014a0 2023-12-17T12:02:40.759 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:02:40.759 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2669069079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2669069079},{"type":"v1","addr":"172.21.15.8:6835","nonce":2669069079}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/4241050553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":4241050553},{"type":"v1","addr":"172.21.15.8:6837","nonce":4241050553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14640,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/2765387309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2765387309},{"type":"v1","addr":"172.21.15.186:6835","nonce":2765387309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/487046247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":487046247},{"type":"v1","addr":"172.21.15.8:6839","nonce":487046247}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/582753561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":582753561},{"type":"v1","addr":"172.21.15.186:6833","nonce":582753561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/305815776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":305815776},{"type":"v1","addr":"172.21.15.100:6833","nonce":305815776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24503,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2140351853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2140351853},{"type":"v1","addr":"172.21.15.100:6835","nonce":2140351853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24520,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/822451724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":822451724},{"type":"v1","addr":"172.21.15.186:6837","nonce":822451724}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24530,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/4176831844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":4176831844},{"type":"v1","addr":"172.21.15.100:6837","nonce":4176831844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24541,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6839/91602342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":91602342},{"type":"v1","addr":"172.21.15.186:6839","nonce":91602342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-12-17T12:02:40.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.758+0000 7f2875bff700 1 -- 172.21.15.8:0/2443357146 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f28580a1500 msgr2=0x7f28580a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:40.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.758+0000 7f2875bff700 1 --2- 172.21.15.8:0/2443357146 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f28580a1500 0x7f28580a39c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2864005fd0 tx=0x7f2864005f60 comp rx=0 tx=0).stop 2023-12-17T12:02:40.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.758+0000 7f2875bff700 1 -- 172.21.15.8:0/2443357146 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28701014a0 msgr2=0x7f2870107180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:40.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.758+0000 7f2875bff700 1 --2- 172.21.15.8:0/2443357146 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28701014a0 0x7f2870107180 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f286000e970 tx=0x7f286000ed30 comp rx=0 tx=0).stop 2023-12-17T12:02:40.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.759+0000 7f2875bff700 1 -- 172.21.15.8:0/2443357146 shutdown_connections 2023-12-17T12:02:40.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.759+0000 7f2875bff700 1 --2- 172.21.15.8:0/2443357146 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f28580a1500 0x7f28580a39c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:40.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.759+0000 7f2875bff700 1 --2- 172.21.15.8:0/2443357146 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2870103030 0x7f2870103d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:40.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.759+0000 7f2875bff700 1 --2- 172.21.15.8:0/2443357146 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f28701014a0 0x7f2870107180 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:40.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.759+0000 7f2875bff700 1 --2- 172.21.15.8:0/2443357146 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2870102690 0x7f28701076c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:40.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.759+0000 7f2875bff700 1 -- 172.21.15.8:0/2443357146 >> 172.21.15.8:0/2443357146 conn(0x7f28700fca10 msgr2=0x7f2870073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:40.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.759+0000 7f2875bff700 1 -- 172.21.15.8:0/2443357146 shutdown_connections 2023-12-17T12:02:40.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:40.759+0000 7f2875bff700 1 -- 172.21.15.8:0/2443357146 wait complete. 2023-12-17T12:02:40.763 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 11 2023-12-17T12:02:41.423 INFO:journalctl@ceph.mds.a.smithi008.stdout:Dec 17 12:02:41 smithi008 systemd[1]: Starting Ceph mds.a for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:02:41.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:41 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/2443357146' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:41.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:41 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/2443357146' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:41.746 INFO:journalctl@ceph.mds.a.smithi008.stdout:Dec 17 12:02:41 smithi008 bash[88195]: 8f814409367b022e2377e84cd8e0b36f55d6e2a05828ee09ad2082cc3e2000d4 2023-12-17T12:02:41.746 INFO:journalctl@ceph.mds.a.smithi008.stdout:Dec 17 12:02:41 smithi008 systemd[1]: Started Ceph mds.a for f43f508a-9cd2-11ee-95a5-87774f69a715. 2023-12-17T12:02:41.746 INFO:journalctl@ceph.mds.a.smithi008.stdout:Dec 17 12:02:41 smithi008 ceph-mds[88233]: -- 172.21.15.8:0/2963656921 <== mon.0 v2:172.21.15.8:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5584bc537520 con 0x5584bc50e800 2023-12-17T12:02:41.746 INFO:journalctl@ceph.mds.a.smithi008.stdout:Dec 17 12:02:41 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-a[88210]: starting mds.a at 2023-12-17T12:02:41.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:41 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/2443357146' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:42.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:42 smithi100 ceph-mon[41266]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:42.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:42 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:42.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:42 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:42.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:42 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:42.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:42 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:02:42.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:42 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T12:02:42.666 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:42 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:42.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:42 smithi186 ceph-mon[41182]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:42.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:42 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:42.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:42 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:42.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:42 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:42.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:42 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:02:42.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:42 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T12:02:42.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:42 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:42.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:42 smithi008 ceph-mon[36830]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:42.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:42 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:42.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:42 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:42.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:42 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:42.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:42 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-12-17T12:02:42.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:42 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-12-17T12:02:42.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:42 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:42.782 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-17T12:02:43.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:42.998+0000 7fd816dff700 1 -- 172.21.15.8:0/2365157854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd810073fd0 msgr2=0x7fd810074450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:43.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:42.998+0000 7fd816dff700 1 --2- 172.21.15.8:0/2365157854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd810073fd0 0x7fd810074450 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc009990 tx=0x7fd7fc009ca0 comp rx=0 tx=0).stop 2023-12-17T12:02:43.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:42.998+0000 7fd816dff700 1 -- 172.21.15.8:0/2365157854 shutdown_connections 2023-12-17T12:02:43.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:42.998+0000 7fd816dff700 1 --2- 172.21.15.8:0/2365157854 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd810109380 0x7fd81010b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:43.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:42.998+0000 7fd816dff700 1 --2- 172.21.15.8:0/2365157854 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd8100755b0 0x7fd810073a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:43.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:42.998+0000 7fd816dff700 1 --2- 172.21.15.8:0/2365157854 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd810073fd0 0x7fd810074450 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:43.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:42.999+0000 7fd816dff700 1 -- 172.21.15.8:0/2365157854 >> 172.21.15.8:0/2365157854 conn(0x7fd8100fca20 msgr2=0x7fd8100fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:43.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:42.999+0000 7fd816dff700 1 -- 172.21.15.8:0/2365157854 shutdown_connections 2023-12-17T12:02:43.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:42.999+0000 7fd816dff700 1 -- 172.21.15.8:0/2365157854 wait complete. 2023-12-17T12:02:43.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.000+0000 7fd816dff700 1 Processor -- start 2023-12-17T12:02:43.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.000+0000 7fd816dff700 1 -- start start 2023-12-17T12:02:43.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.000+0000 7fd816dff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd810073fd0 0x7fd810199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:43.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.000+0000 7fd816dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8100755b0 0x7fd810199a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:43.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.000+0000 7fd816dff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd810109380 0x7fd8101a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:43.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.000+0000 7fd816dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8101a1080 con 0x7fd8100755b0 2023-12-17T12:02:43.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.000+0000 7fd816dff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8101a11c0 con 0x7fd810109380 2023-12-17T12:02:43.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.000+0000 7fd816dff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8101a1350 con 0x7fd810073fd0 2023-12-17T12:02:43.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.000+0000 7fd80ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8100755b0 0x7fd810199a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:43.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.000+0000 7fd80ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8100755b0 0x7fd810199a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60174/0 (socket says 172.21.15.8:60174) 2023-12-17T12:02:43.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.000+0000 7fd80ffff700 1 -- 172.21.15.8:0/2200196010 learned_addr learned my addr 172.21.15.8:0/2200196010 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:02:43.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.001+0000 7fd814b9b700 1 --2- 172.21.15.8:0/2200196010 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd810073fd0 0x7fd810199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:43.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.001+0000 7fd80ffff700 1 -- 172.21.15.8:0/2200196010 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd810073fd0 msgr2=0x7fd810199550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:43.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.001+0000 7fd80ffff700 1 --2- 172.21.15.8:0/2200196010 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd810073fd0 0x7fd810199550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:43.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.001+0000 7fd80ffff700 1 -- 172.21.15.8:0/2200196010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd810109380 msgr2=0x7fd8101a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:43.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.001+0000 7fd80ffff700 1 --2- 172.21.15.8:0/2200196010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd810109380 0x7fd8101a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:43.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.001+0000 7fd80ffff700 1 -- 172.21.15.8:0/2200196010 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7fc0095f0 con 0x7fd8100755b0 2023-12-17T12:02:43.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.001+0000 7fd80ffff700 1 --2- 172.21.15.8:0/2200196010 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8100755b0 0x7fd810199a90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc000c00 tx=0x7fd7fc005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:43.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.001+0000 7fd80dffb700 1 -- 172.21.15.8:0/2200196010 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc01d070 con 0x7fd8100755b0 2023-12-17T12:02:43.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.001+0000 7fd80dffb700 1 -- 172.21.15.8:0/2200196010 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd7fc004100 con 0x7fd8100755b0 2023-12-17T12:02:43.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.001+0000 7fd80dffb700 1 -- 172.21.15.8:0/2200196010 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc022d70 con 0x7fd8100755b0 2023-12-17T12:02:43.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.001+0000 7fd816dff700 1 -- 172.21.15.8:0/2200196010 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8101a15d0 con 0x7fd8100755b0 2023-12-17T12:02:43.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.001+0000 7fd816dff700 1 -- 172.21.15.8:0/2200196010 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8101a19f0 con 0x7fd8100755b0 2023-12-17T12:02:43.006 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.002+0000 7fd816dff700 1 -- 172.21.15.8:0/2200196010 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8100682a0 con 0x7fd8100755b0 2023-12-17T12:02:43.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.004+0000 7fd80dffb700 1 -- 172.21.15.8:0/2200196010 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7fd7fc022570 con 0x7fd8100755b0 2023-12-17T12:02:43.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.006+0000 7fd80dffb700 1 --2- 172.21.15.8:0/2200196010 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fd8000a1500 0x7fd8000a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:43.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.006+0000 7fd80dffb700 1 -- 172.21.15.8:0/2200196010 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fd7fc0cdfd0 con 0x7fd8100755b0 2023-12-17T12:02:43.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.006+0000 7fd814b9b700 1 --2- 172.21.15.8:0/2200196010 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fd8000a1500 0x7fd8000a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:43.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.007+0000 7fd814b9b700 1 --2- 172.21.15.8:0/2200196010 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fd8000a1500 0x7fd8000a39c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd804005950 tx=0x7fd8040058e0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:43.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.008+0000 7fd80dffb700 1 -- 172.21.15.8:0/2200196010 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fd7fc097ac0 con 0x7fd8100755b0 2023-12-17T12:02:43.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.265+0000 7fd816dff700 1 -- 172.21.15.8:0/2200196010 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8100682a0 con 0x7fd8100755b0 2023-12-17T12:02:43.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.266+0000 7fd80dffb700 1 -- 172.21.15.8:0/2200196010 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+9227 (secure 0 0 0) 0x7fd8100682a0 con 0x7fd8100755b0 2023-12-17T12:02:43.268 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:02:43.268 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2669069079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2669069079},{"type":"v1","addr":"172.21.15.8:6835","nonce":2669069079}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/4241050553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":4241050553},{"type":"v1","addr":"172.21.15.8:6837","nonce":4241050553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14640,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/2765387309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2765387309},{"type":"v1","addr":"172.21.15.186:6835","nonce":2765387309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/487046247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":487046247},{"type":"v1","addr":"172.21.15.8:6839","nonce":487046247}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/338406768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":338406768},{"type":"v1","addr":"172.21.15.8:6841","nonce":338406768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/582753561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":582753561},{"type":"v1","addr":"172.21.15.186:6833","nonce":582753561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/305815776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":305815776},{"type":"v1","addr":"172.21.15.100:6833","nonce":305815776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24503,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2140351853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2140351853},{"type":"v1","addr":"172.21.15.100:6835","nonce":2140351853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24520,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/822451724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":822451724},{"type":"v1","addr":"172.21.15.186:6837","nonce":822451724}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24530,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/4176831844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":4176831844},{"type":"v1","addr":"172.21.15.100:6837","nonce":4176831844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24541,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6839/91602342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":91602342},{"type":"v1","addr":"172.21.15.186:6839","nonce":91602342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10}],"filesystems":[]} 2023-12-17T12:02:43.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.268+0000 7fd816dff700 1 -- 172.21.15.8:0/2200196010 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fd8000a1500 msgr2=0x7fd8000a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:43.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.268+0000 7fd816dff700 1 --2- 172.21.15.8:0/2200196010 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fd8000a1500 0x7fd8000a39c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd804005950 tx=0x7fd8040058e0 comp rx=0 tx=0).stop 2023-12-17T12:02:43.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.268+0000 7fd816dff700 1 -- 172.21.15.8:0/2200196010 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8100755b0 msgr2=0x7fd810199a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:43.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.268+0000 7fd816dff700 1 --2- 172.21.15.8:0/2200196010 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8100755b0 0x7fd810199a90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc000c00 tx=0x7fd7fc005ef0 comp rx=0 tx=0).stop 2023-12-17T12:02:43.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.268+0000 7fd816dff700 1 -- 172.21.15.8:0/2200196010 shutdown_connections 2023-12-17T12:02:43.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.268+0000 7fd816dff700 1 --2- 172.21.15.8:0/2200196010 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fd8000a1500 0x7fd8000a39c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:43.271 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.268+0000 7fd816dff700 1 --2- 172.21.15.8:0/2200196010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fd810109380 0x7fd8101a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:43.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.268+0000 7fd816dff700 1 --2- 172.21.15.8:0/2200196010 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd810073fd0 0x7fd810199550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:43.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.268+0000 7fd816dff700 1 --2- 172.21.15.8:0/2200196010 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fd8100755b0 0x7fd810199a90 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:43.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.268+0000 7fd816dff700 1 -- 172.21.15.8:0/2200196010 >> 172.21.15.8:0/2200196010 conn(0x7fd8100fca20 msgr2=0x7fd8101052d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:43.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.268+0000 7fd816dff700 1 -- 172.21.15.8:0/2200196010 shutdown_connections 2023-12-17T12:02:43.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:43.268+0000 7fd816dff700 1 -- 172.21.15.8:0/2200196010 wait complete. 2023-12-17T12:02:43.272 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 12 2023-12-17T12:02:43.596 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:43 smithi100 ceph-mon[41266]: Deploying daemon mds.b on smithi100 2023-12-17T12:02:43.597 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:43 smithi100 ceph-mon[41266]: mds.? [v2:172.21.15.8:6840/338406768,v1:172.21.15.8:6841/338406768] up:boot 2023-12-17T12:02:43.597 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:43 smithi100 ceph-mon[41266]: fsmap 11 up:standby 2023-12-17T12:02:43.597 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:43 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-12-17T12:02:43.597 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:43 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/2200196010' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:43.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:43 smithi186 ceph-mon[41182]: Deploying daemon mds.b on smithi100 2023-12-17T12:02:43.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:43 smithi186 ceph-mon[41182]: mds.? [v2:172.21.15.8:6840/338406768,v1:172.21.15.8:6841/338406768] up:boot 2023-12-17T12:02:43.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:43 smithi186 ceph-mon[41182]: fsmap 11 up:standby 2023-12-17T12:02:43.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:43 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-12-17T12:02:43.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:43 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/2200196010' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:43.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:43 smithi008 ceph-mon[36830]: Deploying daemon mds.b on smithi100 2023-12-17T12:02:43.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:43 smithi008 ceph-mon[36830]: mds.? [v2:172.21.15.8:6840/338406768,v1:172.21.15.8:6841/338406768] up:boot 2023-12-17T12:02:43.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:43 smithi008 ceph-mon[36830]: fsmap 11 up:standby 2023-12-17T12:02:43.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:43 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-12-17T12:02:43.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:43 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/2200196010' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:43.916 INFO:journalctl@ceph.mds.b.smithi100.stdout:Dec 17 12:02:43 smithi100 systemd[1]: Starting Ceph mds.b for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:02:44.416 INFO:journalctl@ceph.mds.b.smithi100.stdout:Dec 17 12:02:44 smithi100 bash[76400]: 740a9ebc7a1934022d6c718b0694e0dd7e1b6cbca5a6fdb7256bfaadf8d3a22b 2023-12-17T12:02:44.416 INFO:journalctl@ceph.mds.b.smithi100.stdout:Dec 17 12:02:44 smithi100 systemd[1]: Started Ceph mds.b for f43f508a-9cd2-11ee-95a5-87774f69a715. 2023-12-17T12:02:44.416 INFO:journalctl@ceph.mds.b.smithi100.stdout:Dec 17 12:02:44 smithi100 ceph-mds[76438]: -- 172.21.15.100:0/1495589203 <== mon.2 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560e1526f520 con 0x560e15247000 2023-12-17T12:02:44.416 INFO:journalctl@ceph.mds.b.smithi100.stdout:Dec 17 12:02:44 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-b[76415]: starting mds.b at 2023-12-17T12:02:44.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:44 smithi186 ceph-mon[41182]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:44.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:44 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:44.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:44 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:44.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:44 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:44.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:44 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:44.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:44 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:44.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:44 smithi008 ceph-mon[36830]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:44.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:44 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:44.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:44 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:44.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:44 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:44.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:44 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:44.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:44 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:44.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:44 smithi100 ceph-mon[41266]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:44.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:44 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:44.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:44 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:44.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:44 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:44.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:44 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:44.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:44 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:45.291 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-17T12:02:45.502 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.499+0000 7f664cbff700 1 -- 172.21.15.8:0/382894594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6648103030 msgr2=0x7f66481098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:45.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.499+0000 7f664cbff700 1 --2- 172.21.15.8:0/382894594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6648103030 0x7f66481098e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f664000b0d0 tx=0x7f664000b3e0 comp rx=0 tx=0).stop 2023-12-17T12:02:45.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.499+0000 7f664cbff700 1 -- 172.21.15.8:0/382894594 shutdown_connections 2023-12-17T12:02:45.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.499+0000 7f664cbff700 1 --2- 172.21.15.8:0/382894594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6648103030 0x7f66481098e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:45.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.499+0000 7f664cbff700 1 --2- 172.21.15.8:0/382894594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66481014a0 0x7f66481018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:45.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.499+0000 7f664cbff700 1 --2- 172.21.15.8:0/382894594 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6648102690 0x7f6648102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:45.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.499+0000 7f664cbff700 1 -- 172.21.15.8:0/382894594 >> 172.21.15.8:0/382894594 conn(0x7f66480fca10 msgr2=0x7f66480fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:45.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.500+0000 7f664cbff700 1 -- 172.21.15.8:0/382894594 shutdown_connections 2023-12-17T12:02:45.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.500+0000 7f664cbff700 1 -- 172.21.15.8:0/382894594 wait complete. 2023-12-17T12:02:45.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.500+0000 7f664cbff700 1 Processor -- start 2023-12-17T12:02:45.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.501+0000 7f664cbff700 1 -- start start 2023-12-17T12:02:45.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.501+0000 7f664cbff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66481014a0 0x7f6648197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:45.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.501+0000 7f664cbff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6648102690 0x7f6648197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:45.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.501+0000 7f664cbff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6648103030 0x7f664819e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:45.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.501+0000 7f664cbff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664819ef60 con 0x7f6648102690 2023-12-17T12:02:45.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.501+0000 7f664cbff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664819f0a0 con 0x7f66481014a0 2023-12-17T12:02:45.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.501+0000 7f664cbff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f664819f230 con 0x7f6648103030 2023-12-17T12:02:45.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.501+0000 7f6645d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6648102690 0x7f6648197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:45.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.501+0000 7f6645d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6648102690 0x7f6648197970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60190/0 (socket says 172.21.15.8:60190) 2023-12-17T12:02:45.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.501+0000 7f6645d9b700 1 -- 172.21.15.8:0/1302862921 learned_addr learned my addr 172.21.15.8:0/1302862921 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:02:45.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.501+0000 7f664659c700 1 --2- 172.21.15.8:0/1302862921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66481014a0 0x7f6648197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:45.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.501+0000 7f6646d9d700 1 --2- 172.21.15.8:0/1302862921 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6648103030 0x7f664819e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:45.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.502+0000 7f6645d9b700 1 -- 172.21.15.8:0/1302862921 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6648103030 msgr2=0x7f664819e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:45.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.502+0000 7f6645d9b700 1 --2- 172.21.15.8:0/1302862921 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6648103030 0x7f664819e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:45.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.502+0000 7f6645d9b700 1 -- 172.21.15.8:0/1302862921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66481014a0 msgr2=0x7f6648197430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:45.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.502+0000 7f6645d9b700 1 --2- 172.21.15.8:0/1302862921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66481014a0 0x7f6648197430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:45.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.502+0000 7f6645d9b700 1 -- 172.21.15.8:0/1302862921 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6640009d00 con 0x7f6648102690 2023-12-17T12:02:45.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.502+0000 7f664659c700 1 --2- 172.21.15.8:0/1302862921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66481014a0 0x7f6648197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T12:02:45.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.502+0000 7f6645d9b700 1 --2- 172.21.15.8:0/1302862921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6648102690 0x7f6648197970 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f663c00e9a0 tx=0x7f663c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:45.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.502+0000 7f66377fe700 1 -- 172.21.15.8:0/1302862921 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663c009790 con 0x7f6648102690 2023-12-17T12:02:45.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.502+0000 7f66377fe700 1 -- 172.21.15.8:0/1302862921 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f663c010430 con 0x7f6648102690 2023-12-17T12:02:45.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.502+0000 7f664cbff700 1 -- 172.21.15.8:0/1302862921 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f664819f510 con 0x7f6648102690 2023-12-17T12:02:45.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.502+0000 7f66377fe700 1 -- 172.21.15.8:0/1302862921 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663c00cea0 con 0x7f6648102690 2023-12-17T12:02:45.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.502+0000 7f664cbff700 1 -- 172.21.15.8:0/1302862921 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f664819fa20 con 0x7f6648102690 2023-12-17T12:02:45.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.504+0000 7f664cbff700 1 -- 172.21.15.8:0/1302862921 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6648108970 con 0x7f6648102690 2023-12-17T12:02:45.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.507+0000 7f66377fe700 1 -- 172.21.15.8:0/1302862921 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7f663c0105a0 con 0x7f6648102690 2023-12-17T12:02:45.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.508+0000 7f66377fe700 1 --2- 172.21.15.8:0/1302862921 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f66300a1480 0x7f66300a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:45.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.509+0000 7f66377fe700 1 -- 172.21.15.8:0/1302862921 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f663c014070 con 0x7f6648102690 2023-12-17T12:02:45.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.509+0000 7f664659c700 1 --2- 172.21.15.8:0/1302862921 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f66300a1480 0x7f66300a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:45.512 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.509+0000 7f664659c700 1 --2- 172.21.15.8:0/1302862921 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f66300a1480 0x7f66300a3940 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f66481024f0 tx=0x7f6638009260 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:45.513 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.511+0000 7f66377fe700 1 -- 172.21.15.8:0/1302862921 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f663c096700 con 0x7f6648102690 2023-12-17T12:02:45.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:45 smithi186 ceph-mon[41182]: mds.? [v2:172.21.15.100:6838/3921737538,v1:172.21.15.100:6839/3921737538] up:boot 2023-12-17T12:02:45.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:45 smithi186 ceph-mon[41182]: fsmap 12 up:standby 2023-12-17T12:02:45.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:45 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-12-17T12:02:45.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:45 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:02:45.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:45 smithi008 ceph-mon[36830]: mds.? [v2:172.21.15.100:6838/3921737538,v1:172.21.15.100:6839/3921737538] up:boot 2023-12-17T12:02:45.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:45 smithi008 ceph-mon[36830]: fsmap 12 up:standby 2023-12-17T12:02:45.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:45 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-12-17T12:02:45.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:45 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:02:45.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.810+0000 7f664cbff700 1 -- 172.21.15.8:0/1302862921 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6648068230 con 0x7f6648102690 2023-12-17T12:02:45.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.811+0000 7f66377fe700 1 -- 172.21.15.8:0/1302862921 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+10022 (secure 0 0 0) 0x7f663c099d20 con 0x7f6648102690 2023-12-17T12:02:45.814 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:02:45.814 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2669069079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2669069079},{"type":"v1","addr":"172.21.15.8:6835","nonce":2669069079}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/4241050553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":4241050553},{"type":"v1","addr":"172.21.15.8:6837","nonce":4241050553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5},{"gid":14640,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/2765387309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2765387309},{"type":"v1","addr":"172.21.15.186:6835","nonce":2765387309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":7},{"gid":14679,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6839/487046247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":487046247},{"type":"v1","addr":"172.21.15.8:6839","nonce":487046247}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":14691,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6841/338406768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":338406768},{"type":"v1","addr":"172.21.15.8:6841","nonce":338406768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":24451,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/582753561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":582753561},{"type":"v1","addr":"172.21.15.186:6833","nonce":582753561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6833/305815776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":305815776},{"type":"v1","addr":"172.21.15.100:6833","nonce":305815776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":24503,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6835/2140351853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2140351853},{"type":"v1","addr":"172.21.15.100:6835","nonce":2140351853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":6},{"gid":24520,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6837/822451724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":822451724},{"type":"v1","addr":"172.21.15.186:6837","nonce":822451724}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":8},{"gid":24530,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6837/4176831844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":4176831844},{"type":"v1","addr":"172.21.15.100:6837","nonce":4176831844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":9},{"gid":24541,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6839/91602342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":91602342},{"type":"v1","addr":"172.21.15.186:6839","nonce":91602342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":10},{"gid":24569,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.100:6839/3921737538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3921737538},{"type":"v1","addr":"172.21.15.100:6839","nonce":3921737538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":13}],"filesystems":[]} 2023-12-17T12:02:45.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.814+0000 7f664cbff700 1 -- 172.21.15.8:0/1302862921 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f66300a1480 msgr2=0x7f66300a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:45.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.814+0000 7f664cbff700 1 --2- 172.21.15.8:0/1302862921 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f66300a1480 0x7f66300a3940 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f66481024f0 tx=0x7f6638009260 comp rx=0 tx=0).stop 2023-12-17T12:02:45.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.814+0000 7f664cbff700 1 -- 172.21.15.8:0/1302862921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6648102690 msgr2=0x7f6648197970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:45.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.814+0000 7f664cbff700 1 --2- 172.21.15.8:0/1302862921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6648102690 0x7f6648197970 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f663c00e9a0 tx=0x7f663c00ecb0 comp rx=0 tx=0).stop 2023-12-17T12:02:45.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.814+0000 7f664cbff700 1 -- 172.21.15.8:0/1302862921 shutdown_connections 2023-12-17T12:02:45.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.814+0000 7f664cbff700 1 --2- 172.21.15.8:0/1302862921 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f66300a1480 0x7f66300a3940 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:45.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.814+0000 7f664cbff700 1 --2- 172.21.15.8:0/1302862921 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6648103030 0x7f664819e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:45.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.814+0000 7f664cbff700 1 --2- 172.21.15.8:0/1302862921 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f66481014a0 0x7f6648197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:45.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.814+0000 7f664cbff700 1 --2- 172.21.15.8:0/1302862921 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6648102690 0x7f6648197970 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:45.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.814+0000 7f664cbff700 1 -- 172.21.15.8:0/1302862921 >> 172.21.15.8:0/1302862921 conn(0x7f66480fca10 msgr2=0x7f6648105ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:45.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.814+0000 7f664cbff700 1 -- 172.21.15.8:0/1302862921 shutdown_connections 2023-12-17T12:02:45.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:45.814+0000 7f664cbff700 1 -- 172.21.15.8:0/1302862921 wait complete. 2023-12-17T12:02:45.818 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 13 2023-12-17T12:02:45.837 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T12:02:45.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:45 smithi100 ceph-mon[41266]: mds.? [v2:172.21.15.100:6838/3921737538,v1:172.21.15.100:6839/3921737538] up:boot 2023-12-17T12:02:45.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:45 smithi100 ceph-mon[41266]: fsmap 12 up:standby 2023-12-17T12:02:45.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:45 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-12-17T12:02:45.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:45 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:02:46.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.055+0000 7f80173ff700 1 -- 172.21.15.8:0/1296501853 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8010102690 msgr2=0x7f8010102af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:46.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.055+0000 7f80173ff700 1 --2- 172.21.15.8:0/1296501853 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8010102690 0x7f8010102af0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f80000098f0 tx=0x7f8000009c00 comp rx=0 tx=0).stop 2023-12-17T12:02:46.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.055+0000 7f80173ff700 1 -- 172.21.15.8:0/1296501853 shutdown_connections 2023-12-17T12:02:46.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.055+0000 7f80173ff700 1 --2- 172.21.15.8:0/1296501853 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8010103030 0x7f80101098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:46.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.055+0000 7f80173ff700 1 --2- 172.21.15.8:0/1296501853 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f80101014a0 0x7f80101018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:46.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.055+0000 7f80173ff700 1 --2- 172.21.15.8:0/1296501853 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8010102690 0x7f8010102af0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:46.058 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.055+0000 7f80173ff700 1 -- 172.21.15.8:0/1296501853 >> 172.21.15.8:0/1296501853 conn(0x7f80100fca10 msgr2=0x7f80100fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:46.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.055+0000 7f80173ff700 1 -- 172.21.15.8:0/1296501853 shutdown_connections 2023-12-17T12:02:46.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.055+0000 7f80173ff700 1 -- 172.21.15.8:0/1296501853 wait complete. 2023-12-17T12:02:46.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.056+0000 7f80173ff700 1 Processor -- start 2023-12-17T12:02:46.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.057+0000 7f80173ff700 1 -- start start 2023-12-17T12:02:46.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.057+0000 7f80173ff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f80101014a0 0x7f8010197390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:46.060 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.057+0000 7f80173ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8010102690 0x7f80101978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:46.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.057+0000 7f80173ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8010103030 0x7f801019e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:46.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.057+0000 7f80173ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801019eec0 con 0x7f8010103030 2023-12-17T12:02:46.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.057+0000 7f80173ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801019f000 con 0x7f8010102690 2023-12-17T12:02:46.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.057+0000 7f80173ff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801019f190 con 0x7f80101014a0 2023-12-17T12:02:46.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.057+0000 7f801599c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8010103030 0x7f801019e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:46.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.057+0000 7f801519b700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f80101014a0 0x7f8010197390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:46.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.057+0000 7f801519b700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f80101014a0 0x7f8010197390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:53270/0 (socket says 172.21.15.8:53270) 2023-12-17T12:02:46.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.057+0000 7f801599c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8010103030 0x7f801019e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60218/0 (socket says 172.21.15.8:60218) 2023-12-17T12:02:46.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.057+0000 7f801519b700 1 -- 172.21.15.8:0/3927512821 learned_addr learned my addr 172.21.15.8:0/3927512821 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:02:46.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.057+0000 7f801499a700 1 --2- 172.21.15.8:0/3927512821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8010102690 0x7f80101978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:46.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.058+0000 7f801599c700 1 -- 172.21.15.8:0/3927512821 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f80101014a0 msgr2=0x7f8010197390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:46.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.058+0000 7f801599c700 1 --2- 172.21.15.8:0/3927512821 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f80101014a0 0x7f8010197390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:46.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.058+0000 7f801599c700 1 -- 172.21.15.8:0/3927512821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8010102690 msgr2=0x7f80101978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:46.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.058+0000 7f801599c700 1 --2- 172.21.15.8:0/3927512821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8010102690 0x7f80101978d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:46.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.058+0000 7f801599c700 1 -- 172.21.15.8:0/3927512821 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8008009d00 con 0x7f8010103030 2023-12-17T12:02:46.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.058+0000 7f801599c700 1 --2- 172.21.15.8:0/3927512821 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8010103030 0x7f801019e8f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8008009cd0 tx=0x7f800800c620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:46.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.058+0000 7f80067fc700 1 -- 172.21.15.8:0/3927512821 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8008017070 con 0x7f8010103030 2023-12-17T12:02:46.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.058+0000 7f80067fc700 1 -- 172.21.15.8:0/3927512821 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f800800f040 con 0x7f8010103030 2023-12-17T12:02:46.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.058+0000 7f80173ff700 1 -- 172.21.15.8:0/3927512821 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8000009520 con 0x7f8010103030 2023-12-17T12:02:46.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.058+0000 7f80067fc700 1 -- 172.21.15.8:0/3927512821 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800800e050 con 0x7f8010103030 2023-12-17T12:02:46.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.058+0000 7f80173ff700 1 -- 172.21.15.8:0/3927512821 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f801019f790 con 0x7f8010103030 2023-12-17T12:02:46.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.060+0000 7f80173ff700 1 -- 172.21.15.8:0/3927512821 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80101089c0 con 0x7f8010103030 2023-12-17T12:02:46.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.061+0000 7f80067fc700 1 -- 172.21.15.8:0/3927512821 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7f800800cd10 con 0x7f8010103030 2023-12-17T12:02:46.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.062+0000 7f80067fc700 1 --2- 172.21.15.8:0/3927512821 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f7ffc0a1500 0x7f7ffc0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:46.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.063+0000 7f80067fc700 1 -- 172.21.15.8:0/3927512821 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f80080cc1c0 con 0x7f8010103030 2023-12-17T12:02:46.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.063+0000 7f801519b700 1 --2- 172.21.15.8:0/3927512821 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f7ffc0a1500 0x7f7ffc0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:46.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.064+0000 7f801519b700 1 --2- 172.21.15.8:0/3927512821 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f7ffc0a1500 0x7f7ffc0a39c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f800c005950 tx=0x7f800c009260 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:46.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.067+0000 7f80067fc700 1 -- 172.21.15.8:0/3927512821 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f8008095c20 con 0x7f8010103030 2023-12-17T12:02:46.349 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.346+0000 7f80173ff700 1 -- 172.21.15.8:0/3927512821 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80101083a0 con 0x7f8010103030 2023-12-17T12:02:46.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.347+0000 7f80067fc700 1 -- 172.21.15.8:0/3927512821 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v79) v1 ==== 74+0+18349 (secure 0 0 0) 0x7f8008099240 con 0x7f8010103030 2023-12-17T12:02:46.350 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:02:46.351 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":79,"fsid":"f43f508a-9cd2-11ee-95a5-87774f69a715","created":"2023-12-17T11:55:30.666634+0000","modified":"2023-12-17T12:02:05.664519+0000","last_up_change":"2023-12-17T12:02:04.656573+0000","last_in_change":"2023-12-17T12:01:45.526832+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:58:43.972745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1f8acaf-a47b-4b74-a78d-e0b6be49a10e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6803","nonce":297519189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6805","nonce":297519189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6809","nonce":297519189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6807","nonce":297519189}]},"public_addr":"172.21.15.8:6803/297519189","cluster_addr":"172.21.15.8:6805/297519189","heartbeat_back_addr":"172.21.15.8:6809/297519189","heartbeat_front_addr":"172.21.15.8:6807/297519189","state":["exists","up"]},{"osd":1,"uuid":"d7138889-77de-43ba-b36b-7628f6f66bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6801","nonce":2496516573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6803","nonce":2496516573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6807","nonce":2496516573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6805","nonce":2496516573}]},"public_addr":"172.21.15.100:6801/2496516573","cluster_addr":"172.21.15.100:6803/2496516573","heartbeat_back_addr":"172.21.15.100:6807/2496516573","heartbeat_front_addr":"172.21.15.100:6805/2496516573","state":["exists","up"]},{"osd":2,"uuid":"ff452a6b-a11e-47be-9eaf-ec1001b51447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6801","nonce":2454925270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6803","nonce":2454925270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6807","nonce":2454925270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6805","nonce":2454925270}]},"public_addr":"172.21.15.186:6801/2454925270","cluster_addr":"172.21.15.186:6803/2454925270","heartbeat_back_addr":"172.21.15.186:6807/2454925270","heartbeat_front_addr":"172.21.15.186:6805/2454925270","state":["exists","up"]},{"osd":3,"uuid":"d19ab765-df7b-48c7-9012-8a3ac7d81aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6811","nonce":1141622701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6813","nonce":1141622701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6817","nonce":1141622701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6815","nonce":1141622701}]},"public_addr":"172.21.15.8:6811/1141622701","cluster_addr":"172.21.15.8:6813/1141622701","heartbeat_back_addr":"172.21.15.8:6817/1141622701","heartbeat_front_addr":"172.21.15.8:6815/1141622701","state":["exists","up"]},{"osd":4,"uuid":"8ecc3a01-f19a-40a7-93a2-8870116afe6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6809","nonce":1902152516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6811","nonce":1902152516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6815","nonce":1902152516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6813","nonce":1902152516}]},"public_addr":"172.21.15.100:6809/1902152516","cluster_addr":"172.21.15.100:6811/1902152516","heartbeat_back_addr":"172.21.15.100:6815/1902152516","heartbeat_front_addr":"172.21.15.100:6813/1902152516","state":["exists","up"]},{"osd":5,"uuid":"ac057cc9-2a27-4216-a7ae-fc60d9796eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":52,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6809","nonce":648349934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6811","nonce":648349934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6815","nonce":648349934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6813","nonce":648349934}]},"public_addr":"172.21.15.186:6809/648349934","cluster_addr":"172.21.15.186:6811/648349934","heartbeat_back_addr":"172.21.15.186:6815/648349934","heartbeat_front_addr":"172.21.15.186:6813/648349934","state":["exists","up"]},{"osd":6,"uuid":"bb5325e0-fe12-4bbc-96a9-86c228106a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6819","nonce":3266909294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6821","nonce":3266909294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6825","nonce":3266909294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6823","nonce":3266909294}]},"public_addr":"172.21.15.8:6819/3266909294","cluster_addr":"172.21.15.8:6821/3266909294","heartbeat_back_addr":"172.21.15.8:6825/3266909294","heartbeat_front_addr":"172.21.15.8:6823/3266909294","state":["exists","up"]},{"osd":7,"uuid":"48939d99-29dd-436b-b9f1-fdfe1ee26315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6817","nonce":1631494583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6819","nonce":1631494583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6823","nonce":1631494583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6821","nonce":1631494583}]},"public_addr":"172.21.15.100:6817/1631494583","cluster_addr":"172.21.15.100:6819/1631494583","heartbeat_back_addr":"172.21.15.100:6823/1631494583","heartbeat_front_addr":"172.21.15.100:6821/1631494583","state":["exists","up"]},{"osd":8,"uuid":"e3414f7f-7665-406f-89ec-79cbb3d3e274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6817","nonce":3569004799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6819","nonce":3569004799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6823","nonce":3569004799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6821","nonce":3569004799}]},"public_addr":"172.21.15.186:6817/3569004799","cluster_addr":"172.21.15.186:6819/3569004799","heartbeat_back_addr":"172.21.15.186:6823/3569004799","heartbeat_front_addr":"172.21.15.186:6821/3569004799","state":["exists","up"]},{"osd":9,"uuid":"b04f519d-6e44-4158-b6e1-aa4d64be3404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6827","nonce":3980647643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6829","nonce":3980647643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6833","nonce":3980647643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6831","nonce":3980647643}]},"public_addr":"172.21.15.8:6827/3980647643","cluster_addr":"172.21.15.8:6829/3980647643","heartbeat_back_addr":"172.21.15.8:6833/3980647643","heartbeat_front_addr":"172.21.15.8:6831/3980647643","state":["exists","up"]},{"osd":10,"uuid":"779fde04-620b-4b44-bd35-39be1470eec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6825","nonce":34112410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6827","nonce":34112410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6831","nonce":34112410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6829","nonce":34112410}]},"public_addr":"172.21.15.100:6825/34112410","cluster_addr":"172.21.15.100:6827/34112410","heartbeat_back_addr":"172.21.15.100:6831/34112410","heartbeat_front_addr":"172.21.15.100:6829/34112410","state":["exists","up"]},{"osd":11,"uuid":"6bbcb42f-aa99-44e4-9c3f-d818423eb5b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6825","nonce":3779371472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6827","nonce":3779371472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6831","nonce":3779371472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6829","nonce":3779371472}]},"public_addr":"172.21.15.186:6825/3779371472","cluster_addr":"172.21.15.186:6827/3779371472","heartbeat_back_addr":"172.21.15.186:6831/3779371472","heartbeat_front_addr":"172.21.15.186:6829/3779371472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:57:56.955667+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:58:18.433916+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:58:40.589590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:59:03.635858+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:59:25.544564+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:59:48.171593+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:00:10.876885+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:00:32.920759+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:00:55.273330+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:01:18.131720+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:01:40.259620+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:02:02.776536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/4074020814":"2023-12-18T11:56:27.362306+0000","172.21.15.8:6801/222068650":"2023-12-18T11:56:27.362306+0000","172.21.15.8:6801/4187398661":"2023-12-18T11:56:00.731492+0000","172.21.15.8:6800/222068650":"2023-12-18T11:56:27.362306+0000","172.21.15.8:6800/4187398661":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/2964092603":"2023-12-18T11:56:27.362306+0000","172.21.15.8:0/35186087":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/1429868241":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/174719729":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/2106317618":"2023-12-18T11:56:27.362306+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T12:02:46.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.351+0000 7f80173ff700 1 -- 172.21.15.8:0/3927512821 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f7ffc0a1500 msgr2=0x7f7ffc0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:46.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.351+0000 7f80173ff700 1 --2- 172.21.15.8:0/3927512821 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f7ffc0a1500 0x7f7ffc0a39c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f800c005950 tx=0x7f800c009260 comp rx=0 tx=0).stop 2023-12-17T12:02:46.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.351+0000 7f80173ff700 1 -- 172.21.15.8:0/3927512821 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8010103030 msgr2=0x7f801019e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:46.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.351+0000 7f80173ff700 1 --2- 172.21.15.8:0/3927512821 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8010103030 0x7f801019e8f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f8008009cd0 tx=0x7f800800c620 comp rx=0 tx=0).stop 2023-12-17T12:02:46.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.351+0000 7f80173ff700 1 -- 172.21.15.8:0/3927512821 shutdown_connections 2023-12-17T12:02:46.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.351+0000 7f80173ff700 1 --2- 172.21.15.8:0/3927512821 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f7ffc0a1500 0x7f7ffc0a39c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:46.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.351+0000 7f80173ff700 1 --2- 172.21.15.8:0/3927512821 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8010103030 0x7f801019e8f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:46.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.351+0000 7f80173ff700 1 --2- 172.21.15.8:0/3927512821 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f80101014a0 0x7f8010197390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:46.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.351+0000 7f80173ff700 1 --2- 172.21.15.8:0/3927512821 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8010102690 0x7f80101978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:46.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.351+0000 7f80173ff700 1 -- 172.21.15.8:0/3927512821 >> 172.21.15.8:0/3927512821 conn(0x7f80100fca10 msgr2=0x7f8010105b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:46.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.351+0000 7f80173ff700 1 -- 172.21.15.8:0/3927512821 shutdown_connections 2023-12-17T12:02:46.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.351+0000 7f80173ff700 1 -- 172.21.15.8:0/3927512821 wait complete. 2023-12-17T12:02:46.380 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-17T11:58:43.972745+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-17T12:02:46.381 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-17T12:02:46.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.602+0000 7f28667ff700 1 -- 172.21.15.8:0/283764698 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2860075610 msgr2=0x7f2860073a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:46.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.602+0000 7f28667ff700 1 --2- 172.21.15.8:0/283764698 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2860075610 0x7f2860073a60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f28500098f0 tx=0x7f2850009c00 comp rx=0 tx=0).stop 2023-12-17T12:02:46.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.602+0000 7f28667ff700 1 -- 172.21.15.8:0/283764698 shutdown_connections 2023-12-17T12:02:46.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.602+0000 7f28667ff700 1 --2- 172.21.15.8:0/283764698 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f286010db70 0x7f286010ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:46.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.602+0000 7f28667ff700 1 --2- 172.21.15.8:0/283764698 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2860075610 0x7f2860073a60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:46.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.602+0000 7f28667ff700 1 --2- 172.21.15.8:0/283764698 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2860074030 0x7f28600744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:46.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.602+0000 7f28667ff700 1 -- 172.21.15.8:0/283764698 >> 172.21.15.8:0/283764698 conn(0x7f28600fcb10 msgr2=0x7f28600fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:46.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.603+0000 7f28667ff700 1 -- 172.21.15.8:0/283764698 shutdown_connections 2023-12-17T12:02:46.606 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.603+0000 7f28667ff700 1 -- 172.21.15.8:0/283764698 wait complete. 2023-12-17T12:02:46.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.603+0000 7f28667ff700 1 Processor -- start 2023-12-17T12:02:46.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.604+0000 7f28667ff700 1 -- start start 2023-12-17T12:02:46.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.604+0000 7f28667ff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2860074030 0x7f286019daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:46.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.604+0000 7f28667ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2860075610 0x7f286019e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:46.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.604+0000 7f28667ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f286010db70 0x7f28601a5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:46.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.604+0000 7f28667ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28601a5620 con 0x7f286010db70 2023-12-17T12:02:46.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.604+0000 7f28667ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28601a5760 con 0x7f2860075610 2023-12-17T12:02:46.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.604+0000 7f28667ff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28601a58f0 con 0x7f2860074030 2023-12-17T12:02:46.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.604+0000 7f285ffff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2860074030 0x7f286019daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:46.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.604+0000 7f285ffff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2860074030 0x7f286019daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:53284/0 (socket says 172.21.15.8:53284) 2023-12-17T12:02:46.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.604+0000 7f285f7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2860075610 0x7f286019e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:46.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.604+0000 7f285ffff700 1 -- 172.21.15.8:0/3325712708 learned_addr learned my addr 172.21.15.8:0/3325712708 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:02:46.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.604+0000 7f2864d9c700 1 --2- 172.21.15.8:0/3325712708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f286010db70 0x7f28601a5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:46.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.605+0000 7f285ffff700 1 -- 172.21.15.8:0/3325712708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2860075610 msgr2=0x7f286019e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:46.609 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.605+0000 7f285ffff700 1 --2- 172.21.15.8:0/3325712708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2860075610 0x7f286019e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:46.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.605+0000 7f285ffff700 1 -- 172.21.15.8:0/3325712708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f286010db70 msgr2=0x7f28601a5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:46.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.605+0000 7f285ffff700 1 --2- 172.21.15.8:0/3325712708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f286010db70 0x7f28601a5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:46.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.605+0000 7f285ffff700 1 -- 172.21.15.8:0/3325712708 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2850009520 con 0x7f2860074030 2023-12-17T12:02:46.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.605+0000 7f2864d9c700 1 --2- 172.21.15.8:0/3325712708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f286010db70 0x7f28601a5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T12:02:46.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.605+0000 7f285ffff700 1 --2- 172.21.15.8:0/3325712708 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2860074030 0x7f286019daf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2850009810 tx=0x7f285000b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:46.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.605+0000 7f285d7fa700 1 -- 172.21.15.8:0/3325712708 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285001c070 con 0x7f2860074030 2023-12-17T12:02:46.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.605+0000 7f285d7fa700 1 -- 172.21.15.8:0/3325712708 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f285000f7d0 con 0x7f2860074030 2023-12-17T12:02:46.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.605+0000 7f28667ff700 1 -- 172.21.15.8:0/3325712708 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28601a5b70 con 0x7f2860074030 2023-12-17T12:02:46.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.605+0000 7f285d7fa700 1 -- 172.21.15.8:0/3325712708 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28500039e0 con 0x7f2860074030 2023-12-17T12:02:46.610 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.605+0000 7f28667ff700 1 -- 172.21.15.8:0/3325712708 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28601a5ff0 con 0x7f2860074030 2023-12-17T12:02:46.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.606+0000 7f28667ff700 1 -- 172.21.15.8:0/3325712708 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2860103dd0 con 0x7f2860074030 2023-12-17T12:02:46.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.608+0000 7f285d7fa700 1 -- 172.21.15.8:0/3325712708 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7f2850020030 con 0x7f2860074030 2023-12-17T12:02:46.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.610+0000 7f285d7fa700 1 --2- 172.21.15.8:0/3325712708 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f28480a1500 0x7f28480a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:46.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.610+0000 7f285d7fa700 1 -- 172.21.15.8:0/3325712708 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f28500cd900 con 0x7f2860074030 2023-12-17T12:02:46.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.610+0000 7f285f7fe700 1 --2- 172.21.15.8:0/3325712708 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f28480a1500 0x7f28480a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:46.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.610+0000 7f285f7fe700 1 --2- 172.21.15.8:0/3325712708 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f28480a1500 0x7f28480a39c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2860075330 tx=0x7f2854009310 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:46.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.615+0000 7f285d7fa700 1 -- 172.21.15.8:0/3325712708 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f28500973f0 con 0x7f2860074030 2023-12-17T12:02:46.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:46 smithi186 ceph-mon[41182]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:46.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:46 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/1302862921' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:46.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:46 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/3927512821' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:02:46.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:46 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:46.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:46 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:46.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:46 smithi008 ceph-mon[36830]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:46.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:46 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/1302862921' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:46.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:46 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/3927512821' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:02:46.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:46 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:46.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:46 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:46.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.830+0000 7f28667ff700 1 -- 172.21.15.8:0/3325712708 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f28601037b0 con 0x7f2860074030 2023-12-17T12:02:46.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.831+0000 7f285d7fa700 1 -- 172.21.15.8:0/3325712708 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v79) v1 ==== 93+0+10 (secure 0 0 0) 0x7f285009aa10 con 0x7f2860074030 2023-12-17T12:02:46.834 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-12-17T12:02:46.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.833+0000 7f28667ff700 1 -- 172.21.15.8:0/3325712708 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f28480a1500 msgr2=0x7f28480a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:46.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.833+0000 7f28667ff700 1 --2- 172.21.15.8:0/3325712708 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f28480a1500 0x7f28480a39c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2860075330 tx=0x7f2854009310 comp rx=0 tx=0).stop 2023-12-17T12:02:46.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.833+0000 7f28667ff700 1 -- 172.21.15.8:0/3325712708 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2860074030 msgr2=0x7f286019daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:46.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.833+0000 7f28667ff700 1 --2- 172.21.15.8:0/3325712708 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2860074030 0x7f286019daf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2850009810 tx=0x7f285000b840 comp rx=0 tx=0).stop 2023-12-17T12:02:46.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.833+0000 7f28667ff700 1 -- 172.21.15.8:0/3325712708 shutdown_connections 2023-12-17T12:02:46.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.833+0000 7f28667ff700 1 --2- 172.21.15.8:0/3325712708 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f28480a1500 0x7f28480a39c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:46.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.833+0000 7f28667ff700 1 --2- 172.21.15.8:0/3325712708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f286010db70 0x7f28601a5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:46.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.833+0000 7f28667ff700 1 --2- 172.21.15.8:0/3325712708 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2860074030 0x7f286019daf0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:46.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.833+0000 7f28667ff700 1 --2- 172.21.15.8:0/3325712708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2860075610 0x7f286019e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:46.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.833+0000 7f28667ff700 1 -- 172.21.15.8:0/3325712708 >> 172.21.15.8:0/3325712708 conn(0x7f28600fcb10 msgr2=0x7f2860100f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:46.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.833+0000 7f28667ff700 1 -- 172.21.15.8:0/3325712708 shutdown_connections 2023-12-17T12:02:46.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:46.833+0000 7f28667ff700 1 -- 172.21.15.8:0/3325712708 wait complete. 2023-12-17T12:02:46.855 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-17T12:02:46.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:46 smithi100 ceph-mon[41266]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:46.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:46 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/1302862921' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:02:46.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:46 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/3927512821' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:02:46.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:46 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:46.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:46 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:47.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.056+0000 7fda21bff700 1 -- 172.21.15.8:0/2910246606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda1c101490 msgr2=0x7fda1c1018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:47.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.056+0000 7fda21bff700 1 --2- 172.21.15.8:0/2910246606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda1c101490 0x7fda1c1018b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0099c0 tx=0x7fda0c009cd0 comp rx=0 tx=0).stop 2023-12-17T12:02:47.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.056+0000 7fda21bff700 1 -- 172.21.15.8:0/2910246606 shutdown_connections 2023-12-17T12:02:47.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.056+0000 7fda21bff700 1 --2- 172.21.15.8:0/2910246606 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda1c103020 0x7fda1c1098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:47.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.056+0000 7fda21bff700 1 --2- 172.21.15.8:0/2910246606 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda1c101490 0x7fda1c1018b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:47.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.056+0000 7fda21bff700 1 --2- 172.21.15.8:0/2910246606 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda1c102680 0x7fda1c102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:47.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.056+0000 7fda21bff700 1 -- 172.21.15.8:0/2910246606 >> 172.21.15.8:0/2910246606 conn(0x7fda1c0fca00 msgr2=0x7fda1c0fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:47.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.056+0000 7fda21bff700 1 -- 172.21.15.8:0/2910246606 shutdown_connections 2023-12-17T12:02:47.059 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.056+0000 7fda21bff700 1 -- 172.21.15.8:0/2910246606 wait complete. 2023-12-17T12:02:47.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.057+0000 7fda21bff700 1 Processor -- start 2023-12-17T12:02:47.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.057+0000 7fda21bff700 1 -- start start 2023-12-17T12:02:47.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.058+0000 7fda21bff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda1c101490 0x7fda1c199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:47.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.058+0000 7fda21bff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda1c102680 0x7fda1c199ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:47.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.058+0000 7fda21bff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda1c103020 0x7fda1c1a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:47.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.058+0000 7fda21bff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c1a10a0 con 0x7fda1c101490 2023-12-17T12:02:47.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.058+0000 7fda21bff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c1a11e0 con 0x7fda1c103020 2023-12-17T12:02:47.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.058+0000 7fda21bff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1c1a1370 con 0x7fda1c102680 2023-12-17T12:02:47.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.058+0000 7fda1b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda1c101490 0x7fda1c199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:47.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.058+0000 7fda1b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda1c101490 0x7fda1c199570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60262/0 (socket says 172.21.15.8:60262) 2023-12-17T12:02:47.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.058+0000 7fda1b7fe700 1 -- 172.21.15.8:0/1798686565 learned_addr learned my addr 172.21.15.8:0/1798686565 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:02:47.062 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.058+0000 7fda1affd700 1 --2- 172.21.15.8:0/1798686565 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda1c102680 0x7fda1c199ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:47.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.058+0000 7fda1bfff700 1 --2- 172.21.15.8:0/1798686565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda1c103020 0x7fda1c1a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:47.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.058+0000 7fda1b7fe700 1 -- 172.21.15.8:0/1798686565 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda1c102680 msgr2=0x7fda1c199ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:47.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.058+0000 7fda1b7fe700 1 --2- 172.21.15.8:0/1798686565 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda1c102680 0x7fda1c199ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:47.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.058+0000 7fda1b7fe700 1 -- 172.21.15.8:0/1798686565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda1c103020 msgr2=0x7fda1c1a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:47.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.058+0000 7fda1b7fe700 1 --2- 172.21.15.8:0/1798686565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda1c103020 0x7fda1c1a0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:47.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.058+0000 7fda1b7fe700 1 -- 172.21.15.8:0/1798686565 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda10009520 con 0x7fda1c101490 2023-12-17T12:02:47.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.059+0000 7fda1b7fe700 1 --2- 172.21.15.8:0/1798686565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda1c101490 0x7fda1c199570 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fda0c000c00 tx=0x7fda0c00f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:47.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.059+0000 7fda18ff9700 1 -- 172.21.15.8:0/1798686565 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c01d070 con 0x7fda1c101490 2023-12-17T12:02:47.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.059+0000 7fda18ff9700 1 -- 172.21.15.8:0/1798686565 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fda0c005030 con 0x7fda1c101490 2023-12-17T12:02:47.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.059+0000 7fda21bff700 1 -- 172.21.15.8:0/1798686565 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda0c0095f0 con 0x7fda1c101490 2023-12-17T12:02:47.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.059+0000 7fda18ff9700 1 -- 172.21.15.8:0/1798686565 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c004b30 con 0x7fda1c101490 2023-12-17T12:02:47.063 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.059+0000 7fda21bff700 1 -- 172.21.15.8:0/1798686565 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda1c1a1880 con 0x7fda1c101490 2023-12-17T12:02:47.064 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.060+0000 7fda21bff700 1 -- 172.21.15.8:0/1798686565 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda1c068680 con 0x7fda1c101490 2023-12-17T12:02:47.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.062+0000 7fda18ff9700 1 -- 172.21.15.8:0/1798686565 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7fda0c004c90 con 0x7fda1c101490 2023-12-17T12:02:47.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.064+0000 7fda18ff9700 1 --2- 172.21.15.8:0/1798686565 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fda040a1480 0x7fda040a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:47.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.064+0000 7fda18ff9700 1 -- 172.21.15.8:0/1798686565 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fda0c0cd980 con 0x7fda1c101490 2023-12-17T12:02:47.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.064+0000 7fda1affd700 1 --2- 172.21.15.8:0/1798686565 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fda040a1480 0x7fda040a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:47.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.065+0000 7fda1affd700 1 --2- 172.21.15.8:0/1798686565 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fda040a1480 0x7fda040a3940 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fda10009df0 tx=0x7fda10009260 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:47.069 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.066+0000 7fda18ff9700 1 -- 172.21.15.8:0/1798686565 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fda0c097470 con 0x7fda1c101490 2023-12-17T12:02:47.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.283+0000 7fda21bff700 1 -- 172.21.15.8:0/1798686565 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fda1c10cd70 con 0x7fda1c101490 2023-12-17T12:02:47.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.283+0000 7fda18ff9700 1 -- 172.21.15.8:0/1798686565 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v79) v1 ==== 84+0+65 (secure 0 0 0) 0x7fda0c09aa90 con 0x7fda1c101490 2023-12-17T12:02:47.286 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:02:47.286 INFO:teuthology.orchestra.run.smithi008.stdout:[ 2023-12-17T12:02:47.286 INFO:teuthology.orchestra.run.smithi008.stdout: { 2023-12-17T12:02:47.286 INFO:teuthology.orchestra.run.smithi008.stdout: "poolnum": 1, 2023-12-17T12:02:47.287 INFO:teuthology.orchestra.run.smithi008.stdout: "poolname": ".mgr" 2023-12-17T12:02:47.287 INFO:teuthology.orchestra.run.smithi008.stdout: } 2023-12-17T12:02:47.287 INFO:teuthology.orchestra.run.smithi008.stdout:] 2023-12-17T12:02:47.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.286+0000 7fda21bff700 1 -- 172.21.15.8:0/1798686565 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fda040a1480 msgr2=0x7fda040a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:47.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.286+0000 7fda21bff700 1 --2- 172.21.15.8:0/1798686565 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fda040a1480 0x7fda040a3940 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fda10009df0 tx=0x7fda10009260 comp rx=0 tx=0).stop 2023-12-17T12:02:47.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.286+0000 7fda21bff700 1 -- 172.21.15.8:0/1798686565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda1c101490 msgr2=0x7fda1c199570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:47.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.286+0000 7fda21bff700 1 --2- 172.21.15.8:0/1798686565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda1c101490 0x7fda1c199570 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fda0c000c00 tx=0x7fda0c00f690 comp rx=0 tx=0).stop 2023-12-17T12:02:47.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.286+0000 7fda21bff700 1 -- 172.21.15.8:0/1798686565 shutdown_connections 2023-12-17T12:02:47.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.286+0000 7fda21bff700 1 --2- 172.21.15.8:0/1798686565 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fda040a1480 0x7fda040a3940 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:47.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.286+0000 7fda21bff700 1 --2- 172.21.15.8:0/1798686565 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fda1c103020 0x7fda1c1a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:47.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.286+0000 7fda21bff700 1 --2- 172.21.15.8:0/1798686565 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fda1c101490 0x7fda1c199570 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:47.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.286+0000 7fda21bff700 1 --2- 172.21.15.8:0/1798686565 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda1c102680 0x7fda1c199ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:47.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.286+0000 7fda21bff700 1 -- 172.21.15.8:0/1798686565 >> 172.21.15.8:0/1798686565 conn(0x7fda1c0fca00 msgr2=0x7fda1c107ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:47.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.286+0000 7fda21bff700 1 -- 172.21.15.8:0/1798686565 shutdown_connections 2023-12-17T12:02:47.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.286+0000 7fda21bff700 1 -- 172.21.15.8:0/1798686565 wait complete. 2023-12-17T12:02:47.308 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-17T12:02:47.308 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-17T12:02:47.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.523+0000 7f482a5ff700 1 -- 172.21.15.8:0/2210961988 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4824075610 msgr2=0x7f4824073a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:47.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.523+0000 7f482a5ff700 1 --2- 172.21.15.8:0/2210961988 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4824075610 0x7f4824073a60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4814009990 tx=0x7f4814009ca0 comp rx=0 tx=0).stop 2023-12-17T12:02:47.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.523+0000 7f482a5ff700 1 -- 172.21.15.8:0/2210961988 shutdown_connections 2023-12-17T12:02:47.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.523+0000 7f482a5ff700 1 --2- 172.21.15.8:0/2210961988 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4824109460 0x7f482410b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:47.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.523+0000 7f482a5ff700 1 --2- 172.21.15.8:0/2210961988 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4824075610 0x7f4824073a60 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:47.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.523+0000 7f482a5ff700 1 --2- 172.21.15.8:0/2210961988 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4824074030 0x7f48240744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:47.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.523+0000 7f482a5ff700 1 -- 172.21.15.8:0/2210961988 >> 172.21.15.8:0/2210961988 conn(0x7f48240fcb10 msgr2=0x7f48240fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:47.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.523+0000 7f482a5ff700 1 -- 172.21.15.8:0/2210961988 shutdown_connections 2023-12-17T12:02:47.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.523+0000 7f482a5ff700 1 -- 172.21.15.8:0/2210961988 wait complete. 2023-12-17T12:02:47.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.524+0000 7f482a5ff700 1 Processor -- start 2023-12-17T12:02:47.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.524+0000 7f482a5ff700 1 -- start start 2023-12-17T12:02:47.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.525+0000 7f482a5ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4824074030 0x7f48241996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:47.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.525+0000 7f482a5ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4824075610 0x7f4824199be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:47.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.525+0000 7f482a5ff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4824109460 0x7f48241a0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:47.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.525+0000 7f482a5ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48241a11d0 con 0x7f4824075610 2023-12-17T12:02:47.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.525+0000 7f482a5ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48241a1310 con 0x7f4824074030 2023-12-17T12:02:47.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.525+0000 7f482a5ff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48241a14a0 con 0x7f4824109460 2023-12-17T12:02:47.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.525+0000 7f48237fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4824075610 0x7f4824199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:47.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.525+0000 7f48237fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4824075610 0x7f4824199be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60282/0 (socket says 172.21.15.8:60282) 2023-12-17T12:02:47.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.525+0000 7f48237fe700 1 -- 172.21.15.8:0/3704917563 learned_addr learned my addr 172.21.15.8:0/3704917563 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:02:47.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.525+0000 7f4823fff700 1 --2- 172.21.15.8:0/3704917563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4824074030 0x7f48241996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:47.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.525+0000 7f4828b9c700 1 --2- 172.21.15.8:0/3704917563 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4824109460 0x7f48241a0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:47.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.525+0000 7f48237fe700 1 -- 172.21.15.8:0/3704917563 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4824109460 msgr2=0x7f48241a0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:47.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.525+0000 7f48237fe700 1 --2- 172.21.15.8:0/3704917563 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4824109460 0x7f48241a0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:47.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.525+0000 7f48237fe700 1 -- 172.21.15.8:0/3704917563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4824074030 msgr2=0x7f48241996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:47.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.525+0000 7f48237fe700 1 --2- 172.21.15.8:0/3704917563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4824074030 0x7f48241996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:47.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.525+0000 7f48237fe700 1 -- 172.21.15.8:0/3704917563 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48140095f0 con 0x7f4824075610 2023-12-17T12:02:47.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.526+0000 7f48237fe700 1 --2- 172.21.15.8:0/3704917563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4824075610 0x7f4824199be0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f481800e970 tx=0x7f481800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:47.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.526+0000 7f48217fa700 1 -- 172.21.15.8:0/3704917563 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4818009790 con 0x7f4824075610 2023-12-17T12:02:47.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.526+0000 7f48217fa700 1 -- 172.21.15.8:0/3704917563 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f481800c7e0 con 0x7f4824075610 2023-12-17T12:02:47.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.526+0000 7f48217fa700 1 -- 172.21.15.8:0/3704917563 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4818003bd0 con 0x7f4824075610 2023-12-17T12:02:47.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.526+0000 7f482a5ff700 1 -- 172.21.15.8:0/3704917563 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48241a1780 con 0x7f4824075610 2023-12-17T12:02:47.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.526+0000 7f482a5ff700 1 -- 172.21.15.8:0/3704917563 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48241a1c40 con 0x7f4824075610 2023-12-17T12:02:47.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.527+0000 7f482a5ff700 1 -- 172.21.15.8:0/3704917563 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4824108220 con 0x7f4824075610 2023-12-17T12:02:47.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.529+0000 7f48217fa700 1 -- 172.21.15.8:0/3704917563 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7f481800c950 con 0x7f4824075610 2023-12-17T12:02:47.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.530+0000 7f48217fa700 1 --2- 172.21.15.8:0/3704917563 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f480c0a1500 0x7f480c0a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:47.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.531+0000 7f48217fa700 1 -- 172.21.15.8:0/3704917563 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f4818014070 con 0x7f4824075610 2023-12-17T12:02:47.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.531+0000 7f4823fff700 1 --2- 172.21.15.8:0/3704917563 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f480c0a1500 0x7f480c0a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:47.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.531+0000 7f4823fff700 1 --2- 172.21.15.8:0/3704917563 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f480c0a1500 0x7f480c0a39c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4814005910 tx=0x7f481400b260 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:47.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.534+0000 7f48217fa700 1 -- 172.21.15.8:0/3704917563 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f48180964b0 con 0x7f4824075610 2023-12-17T12:02:47.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:47.751+0000 7f482a5ff700 1 -- 172.21.15.8:0/3704917563 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4824068310 con 0x7f4824075610 2023-12-17T12:02:47.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:47 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:47.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:47 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:47.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:47 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:47.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:47 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:47.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:47 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/3325712708' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-17T12:02:47.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:47 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/1798686565' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-12-17T12:02:47.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:47 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:47.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:47 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:02:47.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:47 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:47.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:47 smithi100 ceph-mon[41266]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:47.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:47 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:47.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:47 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:47.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:47 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:47.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:47 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:47.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:47 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:47.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:47 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/3325712708' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-17T12:02:47.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:47 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/1798686565' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-12-17T12:02:47.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:47 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:47.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:47 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:02:47.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:47 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:47.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:47 smithi186 ceph-mon[41182]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:47.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:47 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:47.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:47 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:47.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:47 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:47.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:47 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:47.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:47 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:47.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:47 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/3325712708' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-17T12:02:47.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:47 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/1798686565' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-12-17T12:02:47.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:47 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:47.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:47 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:02:47.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:47 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:47.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:47 smithi008 ceph-mon[36830]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:47.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:47 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:48.581 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.579+0000 7f48217fa700 1 -- 172.21.15.8:0/3704917563 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v80) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4818099ad0 con 0x7f4824075610 2023-12-17T12:02:48.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.582+0000 7f482a5ff700 1 -- 172.21.15.8:0/3704917563 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f480c0a1500 msgr2=0x7f480c0a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:48.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.582+0000 7f482a5ff700 1 --2- 172.21.15.8:0/3704917563 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f480c0a1500 0x7f480c0a39c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4814005910 tx=0x7f481400b260 comp rx=0 tx=0).stop 2023-12-17T12:02:48.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.582+0000 7f482a5ff700 1 -- 172.21.15.8:0/3704917563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4824075610 msgr2=0x7f4824199be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:48.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.582+0000 7f482a5ff700 1 --2- 172.21.15.8:0/3704917563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4824075610 0x7f4824199be0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f481800e970 tx=0x7f481800ec80 comp rx=0 tx=0).stop 2023-12-17T12:02:48.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.582+0000 7f482a5ff700 1 -- 172.21.15.8:0/3704917563 shutdown_connections 2023-12-17T12:02:48.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.582+0000 7f482a5ff700 1 --2- 172.21.15.8:0/3704917563 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f480c0a1500 0x7f480c0a39c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:48.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.582+0000 7f482a5ff700 1 --2- 172.21.15.8:0/3704917563 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4824109460 0x7f48241a0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:48.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.582+0000 7f482a5ff700 1 --2- 172.21.15.8:0/3704917563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4824074030 0x7f48241996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:48.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.582+0000 7f482a5ff700 1 --2- 172.21.15.8:0/3704917563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4824075610 0x7f4824199be0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:48.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.582+0000 7f482a5ff700 1 -- 172.21.15.8:0/3704917563 >> 172.21.15.8:0/3704917563 conn(0x7f48240fcb10 msgr2=0x7f4824105360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:48.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.583+0000 7f482a5ff700 1 -- 172.21.15.8:0/3704917563 shutdown_connections 2023-12-17T12:02:48.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.583+0000 7f482a5ff700 1 -- 172.21.15.8:0/3704917563 wait complete. 2023-12-17T12:02:48.587 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_metadata' created 2023-12-17T12:02:48.609 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-17T12:02:48.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.824+0000 7f363c9ff700 1 -- 172.21.15.8:0/3012311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3638107260 msgr2=0x7f36381096d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:48.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.824+0000 7f363c9ff700 1 --2- 172.21.15.8:0/3012311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3638107260 0x7f36381096d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f363000b0a0 tx=0x7f363000b3b0 comp rx=0 tx=0).stop 2023-12-17T12:02:48.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.825+0000 7f363c9ff700 1 -- 172.21.15.8:0/3012311 shutdown_connections 2023-12-17T12:02:48.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.825+0000 7f363c9ff700 1 --2- 172.21.15.8:0/3012311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3638107260 0x7f36381096d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:48.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.825+0000 7f363c9ff700 1 --2- 172.21.15.8:0/3012311 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3638102000 0x7f36381043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:48.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.825+0000 7f363c9ff700 1 --2- 172.21.15.8:0/3012311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3638104930 0x7f3638106d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:48.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.825+0000 7f363c9ff700 1 -- 172.21.15.8:0/3012311 >> 172.21.15.8:0/3012311 conn(0x7f36380fb9f0 msgr2=0x7f36380fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:48.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.825+0000 7f363c9ff700 1 -- 172.21.15.8:0/3012311 shutdown_connections 2023-12-17T12:02:48.828 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.825+0000 7f363c9ff700 1 -- 172.21.15.8:0/3012311 wait complete. 2023-12-17T12:02:48.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.826+0000 7f363c9ff700 1 Processor -- start 2023-12-17T12:02:48.829 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.826+0000 7f363c9ff700 1 -- start start 2023-12-17T12:02:48.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.827+0000 7f363c9ff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3638102000 0x7f36381974d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:48.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.827+0000 7f363c9ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3638104930 0x7f3638197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:48.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.827+0000 7f363c9ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3638107260 0x7f363819ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:48.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.827+0000 7f363c9ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363819f000 con 0x7f3638104930 2023-12-17T12:02:48.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.827+0000 7f363c9ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363819f140 con 0x7f3638107260 2023-12-17T12:02:48.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.827+0000 7f363c9ff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f363819f2d0 con 0x7f3638102000 2023-12-17T12:02:48.830 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.827+0000 7f3635d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3638104930 0x7f3638197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:48.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.827+0000 7f363659c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3638102000 0x7f36381974d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:48.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.827+0000 7f3635d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3638104930 0x7f3638197a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60298/0 (socket says 172.21.15.8:60298) 2023-12-17T12:02:48.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.827+0000 7f3635d9b700 1 -- 172.21.15.8:0/3629407808 learned_addr learned my addr 172.21.15.8:0/3629407808 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:02:48.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.827+0000 7f3636d9d700 1 --2- 172.21.15.8:0/3629407808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3638107260 0x7f363819ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:48.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.828+0000 7f363659c700 1 -- 172.21.15.8:0/3629407808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3638107260 msgr2=0x7f363819ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:48.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.828+0000 7f363659c700 1 --2- 172.21.15.8:0/3629407808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3638107260 0x7f363819ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:48.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.828+0000 7f363659c700 1 -- 172.21.15.8:0/3629407808 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3638104930 msgr2=0x7f3638197a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:48.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.828+0000 7f363659c700 1 --2- 172.21.15.8:0/3629407808 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3638104930 0x7f3638197a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:48.831 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.828+0000 7f363659c700 1 -- 172.21.15.8:0/3629407808 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3630009d00 con 0x7f3638102000 2023-12-17T12:02:48.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.828+0000 7f363659c700 1 --2- 172.21.15.8:0/3629407808 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3638102000 0x7f36381974d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f362800e9f0 tx=0x7f362800ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:48.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.828+0000 7f36277fe700 1 -- 172.21.15.8:0/3629407808 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f362800c9c0 con 0x7f3638102000 2023-12-17T12:02:48.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.828+0000 7f363c9ff700 1 -- 172.21.15.8:0/3629407808 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f363819f5b0 con 0x7f3638102000 2023-12-17T12:02:48.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.828+0000 7f36277fe700 1 -- 172.21.15.8:0/3629407808 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3628010430 con 0x7f3638102000 2023-12-17T12:02:48.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.828+0000 7f36277fe700 1 -- 172.21.15.8:0/3629407808 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3628018680 con 0x7f3638102000 2023-12-17T12:02:48.832 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.828+0000 7f363c9ff700 1 -- 172.21.15.8:0/3629407808 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f363819fac0 con 0x7f3638102000 2023-12-17T12:02:48.833 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.830+0000 7f363c9ff700 1 -- 172.21.15.8:0/3629407808 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36380fd570 con 0x7f3638102000 2023-12-17T12:02:48.834 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.832+0000 7f36277fe700 1 -- 172.21.15.8:0/3629407808 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7f36280105a0 con 0x7f3638102000 2023-12-17T12:02:48.835 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.833+0000 7f36277fe700 1 --2- 172.21.15.8:0/3629407808 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f36200a1480 0x7f36200a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:48.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.833+0000 7f36277fe700 1 -- 172.21.15.8:0/3629407808 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 7497+0+0 (secure 0 0 0) 0x7f3628014070 con 0x7f3638102000 2023-12-17T12:02:48.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.833+0000 7f3635d9b700 1 --2- 172.21.15.8:0/3629407808 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f36200a1480 0x7f36200a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:48.836 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.834+0000 7f3635d9b700 1 --2- 172.21.15.8:0/3629407808 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f36200a1480 0x7f36200a3940 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f362c009d20 tx=0x7f362c009260 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:48.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:48.837+0000 7f36277fe700 1 -- 172.21.15.8:0/3629407808 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f3628096520 con 0x7f3638102000 2023-12-17T12:02:48.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:48 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:02:48.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:48 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/3704917563' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-12-17T12:02:48.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:48 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:02:48.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:48 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/3704917563' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-12-17T12:02:48.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:48 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:02:48.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:48 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/3704917563' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-12-17T12:02:49.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.080+0000 7f363c9ff700 1 -- 172.21.15.8:0/3629407808 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f363810cee0 con 0x7f3638102000 2023-12-17T12:02:49.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.644+0000 7f36277fe700 1 -- 172.21.15.8:0/3629407808 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v81) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3628099b40 con 0x7f3638102000 2023-12-17T12:02:49.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.651+0000 7f363c9ff700 1 -- 172.21.15.8:0/3629407808 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f36200a1480 msgr2=0x7f36200a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:49.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.651+0000 7f363c9ff700 1 --2- 172.21.15.8:0/3629407808 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f36200a1480 0x7f36200a3940 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f362c009d20 tx=0x7f362c009260 comp rx=0 tx=0).stop 2023-12-17T12:02:49.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.651+0000 7f363c9ff700 1 -- 172.21.15.8:0/3629407808 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3638102000 msgr2=0x7f36381974d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:49.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.651+0000 7f363c9ff700 1 --2- 172.21.15.8:0/3629407808 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3638102000 0x7f36381974d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f362800e9f0 tx=0x7f362800ed00 comp rx=0 tx=0).stop 2023-12-17T12:02:49.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.652+0000 7f363c9ff700 1 -- 172.21.15.8:0/3629407808 shutdown_connections 2023-12-17T12:02:49.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.652+0000 7f363c9ff700 1 --2- 172.21.15.8:0/3629407808 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f36200a1480 0x7f36200a3940 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:49.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.652+0000 7f363c9ff700 1 --2- 172.21.15.8:0/3629407808 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3638107260 0x7f363819ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:49.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.652+0000 7f363c9ff700 1 --2- 172.21.15.8:0/3629407808 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3638102000 0x7f36381974d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:49.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.652+0000 7f363c9ff700 1 --2- 172.21.15.8:0/3629407808 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3638104930 0x7f3638197a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:49.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.652+0000 7f363c9ff700 1 -- 172.21.15.8:0/3629407808 >> 172.21.15.8:0/3629407808 conn(0x7f36380fb9f0 msgr2=0x7f3638102a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:49.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.652+0000 7f363c9ff700 1 -- 172.21.15.8:0/3629407808 shutdown_connections 2023-12-17T12:02:49.656 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.653+0000 7f363c9ff700 1 -- 172.21.15.8:0/3629407808 wait complete. 2023-12-17T12:02:49.662 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_data' created 2023-12-17T12:02:49.689 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-17T12:02:49.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.901+0000 7f89a1fff700 1 -- 172.21.15.8:0/40361281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f899c1015a0 msgr2=0x7f899c1019c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:49.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.901+0000 7f89a1fff700 1 --2- 172.21.15.8:0/40361281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f899c1015a0 0x7f899c1019c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f898c009990 tx=0x7f898c009ca0 comp rx=0 tx=0).stop 2023-12-17T12:02:49.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.902+0000 7f89a1fff700 1 -- 172.21.15.8:0/40361281 shutdown_connections 2023-12-17T12:02:49.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.902+0000 7f89a1fff700 1 --2- 172.21.15.8:0/40361281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f899c103130 0x7f899c1099e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:49.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.902+0000 7f89a1fff700 1 --2- 172.21.15.8:0/40361281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f899c1015a0 0x7f899c1019c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:49.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.902+0000 7f89a1fff700 1 --2- 172.21.15.8:0/40361281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f899c102790 0x7f899c102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:49.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.902+0000 7f89a1fff700 1 -- 172.21.15.8:0/40361281 >> 172.21.15.8:0/40361281 conn(0x7f899c0fcb10 msgr2=0x7f899c0fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:49.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.902+0000 7f89a1fff700 1 -- 172.21.15.8:0/40361281 shutdown_connections 2023-12-17T12:02:49.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.902+0000 7f89a1fff700 1 -- 172.21.15.8:0/40361281 wait complete. 2023-12-17T12:02:49.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.903+0000 7f89a1fff700 1 Processor -- start 2023-12-17T12:02:49.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.903+0000 7f89a1fff700 1 -- start start 2023-12-17T12:02:49.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.903+0000 7f89a1fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f899c1015a0 0x7f899c197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:49.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.903+0000 7f89a1fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f899c102790 0x7f899c197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:49.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.903+0000 7f89a1fff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f899c103130 0x7f899c19ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:49.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.903+0000 7f89a1fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899c19f010 con 0x7f899c102790 2023-12-17T12:02:49.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.903+0000 7f89a1fff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899c19f150 con 0x7f899c1015a0 2023-12-17T12:02:49.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.903+0000 7f89a1fff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f899c19f2e0 con 0x7f899c103130 2023-12-17T12:02:49.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.904+0000 7f899affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f899c102790 0x7f899c197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:49.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.904+0000 7f899b7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f899c1015a0 0x7f899c197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:49.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.904+0000 7f899affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f899c102790 0x7f899c197a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:60318/0 (socket says 172.21.15.8:60318) 2023-12-17T12:02:49.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.904+0000 7f899b7fe700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f899c1015a0 0x7f899c197530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.8:53168/0 (socket says 172.21.15.8:53168) 2023-12-17T12:02:49.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.904+0000 7f899affd700 1 -- 172.21.15.8:0/2101535984 learned_addr learned my addr 172.21.15.8:0/2101535984 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:02:49.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.904+0000 7f899bfff700 1 --2- 172.21.15.8:0/2101535984 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f899c103130 0x7f899c19ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:49.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.904+0000 7f899b7fe700 1 -- 172.21.15.8:0/2101535984 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f899c103130 msgr2=0x7f899c19ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:49.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.904+0000 7f899b7fe700 1 --2- 172.21.15.8:0/2101535984 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f899c103130 0x7f899c19ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:49.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.904+0000 7f899b7fe700 1 -- 172.21.15.8:0/2101535984 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f899c102790 msgr2=0x7f899c197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:49.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.904+0000 7f899b7fe700 1 --2- 172.21.15.8:0/2101535984 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f899c102790 0x7f899c197a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:49.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.904+0000 7f899b7fe700 1 -- 172.21.15.8:0/2101535984 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8990009520 con 0x7f899c1015a0 2023-12-17T12:02:49.908 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.904+0000 7f899affd700 1 --2- 172.21.15.8:0/2101535984 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f899c102790 0x7f899c197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T12:02:49.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.904+0000 7f899b7fe700 1 --2- 172.21.15.8:0/2101535984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f899c1015a0 0x7f899c197530 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f898c000c00 tx=0x7f898c00b9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:49.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.905+0000 7f8998ff9700 1 -- 172.21.15.8:0/2101535984 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c01d070 con 0x7f899c1015a0 2023-12-17T12:02:49.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.905+0000 7f89a1fff700 1 -- 172.21.15.8:0/2101535984 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f898c0095f0 con 0x7f899c1015a0 2023-12-17T12:02:49.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.905+0000 7f8998ff9700 1 -- 172.21.15.8:0/2101535984 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f898c003d20 con 0x7f899c1015a0 2023-12-17T12:02:49.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.905+0000 7f8998ff9700 1 -- 172.21.15.8:0/2101535984 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f898c00fd00 con 0x7f899c1015a0 2023-12-17T12:02:49.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.905+0000 7f89a1fff700 1 -- 172.21.15.8:0/2101535984 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f899c19f850 con 0x7f899c1015a0 2023-12-17T12:02:49.909 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.906+0000 7f89a1fff700 1 -- 172.21.15.8:0/2101535984 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f899c108b10 con 0x7f899c1015a0 2023-12-17T12:02:49.910 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.908+0000 7f8998ff9700 1 -- 172.21.15.8:0/2101535984 <== mon.2 v2:172.21.15.100:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7f898c00f460 con 0x7f899c1015a0 2023-12-17T12:02:49.911 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.909+0000 7f8998ff9700 1 --2- 172.21.15.8:0/2101535984 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f89840a1500 0x7f89840a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:49.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.909+0000 7f8998ff9700 1 -- 172.21.15.8:0/2101535984 <== mon.2 v2:172.21.15.100:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7879+0+0 (secure 0 0 0) 0x7f898c0cdd50 con 0x7f899c1015a0 2023-12-17T12:02:49.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.909+0000 7f899affd700 1 --2- 172.21.15.8:0/2101535984 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f89840a1500 0x7f89840a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:49.912 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.910+0000 7f899affd700 1 --2- 172.21.15.8:0/2101535984 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f89840a1500 0x7f89840a39c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8990009fd0 tx=0x7f8990009260 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:49.915 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:49.912+0000 7f8998ff9700 1 -- 172.21.15.8:0/2101535984 <== mon.2 v2:172.21.15.100:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f898c097550 con 0x7f899c1015a0 2023-12-17T12:02:49.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:49 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/3704917563' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-12-17T12:02:49.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:49 smithi100 ceph-mon[41266]: osdmap e80: 12 total, 12 up, 12 in 2023-12-17T12:02:49.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:49 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/3704917563' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-12-17T12:02:49.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:49 smithi186 ceph-mon[41182]: osdmap e80: 12 total, 12 up, 12 in 2023-12-17T12:02:49.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:49 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/3704917563' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-12-17T12:02:49.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:49 smithi008 ceph-mon[36830]: osdmap e80: 12 total, 12 up, 12 in 2023-12-17T12:02:50.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:50.173+0000 7f89a1fff700 1 -- 172.21.15.8:0/2101535984 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f899c10ccd0 con 0x7f899c1015a0 2023-12-17T12:02:50.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:50 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/3629407808' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-12-17T12:02:50.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:50 smithi100 ceph-mon[41266]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-12-17T12:02:50.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:50 smithi100 ceph-mon[41266]: pgmap v261: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:50.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:50 smithi100 ceph-mon[41266]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-12-17T12:02:50.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:50 smithi100 ceph-mon[41266]: osdmap e81: 12 total, 12 up, 12 in 2023-12-17T12:02:50.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:50 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:50.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:50 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:50.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:50 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:50.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:50 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:50.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:50 smithi100 ceph-mon[41266]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-12-17T12:02:50.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:50 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:50.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:50 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:50.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:50 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:50.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:50 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:02:50.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:50 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:50.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:50 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/2101535984' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-12-17T12:02:50.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:50 smithi100 ceph-mon[41266]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-12-17T12:02:50.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:50 smithi100 ceph-mon[41266]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-12-17T12:02:50.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:50 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/3629407808' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-12-17T12:02:50.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:50 smithi186 ceph-mon[41182]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-12-17T12:02:50.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:50 smithi186 ceph-mon[41182]: pgmap v261: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:50.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:50 smithi186 ceph-mon[41182]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-12-17T12:02:50.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:50 smithi186 ceph-mon[41182]: osdmap e81: 12 total, 12 up, 12 in 2023-12-17T12:02:50.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:50 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:50.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:50 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:50.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:50 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:50.977 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:50 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:50.977 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:50 smithi186 ceph-mon[41182]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-12-17T12:02:50.977 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:50 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:50.977 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:50 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:50.977 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:50 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:50.977 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:50 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:02:50.977 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:50 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:50.977 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:50 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/2101535984' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-12-17T12:02:50.977 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:50 smithi186 ceph-mon[41182]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-12-17T12:02:50.977 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:50 smithi186 ceph-mon[41182]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-12-17T12:02:50.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:50.977+0000 7f8998ff9700 1 -- 172.21.15.8:0/2101535984 <== mon.2 v2:172.21.15.100:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7f898c00fe60 con 0x7f899c1015a0 2023-12-17T12:02:50.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:50.980+0000 7f89a1fff700 1 -- 172.21.15.8:0/2101535984 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f89840a1500 msgr2=0x7f89840a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:50.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:50.980+0000 7f89a1fff700 1 --2- 172.21.15.8:0/2101535984 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f89840a1500 0x7f89840a39c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8990009fd0 tx=0x7f8990009260 comp rx=0 tx=0).stop 2023-12-17T12:02:50.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:50.980+0000 7f89a1fff700 1 -- 172.21.15.8:0/2101535984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f899c1015a0 msgr2=0x7f899c197530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:50.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:50.980+0000 7f89a1fff700 1 --2- 172.21.15.8:0/2101535984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f899c1015a0 0x7f899c197530 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f898c000c00 tx=0x7f898c00b9e0 comp rx=0 tx=0).stop 2023-12-17T12:02:50.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:50.980+0000 7f89a1fff700 1 -- 172.21.15.8:0/2101535984 shutdown_connections 2023-12-17T12:02:50.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:50.980+0000 7f89a1fff700 1 --2- 172.21.15.8:0/2101535984 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f89840a1500 0x7f89840a39c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:50.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:50.980+0000 7f89a1fff700 1 --2- 172.21.15.8:0/2101535984 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f899c103130 0x7f899c19ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:50.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:50.980+0000 7f89a1fff700 1 --2- 172.21.15.8:0/2101535984 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f899c1015a0 0x7f899c197530 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:50.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:50.980+0000 7f89a1fff700 1 --2- 172.21.15.8:0/2101535984 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f899c102790 0x7f899c197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:50.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:50.980+0000 7f89a1fff700 1 -- 172.21.15.8:0/2101535984 >> 172.21.15.8:0/2101535984 conn(0x7f899c0fcb10 msgr2=0x7f899c105c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:50.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:50.981+0000 7f89a1fff700 1 -- 172.21.15.8:0/2101535984 shutdown_connections 2023-12-17T12:02:50.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:50.981+0000 7f89a1fff700 1 -- 172.21.15.8:0/2101535984 wait complete. 2023-12-17T12:02:50.986 INFO:teuthology.orchestra.run.smithi008.stderr:new fs with metadata pool 2 and data pool 3 2023-12-17T12:02:50.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:50 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/3629407808' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-12-17T12:02:50.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:50 smithi008 ceph-mon[36830]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-12-17T12:02:50.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:50 smithi008 ceph-mon[36830]: pgmap v261: 33 pgs: 3 creating+peering, 1 active+clean, 29 unknown; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:50.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:50 smithi008 ceph-mon[36830]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-12-17T12:02:50.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:50 smithi008 ceph-mon[36830]: osdmap e81: 12 total, 12 up, 12 in 2023-12-17T12:02:50.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:50 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:50.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:50 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:50.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:50 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:50.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:50 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:50.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:50 smithi008 ceph-mon[36830]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-12-17T12:02:50.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:50 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:50.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:50 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:50.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:50 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:02:50.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:50 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:02:50.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:50 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:02:50.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:50 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/2101535984' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-12-17T12:02:50.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:50 smithi008 ceph-mon[36830]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-12-17T12:02:50.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:50 smithi008 ceph-mon[36830]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-12-17T12:02:51.008 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T12:02:51.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.214+0000 7f6418dff700 1 -- 172.21.15.8:0/3145876786 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6414103030 msgr2=0x7f64141098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:51.217 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.214+0000 7f6418dff700 1 --2- 172.21.15.8:0/3145876786 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6414103030 0x7f64141098e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f640c00b0d0 tx=0x7f640c00b3e0 comp rx=0 tx=0).stop 2023-12-17T12:02:51.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.214+0000 7f6418dff700 1 -- 172.21.15.8:0/3145876786 shutdown_connections 2023-12-17T12:02:51.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.214+0000 7f6418dff700 1 --2- 172.21.15.8:0/3145876786 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6414103030 0x7f64141098e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:51.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.214+0000 7f6418dff700 1 --2- 172.21.15.8:0/3145876786 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64141014a0 0x7f64141018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:51.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.214+0000 7f6418dff700 1 --2- 172.21.15.8:0/3145876786 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6414102690 0x7f6414102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:51.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.214+0000 7f6418dff700 1 -- 172.21.15.8:0/3145876786 >> 172.21.15.8:0/3145876786 conn(0x7f64140fca10 msgr2=0x7f64140fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:51.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.214+0000 7f6418dff700 1 -- 172.21.15.8:0/3145876786 shutdown_connections 2023-12-17T12:02:51.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.214+0000 7f6418dff700 1 -- 172.21.15.8:0/3145876786 wait complete. 2023-12-17T12:02:51.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.215+0000 7f6418dff700 1 Processor -- start 2023-12-17T12:02:51.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.215+0000 7f6418dff700 1 -- start start 2023-12-17T12:02:51.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.216+0000 7f6418dff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64141014a0 0x7f6414197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:51.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.216+0000 7f6418dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6414102690 0x7f6414197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:51.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.216+0000 7f6418dff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6414103030 0x7f641419e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:51.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.216+0000 7f6418dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641419ef60 con 0x7f6414102690 2023-12-17T12:02:51.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.216+0000 7f6418dff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641419f0a0 con 0x7f64141014a0 2023-12-17T12:02:51.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.216+0000 7f6418dff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f641419f230 con 0x7f6414103030 2023-12-17T12:02:51.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.216+0000 7f6411d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6414102690 0x7f6414197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:51.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.216+0000 7f6411d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6414102690 0x7f6414197970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56222/0 (socket says 172.21.15.8:56222) 2023-12-17T12:02:51.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.216+0000 7f641259c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64141014a0 0x7f6414197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:51.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.216+0000 7f6411d9b700 1 -- 172.21.15.8:0/2552545216 learned_addr learned my addr 172.21.15.8:0/2552545216 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:02:51.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.216+0000 7f6412d9d700 1 --2- 172.21.15.8:0/2552545216 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6414103030 0x7f641419e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:51.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.216+0000 7f6411d9b700 1 -- 172.21.15.8:0/2552545216 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6414103030 msgr2=0x7f641419e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:51.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.216+0000 7f6411d9b700 1 --2- 172.21.15.8:0/2552545216 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6414103030 0x7f641419e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:51.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.216+0000 7f6411d9b700 1 -- 172.21.15.8:0/2552545216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64141014a0 msgr2=0x7f6414197430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:51.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.216+0000 7f6411d9b700 1 --2- 172.21.15.8:0/2552545216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64141014a0 0x7f6414197430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:51.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.216+0000 7f6411d9b700 1 -- 172.21.15.8:0/2552545216 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f640c009d00 con 0x7f6414102690 2023-12-17T12:02:51.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.217+0000 7f6411d9b700 1 --2- 172.21.15.8:0/2552545216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6414102690 0x7f6414197970 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f640800d950 tx=0x7f640800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:51.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.217+0000 7f64037fe700 1 -- 172.21.15.8:0/2552545216 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6408009940 con 0x7f6414102690 2023-12-17T12:02:51.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.217+0000 7f64037fe700 1 -- 172.21.15.8:0/2552545216 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6408010460 con 0x7f6414102690 2023-12-17T12:02:51.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.217+0000 7f6418dff700 1 -- 172.21.15.8:0/2552545216 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f641419f510 con 0x7f6414102690 2023-12-17T12:02:51.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.217+0000 7f64037fe700 1 -- 172.21.15.8:0/2552545216 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f640800f620 con 0x7f6414102690 2023-12-17T12:02:51.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.217+0000 7f6418dff700 1 -- 172.21.15.8:0/2552545216 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f641419fa20 con 0x7f6414102690 2023-12-17T12:02:51.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.218+0000 7f6418dff700 1 -- 172.21.15.8:0/2552545216 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6414108920 con 0x7f6414102690 2023-12-17T12:02:51.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.220+0000 7f64037fe700 1 -- 172.21.15.8:0/2552545216 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7f64080105d0 con 0x7f6414102690 2023-12-17T12:02:51.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.221+0000 7f64037fe700 1 --2- 172.21.15.8:0/2552545216 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f63fc0a1480 0x7f63fc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:51.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.222+0000 7f64037fe700 1 -- 172.21.15.8:0/2552545216 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f64080cca50 con 0x7f6414102690 2023-12-17T12:02:51.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.222+0000 7f641259c700 1 --2- 172.21.15.8:0/2552545216 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f63fc0a1480 0x7f63fc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:51.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.222+0000 7f641259c700 1 --2- 172.21.15.8:0/2552545216 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f63fc0a1480 0x7f63fc0a3940 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f64141024f0 tx=0x7f640400b410 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:51.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.224+0000 7f64037fe700 1 -- 172.21.15.8:0/2552545216 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f6408096160 con 0x7f6414102690 2023-12-17T12:02:51.442 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.440+0000 7f6418dff700 1 -- 172.21.15.8:0/2552545216 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f641410cbb0 con 0x7f6414102690 2023-12-17T12:02:51.444 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.441+0000 7f64037fe700 1 -- 172.21.15.8:0/2552545216 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+22059 (secure 0 0 0) 0x7f6408016090 con 0x7f6414102690 2023-12-17T12:02:51.444 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:02:51.444 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":82,"fsid":"f43f508a-9cd2-11ee-95a5-87774f69a715","created":"2023-12-17T11:55:30.666634+0000","modified":"2023-12-17T12:02:50.176511+0000","last_up_change":"2023-12-17T12:02:04.656573+0000","last_in_change":"2023-12-17T12:01:45.526832+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:58:43.972745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-17T12:02:48.278153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-17T12:02:49.637968+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1f8acaf-a47b-4b74-a78d-e0b6be49a10e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6803","nonce":297519189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6805","nonce":297519189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6809","nonce":297519189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6807","nonce":297519189}]},"public_addr":"172.21.15.8:6803/297519189","cluster_addr":"172.21.15.8:6805/297519189","heartbeat_back_addr":"172.21.15.8:6809/297519189","heartbeat_front_addr":"172.21.15.8:6807/297519189","state":["exists","up"]},{"osd":1,"uuid":"d7138889-77de-43ba-b36b-7628f6f66bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6801","nonce":2496516573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6803","nonce":2496516573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6807","nonce":2496516573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6805","nonce":2496516573}]},"public_addr":"172.21.15.100:6801/2496516573","cluster_addr":"172.21.15.100:6803/2496516573","heartbeat_back_addr":"172.21.15.100:6807/2496516573","heartbeat_front_addr":"172.21.15.100:6805/2496516573","state":["exists","up"]},{"osd":2,"uuid":"ff452a6b-a11e-47be-9eaf-ec1001b51447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6801","nonce":2454925270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6803","nonce":2454925270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6807","nonce":2454925270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6805","nonce":2454925270}]},"public_addr":"172.21.15.186:6801/2454925270","cluster_addr":"172.21.15.186:6803/2454925270","heartbeat_back_addr":"172.21.15.186:6807/2454925270","heartbeat_front_addr":"172.21.15.186:6805/2454925270","state":["exists","up"]},{"osd":3,"uuid":"d19ab765-df7b-48c7-9012-8a3ac7d81aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6811","nonce":1141622701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6813","nonce":1141622701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6817","nonce":1141622701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6815","nonce":1141622701}]},"public_addr":"172.21.15.8:6811/1141622701","cluster_addr":"172.21.15.8:6813/1141622701","heartbeat_back_addr":"172.21.15.8:6817/1141622701","heartbeat_front_addr":"172.21.15.8:6815/1141622701","state":["exists","up"]},{"osd":4,"uuid":"8ecc3a01-f19a-40a7-93a2-8870116afe6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6809","nonce":1902152516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6811","nonce":1902152516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6815","nonce":1902152516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6813","nonce":1902152516}]},"public_addr":"172.21.15.100:6809/1902152516","cluster_addr":"172.21.15.100:6811/1902152516","heartbeat_back_addr":"172.21.15.100:6815/1902152516","heartbeat_front_addr":"172.21.15.100:6813/1902152516","state":["exists","up"]},{"osd":5,"uuid":"ac057cc9-2a27-4216-a7ae-fc60d9796eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6809","nonce":648349934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6811","nonce":648349934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6815","nonce":648349934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6813","nonce":648349934}]},"public_addr":"172.21.15.186:6809/648349934","cluster_addr":"172.21.15.186:6811/648349934","heartbeat_back_addr":"172.21.15.186:6815/648349934","heartbeat_front_addr":"172.21.15.186:6813/648349934","state":["exists","up"]},{"osd":6,"uuid":"bb5325e0-fe12-4bbc-96a9-86c228106a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6819","nonce":3266909294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6821","nonce":3266909294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6825","nonce":3266909294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6823","nonce":3266909294}]},"public_addr":"172.21.15.8:6819/3266909294","cluster_addr":"172.21.15.8:6821/3266909294","heartbeat_back_addr":"172.21.15.8:6825/3266909294","heartbeat_front_addr":"172.21.15.8:6823/3266909294","state":["exists","up"]},{"osd":7,"uuid":"48939d99-29dd-436b-b9f1-fdfe1ee26315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6817","nonce":1631494583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6819","nonce":1631494583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6823","nonce":1631494583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6821","nonce":1631494583}]},"public_addr":"172.21.15.100:6817/1631494583","cluster_addr":"172.21.15.100:6819/1631494583","heartbeat_back_addr":"172.21.15.100:6823/1631494583","heartbeat_front_addr":"172.21.15.100:6821/1631494583","state":["exists","up"]},{"osd":8,"uuid":"e3414f7f-7665-406f-89ec-79cbb3d3e274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6817","nonce":3569004799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6819","nonce":3569004799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6823","nonce":3569004799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6821","nonce":3569004799}]},"public_addr":"172.21.15.186:6817/3569004799","cluster_addr":"172.21.15.186:6819/3569004799","heartbeat_back_addr":"172.21.15.186:6823/3569004799","heartbeat_front_addr":"172.21.15.186:6821/3569004799","state":["exists","up"]},{"osd":9,"uuid":"b04f519d-6e44-4158-b6e1-aa4d64be3404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6827","nonce":3980647643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6829","nonce":3980647643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6833","nonce":3980647643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6831","nonce":3980647643}]},"public_addr":"172.21.15.8:6827/3980647643","cluster_addr":"172.21.15.8:6829/3980647643","heartbeat_back_addr":"172.21.15.8:6833/3980647643","heartbeat_front_addr":"172.21.15.8:6831/3980647643","state":["exists","up"]},{"osd":10,"uuid":"779fde04-620b-4b44-bd35-39be1470eec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6825","nonce":34112410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6827","nonce":34112410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6831","nonce":34112410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6829","nonce":34112410}]},"public_addr":"172.21.15.100:6825/34112410","cluster_addr":"172.21.15.100:6827/34112410","heartbeat_back_addr":"172.21.15.100:6831/34112410","heartbeat_front_addr":"172.21.15.100:6829/34112410","state":["exists","up"]},{"osd":11,"uuid":"6bbcb42f-aa99-44e4-9c3f-d818423eb5b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6825","nonce":3779371472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6827","nonce":3779371472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6831","nonce":3779371472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6829","nonce":3779371472}]},"public_addr":"172.21.15.186:6825/3779371472","cluster_addr":"172.21.15.186:6827/3779371472","heartbeat_back_addr":"172.21.15.186:6831/3779371472","heartbeat_front_addr":"172.21.15.186:6829/3779371472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:57:56.955667+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:58:18.433916+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:58:40.589590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:59:03.635858+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:59:25.544564+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:59:48.171593+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:00:10.876885+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:00:32.920759+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:00:55.273330+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:01:18.131720+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:01:40.259620+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:02:02.776536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/4074020814":"2023-12-18T11:56:27.362306+0000","172.21.15.8:6801/222068650":"2023-12-18T11:56:27.362306+0000","172.21.15.8:6801/4187398661":"2023-12-18T11:56:00.731492+0000","172.21.15.8:6800/222068650":"2023-12-18T11:56:27.362306+0000","172.21.15.8:6800/4187398661":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/2964092603":"2023-12-18T11:56:27.362306+0000","172.21.15.8:0/35186087":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/1429868241":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/174719729":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/2106317618":"2023-12-18T11:56:27.362306+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T12:02:51.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.444+0000 7f6418dff700 1 -- 172.21.15.8:0/2552545216 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f63fc0a1480 msgr2=0x7f63fc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:51.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.444+0000 7f6418dff700 1 --2- 172.21.15.8:0/2552545216 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f63fc0a1480 0x7f63fc0a3940 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f64141024f0 tx=0x7f640400b410 comp rx=0 tx=0).stop 2023-12-17T12:02:51.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.444+0000 7f6418dff700 1 -- 172.21.15.8:0/2552545216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6414102690 msgr2=0x7f6414197970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:51.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.444+0000 7f6418dff700 1 --2- 172.21.15.8:0/2552545216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6414102690 0x7f6414197970 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f640800d950 tx=0x7f640800dc60 comp rx=0 tx=0).stop 2023-12-17T12:02:51.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.444+0000 7f6418dff700 1 -- 172.21.15.8:0/2552545216 shutdown_connections 2023-12-17T12:02:51.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.444+0000 7f6418dff700 1 --2- 172.21.15.8:0/2552545216 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f63fc0a1480 0x7f63fc0a3940 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:51.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.444+0000 7f6418dff700 1 --2- 172.21.15.8:0/2552545216 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6414103030 0x7f641419e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:51.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.444+0000 7f6418dff700 1 --2- 172.21.15.8:0/2552545216 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f64141014a0 0x7f6414197430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:51.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.444+0000 7f6418dff700 1 --2- 172.21.15.8:0/2552545216 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6414102690 0x7f6414197970 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:51.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.444+0000 7f6418dff700 1 -- 172.21.15.8:0/2552545216 >> 172.21.15.8:0/2552545216 conn(0x7f64140fca10 msgr2=0x7f6414105a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:51.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.444+0000 7f6418dff700 1 -- 172.21.15.8:0/2552545216 shutdown_connections 2023-12-17T12:02:51.448 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.444+0000 7f6418dff700 1 -- 172.21.15.8:0/2552545216 wait complete. 2023-12-17T12:02:51.466 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T12:02:51.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.669+0000 7f051f1ff700 1 -- 172.21.15.8:0/765263195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0518104830 msgr2=0x7f0518106c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:51.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.669+0000 7f051f1ff700 1 --2- 172.21.15.8:0/765263195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0518104830 0x7f0518106c20 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0504009990 tx=0x7f0504009ca0 comp rx=0 tx=0).stop 2023-12-17T12:02:51.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.669+0000 7f051f1ff700 1 -- 172.21.15.8:0/765263195 shutdown_connections 2023-12-17T12:02:51.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.669+0000 7f051f1ff700 1 --2- 172.21.15.8:0/765263195 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0518107160 0x7f05181095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:51.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.669+0000 7f051f1ff700 1 --2- 172.21.15.8:0/765263195 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0518101f00 0x7f05181042f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:51.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.669+0000 7f051f1ff700 1 --2- 172.21.15.8:0/765263195 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0518104830 0x7f0518106c20 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:51.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.669+0000 7f051f1ff700 1 -- 172.21.15.8:0/765263195 >> 172.21.15.8:0/765263195 conn(0x7f05180fb8f0 msgr2=0x7f05180fdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:51.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.669+0000 7f051f1ff700 1 -- 172.21.15.8:0/765263195 shutdown_connections 2023-12-17T12:02:51.672 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.669+0000 7f051f1ff700 1 -- 172.21.15.8:0/765263195 wait complete. 2023-12-17T12:02:51.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.670+0000 7f051f1ff700 1 Processor -- start 2023-12-17T12:02:51.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.670+0000 7f051f1ff700 1 -- start start 2023-12-17T12:02:51.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.671+0000 7f051f1ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0518101f00 0x7f0518195d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:51.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.671+0000 7f051f1ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0518104830 0x7f05181962a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:51.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.671+0000 7f051f1ff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0518107160 0x7f05181928f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:51.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.671+0000 7f051f1ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0518193090 con 0x7f0518101f00 2023-12-17T12:02:51.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.671+0000 7f051f1ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0518193200 con 0x7f0518104830 2023-12-17T12:02:51.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.671+0000 7f051f1ff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05181933c0 con 0x7f0518107160 2023-12-17T12:02:51.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.671+0000 7f051cf9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0518101f00 0x7f0518195d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:51.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.671+0000 7f051cf9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0518101f00 0x7f0518195d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56238/0 (socket says 172.21.15.8:56238) 2023-12-17T12:02:51.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.671+0000 7f051cf9b700 1 -- 172.21.15.8:0/2671360000 learned_addr learned my addr 172.21.15.8:0/2671360000 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:02:51.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.671+0000 7f0517fff700 1 --2- 172.21.15.8:0/2671360000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0518104830 0x7f05181962a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:51.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.671+0000 7f051d79c700 1 --2- 172.21.15.8:0/2671360000 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0518107160 0x7f05181928f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:51.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.671+0000 7f051cf9b700 1 -- 172.21.15.8:0/2671360000 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0518107160 msgr2=0x7f05181928f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:51.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.671+0000 7f051cf9b700 1 --2- 172.21.15.8:0/2671360000 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0518107160 0x7f05181928f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:51.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.671+0000 7f051cf9b700 1 -- 172.21.15.8:0/2671360000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0518104830 msgr2=0x7f05181962a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:51.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.671+0000 7f051cf9b700 1 --2- 172.21.15.8:0/2671360000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0518104830 0x7f05181962a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:51.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.671+0000 7f051cf9b700 1 -- 172.21.15.8:0/2671360000 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05040095f0 con 0x7f0518101f00 2023-12-17T12:02:51.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.672+0000 7f051cf9b700 1 --2- 172.21.15.8:0/2671360000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0518101f00 0x7f0518195d60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f050c00e9a0 tx=0x7f050c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:51.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.672+0000 7f0515ffb700 1 -- 172.21.15.8:0/2671360000 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050c009790 con 0x7f0518101f00 2023-12-17T12:02:51.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.672+0000 7f0515ffb700 1 -- 172.21.15.8:0/2671360000 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f050c010430 con 0x7f0518101f00 2023-12-17T12:02:51.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.672+0000 7f051f1ff700 1 -- 172.21.15.8:0/2671360000 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05181a5ac0 con 0x7f0518101f00 2023-12-17T12:02:51.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.672+0000 7f0515ffb700 1 -- 172.21.15.8:0/2671360000 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050c00cea0 con 0x7f0518101f00 2023-12-17T12:02:51.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.672+0000 7f051f1ff700 1 -- 172.21.15.8:0/2671360000 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05181a5ff0 con 0x7f0518101f00 2023-12-17T12:02:51.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.673+0000 7f051f1ff700 1 -- 172.21.15.8:0/2671360000 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0518108d60 con 0x7f0518101f00 2023-12-17T12:02:51.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.675+0000 7f0515ffb700 1 -- 172.21.15.8:0/2671360000 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7f050c0105a0 con 0x7f0518101f00 2023-12-17T12:02:51.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.676+0000 7f0515ffb700 1 --2- 172.21.15.8:0/2671360000 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f05080a1500 0x7f05080a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:51.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.677+0000 7f0515ffb700 1 -- 172.21.15.8:0/2671360000 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f050c014070 con 0x7f0518101f00 2023-12-17T12:02:51.679 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.677+0000 7f0517fff700 1 --2- 172.21.15.8:0/2671360000 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f05080a1500 0x7f05080a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:51.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.677+0000 7f0517fff700 1 --2- 172.21.15.8:0/2671360000 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f05080a1500 0x7f05080a39c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0504005910 tx=0x7f050400b610 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:51.683 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.681+0000 7f0515ffb700 1 -- 172.21.15.8:0/2671360000 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f050c096480 con 0x7f0518101f00 2023-12-17T12:02:51.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:51 smithi008 ceph-mon[36830]: osdmap e82: 12 total, 12 up, 12 in 2023-12-17T12:02:51.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:51 smithi008 ceph-mon[36830]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-12-17T12:02:51.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:51 smithi008 ceph-mon[36830]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-12-17T12:02:51.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:51 smithi008 ceph-mon[36830]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-12-17T12:02:51.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:51 smithi008 ceph-mon[36830]: pgmap v264: 97 pgs: 21 active+clean, 41 creating+peering, 35 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:51.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:51 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/2552545216' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:02:51.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.895+0000 7f051f1ff700 1 -- 172.21.15.8:0/2671360000 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0518068230 con 0x7f0518101f00 2023-12-17T12:02:51.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.897+0000 7f0515ffb700 1 -- 172.21.15.8:0/2671360000 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22046 (secure 0 0 0) 0x7f050c099aa0 con 0x7f0518101f00 2023-12-17T12:02:51.900 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:02:51.900 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":83,"fsid":"f43f508a-9cd2-11ee-95a5-87774f69a715","created":"2023-12-17T11:55:30.666634+0000","modified":"2023-12-17T12:02:51.656934+0000","last_up_change":"2023-12-17T12:02:04.656573+0000","last_in_change":"2023-12-17T12:01:45.526832+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:58:43.972745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-17T12:02:48.278153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-17T12:02:49.637968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1f8acaf-a47b-4b74-a78d-e0b6be49a10e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6803","nonce":297519189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6805","nonce":297519189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6809","nonce":297519189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6807","nonce":297519189}]},"public_addr":"172.21.15.8:6803/297519189","cluster_addr":"172.21.15.8:6805/297519189","heartbeat_back_addr":"172.21.15.8:6809/297519189","heartbeat_front_addr":"172.21.15.8:6807/297519189","state":["exists","up"]},{"osd":1,"uuid":"d7138889-77de-43ba-b36b-7628f6f66bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6801","nonce":2496516573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6803","nonce":2496516573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6807","nonce":2496516573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6805","nonce":2496516573}]},"public_addr":"172.21.15.100:6801/2496516573","cluster_addr":"172.21.15.100:6803/2496516573","heartbeat_back_addr":"172.21.15.100:6807/2496516573","heartbeat_front_addr":"172.21.15.100:6805/2496516573","state":["exists","up"]},{"osd":2,"uuid":"ff452a6b-a11e-47be-9eaf-ec1001b51447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6801","nonce":2454925270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6803","nonce":2454925270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6807","nonce":2454925270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6805","nonce":2454925270}]},"public_addr":"172.21.15.186:6801/2454925270","cluster_addr":"172.21.15.186:6803/2454925270","heartbeat_back_addr":"172.21.15.186:6807/2454925270","heartbeat_front_addr":"172.21.15.186:6805/2454925270","state":["exists","up"]},{"osd":3,"uuid":"d19ab765-df7b-48c7-9012-8a3ac7d81aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6811","nonce":1141622701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6813","nonce":1141622701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6817","nonce":1141622701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6815","nonce":1141622701}]},"public_addr":"172.21.15.8:6811/1141622701","cluster_addr":"172.21.15.8:6813/1141622701","heartbeat_back_addr":"172.21.15.8:6817/1141622701","heartbeat_front_addr":"172.21.15.8:6815/1141622701","state":["exists","up"]},{"osd":4,"uuid":"8ecc3a01-f19a-40a7-93a2-8870116afe6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6809","nonce":1902152516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6811","nonce":1902152516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6815","nonce":1902152516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6813","nonce":1902152516}]},"public_addr":"172.21.15.100:6809/1902152516","cluster_addr":"172.21.15.100:6811/1902152516","heartbeat_back_addr":"172.21.15.100:6815/1902152516","heartbeat_front_addr":"172.21.15.100:6813/1902152516","state":["exists","up"]},{"osd":5,"uuid":"ac057cc9-2a27-4216-a7ae-fc60d9796eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6809","nonce":648349934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6811","nonce":648349934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6815","nonce":648349934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6813","nonce":648349934}]},"public_addr":"172.21.15.186:6809/648349934","cluster_addr":"172.21.15.186:6811/648349934","heartbeat_back_addr":"172.21.15.186:6815/648349934","heartbeat_front_addr":"172.21.15.186:6813/648349934","state":["exists","up"]},{"osd":6,"uuid":"bb5325e0-fe12-4bbc-96a9-86c228106a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6819","nonce":3266909294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6821","nonce":3266909294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6825","nonce":3266909294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6823","nonce":3266909294}]},"public_addr":"172.21.15.8:6819/3266909294","cluster_addr":"172.21.15.8:6821/3266909294","heartbeat_back_addr":"172.21.15.8:6825/3266909294","heartbeat_front_addr":"172.21.15.8:6823/3266909294","state":["exists","up"]},{"osd":7,"uuid":"48939d99-29dd-436b-b9f1-fdfe1ee26315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6817","nonce":1631494583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6819","nonce":1631494583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6823","nonce":1631494583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6821","nonce":1631494583}]},"public_addr":"172.21.15.100:6817/1631494583","cluster_addr":"172.21.15.100:6819/1631494583","heartbeat_back_addr":"172.21.15.100:6823/1631494583","heartbeat_front_addr":"172.21.15.100:6821/1631494583","state":["exists","up"]},{"osd":8,"uuid":"e3414f7f-7665-406f-89ec-79cbb3d3e274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6817","nonce":3569004799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6819","nonce":3569004799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6823","nonce":3569004799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6821","nonce":3569004799}]},"public_addr":"172.21.15.186:6817/3569004799","cluster_addr":"172.21.15.186:6819/3569004799","heartbeat_back_addr":"172.21.15.186:6823/3569004799","heartbeat_front_addr":"172.21.15.186:6821/3569004799","state":["exists","up"]},{"osd":9,"uuid":"b04f519d-6e44-4158-b6e1-aa4d64be3404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6827","nonce":3980647643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6829","nonce":3980647643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6833","nonce":3980647643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6831","nonce":3980647643}]},"public_addr":"172.21.15.8:6827/3980647643","cluster_addr":"172.21.15.8:6829/3980647643","heartbeat_back_addr":"172.21.15.8:6833/3980647643","heartbeat_front_addr":"172.21.15.8:6831/3980647643","state":["exists","up"]},{"osd":10,"uuid":"779fde04-620b-4b44-bd35-39be1470eec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6825","nonce":34112410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6827","nonce":34112410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6831","nonce":34112410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6829","nonce":34112410}]},"public_addr":"172.21.15.100:6825/34112410","cluster_addr":"172.21.15.100:6827/34112410","heartbeat_back_addr":"172.21.15.100:6831/34112410","heartbeat_front_addr":"172.21.15.100:6829/34112410","state":["exists","up"]},{"osd":11,"uuid":"6bbcb42f-aa99-44e4-9c3f-d818423eb5b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6825","nonce":3779371472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6827","nonce":3779371472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6831","nonce":3779371472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6829","nonce":3779371472}]},"public_addr":"172.21.15.186:6825/3779371472","cluster_addr":"172.21.15.186:6827/3779371472","heartbeat_back_addr":"172.21.15.186:6831/3779371472","heartbeat_front_addr":"172.21.15.186:6829/3779371472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:57:56.955667+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:58:18.433916+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:58:40.589590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:59:03.635858+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:59:25.544564+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:59:48.171593+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:00:10.876885+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:00:32.920759+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:00:55.273330+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:01:18.131720+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:01:40.259620+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:02:02.776536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/4074020814":"2023-12-18T11:56:27.362306+0000","172.21.15.8:6801/222068650":"2023-12-18T11:56:27.362306+0000","172.21.15.8:6801/4187398661":"2023-12-18T11:56:00.731492+0000","172.21.15.8:6800/222068650":"2023-12-18T11:56:27.362306+0000","172.21.15.8:6800/4187398661":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/2964092603":"2023-12-18T11:56:27.362306+0000","172.21.15.8:0/35186087":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/1429868241":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/174719729":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/2106317618":"2023-12-18T11:56:27.362306+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T12:02:51.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.899+0000 7f051f1ff700 1 -- 172.21.15.8:0/2671360000 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f05080a1500 msgr2=0x7f05080a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:51.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.899+0000 7f051f1ff700 1 --2- 172.21.15.8:0/2671360000 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f05080a1500 0x7f05080a39c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0504005910 tx=0x7f050400b610 comp rx=0 tx=0).stop 2023-12-17T12:02:51.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.899+0000 7f051f1ff700 1 -- 172.21.15.8:0/2671360000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0518101f00 msgr2=0x7f0518195d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:51.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.899+0000 7f051f1ff700 1 --2- 172.21.15.8:0/2671360000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0518101f00 0x7f0518195d60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f050c00e9a0 tx=0x7f050c00ecb0 comp rx=0 tx=0).stop 2023-12-17T12:02:51.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.900+0000 7f051f1ff700 1 -- 172.21.15.8:0/2671360000 shutdown_connections 2023-12-17T12:02:51.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.900+0000 7f051f1ff700 1 --2- 172.21.15.8:0/2671360000 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f05080a1500 0x7f05080a39c0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:51.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.900+0000 7f051f1ff700 1 --2- 172.21.15.8:0/2671360000 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0518107160 0x7f05181928f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:51.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.900+0000 7f051f1ff700 1 --2- 172.21.15.8:0/2671360000 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0518101f00 0x7f0518195d60 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:51.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.900+0000 7f051f1ff700 1 --2- 172.21.15.8:0/2671360000 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0518104830 0x7f05181962a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:51.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.900+0000 7f051f1ff700 1 -- 172.21.15.8:0/2671360000 >> 172.21.15.8:0/2671360000 conn(0x7f05180fb8f0 msgr2=0x7f0518101680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:51.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.900+0000 7f051f1ff700 1 -- 172.21.15.8:0/2671360000 shutdown_connections 2023-12-17T12:02:51.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:51.900+0000 7f051f1ff700 1 -- 172.21.15.8:0/2671360000 wait complete. 2023-12-17T12:02:51.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:51 smithi100 ceph-mon[41266]: osdmap e82: 12 total, 12 up, 12 in 2023-12-17T12:02:51.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:51 smithi100 ceph-mon[41266]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-12-17T12:02:51.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:51 smithi100 ceph-mon[41266]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-12-17T12:02:51.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:51 smithi100 ceph-mon[41266]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-12-17T12:02:51.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:51 smithi100 ceph-mon[41266]: pgmap v264: 97 pgs: 21 active+clean, 41 creating+peering, 35 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:51.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:51 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/2552545216' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:02:51.922 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-17T12:02:51.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:51 smithi186 ceph-mon[41182]: osdmap e82: 12 total, 12 up, 12 in 2023-12-17T12:02:51.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:51 smithi186 ceph-mon[41182]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-12-17T12:02:51.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:51 smithi186 ceph-mon[41182]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-12-17T12:02:51.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:51 smithi186 ceph-mon[41182]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-12-17T12:02:51.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:51 smithi186 ceph-mon[41182]: pgmap v264: 97 pgs: 21 active+clean, 41 creating+peering, 35 unknown; 577 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-12-17T12:02:51.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:51 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/2552545216' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:02:52.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.136+0000 7f487a7ff700 1 -- 172.21.15.8:0/504528813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4874102790 msgr2=0x7f4874102bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:52.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.136+0000 7f487a7ff700 1 --2- 172.21.15.8:0/504528813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4874102790 0x7f4874102bf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f485c0099c0 tx=0x7f485c009cd0 comp rx=0 tx=0).stop 2023-12-17T12:02:52.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.136+0000 7f487a7ff700 1 -- 172.21.15.8:0/504528813 shutdown_connections 2023-12-17T12:02:52.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.136+0000 7f487a7ff700 1 --2- 172.21.15.8:0/504528813 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4874103130 0x7f48741099e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:52.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.136+0000 7f487a7ff700 1 --2- 172.21.15.8:0/504528813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f48741015a0 0x7f48741019c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:52.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.136+0000 7f487a7ff700 1 --2- 172.21.15.8:0/504528813 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4874102790 0x7f4874102bf0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:52.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.136+0000 7f487a7ff700 1 -- 172.21.15.8:0/504528813 >> 172.21.15.8:0/504528813 conn(0x7f48740fcb10 msgr2=0x7f48740fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:52.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.136+0000 7f487a7ff700 1 -- 172.21.15.8:0/504528813 shutdown_connections 2023-12-17T12:02:52.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.136+0000 7f487a7ff700 1 -- 172.21.15.8:0/504528813 wait complete. 2023-12-17T12:02:52.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.137+0000 7f487a7ff700 1 Processor -- start 2023-12-17T12:02:52.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.137+0000 7f487a7ff700 1 -- start start 2023-12-17T12:02:52.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.138+0000 7f487a7ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48741015a0 0x7f4874197470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:52.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.138+0000 7f487a7ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4874102790 0x7f48741979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:52.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.138+0000 7f487a7ff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4874103130 0x7f487419e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:52.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.138+0000 7f487a7ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487419efa0 con 0x7f48741015a0 2023-12-17T12:02:52.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.138+0000 7f487a7ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487419f0e0 con 0x7f4874102790 2023-12-17T12:02:52.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.138+0000 7f487a7ff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f487419f270 con 0x7f4874103130 2023-12-17T12:02:52.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.138+0000 7f4873fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48741015a0 0x7f4874197470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:52.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.138+0000 7f4873fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48741015a0 0x7f4874197470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56250/0 (socket says 172.21.15.8:56250) 2023-12-17T12:02:52.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.138+0000 7f4873fff700 1 -- 172.21.15.8:0/1032238453 learned_addr learned my addr 172.21.15.8:0/1032238453 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:02:52.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.138+0000 7f4878d9c700 1 --2- 172.21.15.8:0/1032238453 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4874103130 0x7f487419e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:52.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.138+0000 7f486bfff700 1 --2- 172.21.15.8:0/1032238453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4874102790 0x7f48741979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:52.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.138+0000 7f4873fff700 1 -- 172.21.15.8:0/1032238453 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4874103130 msgr2=0x7f487419e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:52.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.138+0000 7f4873fff700 1 --2- 172.21.15.8:0/1032238453 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4874103130 0x7f487419e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:52.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.138+0000 7f4873fff700 1 -- 172.21.15.8:0/1032238453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4874102790 msgr2=0x7f48741979b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:52.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.138+0000 7f4873fff700 1 --2- 172.21.15.8:0/1032238453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4874102790 0x7f48741979b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:52.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.138+0000 7f4873fff700 1 -- 172.21.15.8:0/1032238453 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f486c009c40 con 0x7f48741015a0 2023-12-17T12:02:52.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.138+0000 7f486bfff700 1 --2- 172.21.15.8:0/1032238453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4874102790 0x7f48741979b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T12:02:52.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.139+0000 7f4873fff700 1 --2- 172.21.15.8:0/1032238453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48741015a0 0x7f4874197470 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f486400e970 tx=0x7f486400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:52.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.139+0000 7f4871ffb700 1 -- 172.21.15.8:0/1032238453 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4864009790 con 0x7f48741015a0 2023-12-17T12:02:52.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.139+0000 7f4871ffb700 1 -- 172.21.15.8:0/1032238453 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f486400eeb0 con 0x7f48741015a0 2023-12-17T12:02:52.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.139+0000 7f4871ffb700 1 -- 172.21.15.8:0/1032238453 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4864003c50 con 0x7f48741015a0 2023-12-17T12:02:52.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.139+0000 7f487a7ff700 1 -- 172.21.15.8:0/1032238453 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f485c0095f0 con 0x7f48741015a0 2023-12-17T12:02:52.143 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.139+0000 7f487a7ff700 1 -- 172.21.15.8:0/1032238453 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f487419f880 con 0x7f48741015a0 2023-12-17T12:02:52.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.140+0000 7f487a7ff700 1 -- 172.21.15.8:0/1032238453 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4874108ac0 con 0x7f48741015a0 2023-12-17T12:02:52.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.142+0000 7f4871ffb700 1 -- 172.21.15.8:0/1032238453 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7f4864003db0 con 0x7f48741015a0 2023-12-17T12:02:52.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.144+0000 7f4871ffb700 1 --2- 172.21.15.8:0/1032238453 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f48600a1480 0x7f48600a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:52.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.145+0000 7f4871ffb700 1 -- 172.21.15.8:0/1032238453 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f4864014070 con 0x7f48741015a0 2023-12-17T12:02:52.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.145+0000 7f486bfff700 1 --2- 172.21.15.8:0/1032238453 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f48600a1480 0x7f48600a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:52.147 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.145+0000 7f486bfff700 1 --2- 172.21.15.8:0/1032238453 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f48600a1480 0x7f48600a3940 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f485c00b580 tx=0x7f485c01a040 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:52.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.149+0000 7f4871ffb700 1 -- 172.21.15.8:0/1032238453 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f48640965a0 con 0x7f48741015a0 2023-12-17T12:02:52.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.410+0000 7f487a7ff700 1 -- 172.21.15.8:0/1032238453 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4874068310 con 0x7f48741015a0 2023-12-17T12:02:52.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:52 smithi186 ceph-mon[41182]: osdmap e83: 12 total, 12 up, 12 in 2023-12-17T12:02:52.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:52 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/2671360000' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:02:52.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:52 smithi186 ceph-mon[41182]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-12-17T12:02:52.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:52 smithi186 ceph-mon[41182]: Cluster is now healthy 2023-12-17T12:02:52.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:52 smithi186 ceph-mon[41182]: mds.? [v2:172.21.15.100:6838/3921737538,v1:172.21.15.100:6839/3921737538] up:active 2023-12-17T12:02:52.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:52 smithi186 ceph-mon[41182]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-17T12:02:52.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:52 smithi186 ceph-mon[41182]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-17T12:02:52.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:52 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/1032238453' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-12-17T12:02:52.987 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.984+0000 7f4871ffb700 1 -- 172.21.15.8:0/1032238453 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4864099bc0 con 0x7f48741015a0 2023-12-17T12:02:52.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.988+0000 7f487a7ff700 1 -- 172.21.15.8:0/1032238453 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f48600a1480 msgr2=0x7f48600a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:52.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.988+0000 7f487a7ff700 1 --2- 172.21.15.8:0/1032238453 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f48600a1480 0x7f48600a3940 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f485c00b580 tx=0x7f485c01a040 comp rx=0 tx=0).stop 2023-12-17T12:02:52.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.988+0000 7f487a7ff700 1 -- 172.21.15.8:0/1032238453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48741015a0 msgr2=0x7f4874197470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:52.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.988+0000 7f487a7ff700 1 --2- 172.21.15.8:0/1032238453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48741015a0 0x7f4874197470 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f486400e970 tx=0x7f486400ed30 comp rx=0 tx=0).stop 2023-12-17T12:02:52.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.988+0000 7f487a7ff700 1 -- 172.21.15.8:0/1032238453 shutdown_connections 2023-12-17T12:02:52.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.988+0000 7f487a7ff700 1 --2- 172.21.15.8:0/1032238453 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f48600a1480 0x7f48600a3940 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:52.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.988+0000 7f487a7ff700 1 --2- 172.21.15.8:0/1032238453 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4874103130 0x7f487419e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:52.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.988+0000 7f487a7ff700 1 --2- 172.21.15.8:0/1032238453 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f48741015a0 0x7f4874197470 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:52.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.988+0000 7f487a7ff700 1 --2- 172.21.15.8:0/1032238453 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4874102790 0x7f48741979b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:52.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.988+0000 7f487a7ff700 1 -- 172.21.15.8:0/1032238453 >> 172.21.15.8:0/1032238453 conn(0x7f48740fcb10 msgr2=0x7f4874105c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:52.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.988+0000 7f487a7ff700 1 -- 172.21.15.8:0/1032238453 shutdown_connections 2023-12-17T12:02:52.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:52.988+0000 7f487a7ff700 1 -- 172.21.15.8:0/1032238453 wait complete. 2023-12-17T12:02:52.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:52 smithi008 ceph-mon[36830]: osdmap e83: 12 total, 12 up, 12 in 2023-12-17T12:02:52.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:52 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/2671360000' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:02:52.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:52 smithi008 ceph-mon[36830]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-12-17T12:02:52.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:52 smithi008 ceph-mon[36830]: Cluster is now healthy 2023-12-17T12:02:52.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:52 smithi008 ceph-mon[36830]: mds.? [v2:172.21.15.100:6838/3921737538,v1:172.21.15.100:6839/3921737538] up:active 2023-12-17T12:02:52.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:52 smithi008 ceph-mon[36830]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-17T12:02:52.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:52 smithi008 ceph-mon[36830]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-17T12:02:52.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:52 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/1032238453' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-12-17T12:02:53.013 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2023-12-17T12:02:53.014 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2023-12-17T12:02:53.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:52 smithi100 ceph-mon[41266]: osdmap e83: 12 total, 12 up, 12 in 2023-12-17T12:02:53.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:52 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/2671360000' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:02:53.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:52 smithi100 ceph-mon[41266]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2023-12-17T12:02:53.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:52 smithi100 ceph-mon[41266]: Cluster is now healthy 2023-12-17T12:02:53.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:52 smithi100 ceph-mon[41266]: mds.? [v2:172.21.15.100:6838/3921737538,v1:172.21.15.100:6839/3921737538] up:active 2023-12-17T12:02:53.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:52 smithi100 ceph-mon[41266]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-17T12:02:53.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:52 smithi100 ceph-mon[41266]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-17T12:02:53.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:52 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/1032238453' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-12-17T12:02:53.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.235+0000 7f4e515ff700 1 -- 172.21.15.8:0/1889739852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e4c102790 msgr2=0x7f4e4c102bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:53.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.235+0000 7f4e515ff700 1 --2- 172.21.15.8:0/1889739852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e4c102790 0x7f4e4c102bf0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f4e400099c0 tx=0x7f4e40009cd0 comp rx=0 tx=0).stop 2023-12-17T12:02:53.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.235+0000 7f4e515ff700 1 -- 172.21.15.8:0/1889739852 shutdown_connections 2023-12-17T12:02:53.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.235+0000 7f4e515ff700 1 --2- 172.21.15.8:0/1889739852 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e4c103130 0x7f4e4c1099e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:53.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.235+0000 7f4e515ff700 1 --2- 172.21.15.8:0/1889739852 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e4c1015a0 0x7f4e4c1019c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:53.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.235+0000 7f4e515ff700 1 --2- 172.21.15.8:0/1889739852 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e4c102790 0x7f4e4c102bf0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:53.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.235+0000 7f4e515ff700 1 -- 172.21.15.8:0/1889739852 >> 172.21.15.8:0/1889739852 conn(0x7f4e4c0fcb10 msgr2=0x7f4e4c0fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:53.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.235+0000 7f4e515ff700 1 -- 172.21.15.8:0/1889739852 shutdown_connections 2023-12-17T12:02:53.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.235+0000 7f4e515ff700 1 -- 172.21.15.8:0/1889739852 wait complete. 2023-12-17T12:02:53.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.236+0000 7f4e515ff700 1 Processor -- start 2023-12-17T12:02:53.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.236+0000 7f4e515ff700 1 -- start start 2023-12-17T12:02:53.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.236+0000 7f4e515ff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e4c1015a0 0x7f4e4c199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:53.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.236+0000 7f4e515ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e4c102790 0x7f4e4c199ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:53.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.236+0000 7f4e515ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e4c103130 0x7f4e4c1a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:53.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.236+0000 7f4e515ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c1a10a0 con 0x7f4e4c102790 2023-12-17T12:02:53.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.236+0000 7f4e515ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c1a11e0 con 0x7f4e4c103130 2023-12-17T12:02:53.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.236+0000 7f4e515ff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e4c1a1370 con 0x7f4e4c1015a0 2023-12-17T12:02:53.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.236+0000 7f4e4a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e4c102790 0x7f4e4c199ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:53.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.237+0000 7f4e4a7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e4c102790 0x7f4e4c199ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56272/0 (socket says 172.21.15.8:56272) 2023-12-17T12:02:53.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.237+0000 7f4e4a7fc700 1 -- 172.21.15.8:0/909665192 learned_addr learned my addr 172.21.15.8:0/909665192 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:02:53.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.237+0000 7f4e4b7fe700 1 --2- 172.21.15.8:0/909665192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e4c103130 0x7f4e4c1a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:53.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.237+0000 7f4e4affd700 1 --2- 172.21.15.8:0/909665192 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e4c1015a0 0x7f4e4c199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:53.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.237+0000 7f4e4a7fc700 1 -- 172.21.15.8:0/909665192 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e4c1015a0 msgr2=0x7f4e4c199570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:53.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.237+0000 7f4e4a7fc700 1 --2- 172.21.15.8:0/909665192 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e4c1015a0 0x7f4e4c199570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:53.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.237+0000 7f4e4a7fc700 1 -- 172.21.15.8:0/909665192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e4c103130 msgr2=0x7f4e4c1a0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:53.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.237+0000 7f4e4a7fc700 1 --2- 172.21.15.8:0/909665192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e4c103130 0x7f4e4c1a0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:53.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.237+0000 7f4e4a7fc700 1 -- 172.21.15.8:0/909665192 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e400095f0 con 0x7f4e4c102790 2023-12-17T12:02:53.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.237+0000 7f4e4b7fe700 1 --2- 172.21.15.8:0/909665192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e4c103130 0x7f4e4c1a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T12:02:53.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.237+0000 7f4e4affd700 1 --2- 172.21.15.8:0/909665192 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e4c1015a0 0x7f4e4c199570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T12:02:53.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.237+0000 7f4e4a7fc700 1 --2- 172.21.15.8:0/909665192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e4c102790 0x7f4e4c199ab0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4e40000c00 tx=0x7f4e40003b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:53.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.237+0000 7f4e33fff700 1 -- 172.21.15.8:0/909665192 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4001d070 con 0x7f4e4c102790 2023-12-17T12:02:53.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.237+0000 7f4e33fff700 1 -- 172.21.15.8:0/909665192 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4e4000bd30 con 0x7f4e4c102790 2023-12-17T12:02:53.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.237+0000 7f4e33fff700 1 -- 172.21.15.8:0/909665192 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e40022e50 con 0x7f4e4c102790 2023-12-17T12:02:53.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.237+0000 7f4e515ff700 1 -- 172.21.15.8:0/909665192 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e4c1a15f0 con 0x7f4e4c102790 2023-12-17T12:02:53.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.238+0000 7f4e515ff700 1 -- 172.21.15.8:0/909665192 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e4c1a1a10 con 0x7f4e4c102790 2023-12-17T12:02:53.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.239+0000 7f4e515ff700 1 -- 172.21.15.8:0/909665192 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e4c068310 con 0x7f4e4c102790 2023-12-17T12:02:53.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.240+0000 7f4e33fff700 1 -- 172.21.15.8:0/909665192 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7f4e40004080 con 0x7f4e4c102790 2023-12-17T12:02:53.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.242+0000 7f4e33fff700 1 --2- 172.21.15.8:0/909665192 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4e340a1500 0x7f4e340a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:53.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.242+0000 7f4e33fff700 1 -- 172.21.15.8:0/909665192 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f4e400cdfe0 con 0x7f4e4c102790 2023-12-17T12:02:53.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.242+0000 7f4e4affd700 1 --2- 172.21.15.8:0/909665192 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4e340a1500 0x7f4e340a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:53.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.243+0000 7f4e4affd700 1 --2- 172.21.15.8:0/909665192 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4e340a1500 0x7f4e340a39c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c005fd0 tx=0x7f4e3c005e40 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:53.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.245+0000 7f4e33fff700 1 -- 172.21.15.8:0/909665192 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4e4005d2f0 con 0x7f4e4c102790 2023-12-17T12:02:53.511 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.509+0000 7f4e515ff700 1 -- 172.21.15.8:0/909665192 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) v1 -- 0x7f4e4c1a1d70 con 0x7f4e4c102790 2023-12-17T12:02:53.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.990+0000 7f4e33fff700 1 -- 172.21.15.8:0/909665192 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v18) v1 ==== 105+0+0 (secure 0 0 0) 0x7f4e40097780 con 0x7f4e4c102790 2023-12-17T12:02:53.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.994+0000 7f4e515ff700 1 -- 172.21.15.8:0/909665192 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4e340a1500 msgr2=0x7f4e340a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:53.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.994+0000 7f4e515ff700 1 --2- 172.21.15.8:0/909665192 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4e340a1500 0x7f4e340a39c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c005fd0 tx=0x7f4e3c005e40 comp rx=0 tx=0).stop 2023-12-17T12:02:53.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.994+0000 7f4e515ff700 1 -- 172.21.15.8:0/909665192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e4c102790 msgr2=0x7f4e4c199ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:53.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.994+0000 7f4e515ff700 1 --2- 172.21.15.8:0/909665192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e4c102790 0x7f4e4c199ab0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4e40000c00 tx=0x7f4e40003b00 comp rx=0 tx=0).stop 2023-12-17T12:02:53.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.994+0000 7f4e515ff700 1 -- 172.21.15.8:0/909665192 shutdown_connections 2023-12-17T12:02:53.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.994+0000 7f4e515ff700 1 --2- 172.21.15.8:0/909665192 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4e340a1500 0x7f4e340a39c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:53.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.994+0000 7f4e515ff700 1 --2- 172.21.15.8:0/909665192 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4e4c103130 0x7f4e4c1a0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:53.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.994+0000 7f4e515ff700 1 --2- 172.21.15.8:0/909665192 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e4c1015a0 0x7f4e4c199570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:53.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.994+0000 7f4e515ff700 1 --2- 172.21.15.8:0/909665192 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4e4c102790 0x7f4e4c199ab0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:53.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.994+0000 7f4e515ff700 1 -- 172.21.15.8:0/909665192 >> 172.21.15.8:0/909665192 conn(0x7f4e4c0fcb10 msgr2=0x7f4e4c073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:53.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.994+0000 7f4e515ff700 1 -- 172.21.15.8:0/909665192 shutdown_connections 2023-12-17T12:02:53.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:53.995+0000 7f4e515ff700 1 -- 172.21.15.8:0/909665192 wait complete. 2023-12-17T12:02:54.023 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2023-12-17T12:02:54.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.232+0000 7fdb901ff700 1 -- 172.21.15.8:0/4231054731 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb881037b0 msgr2=0x7fdb88103bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:54.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.232+0000 7fdb901ff700 1 --2- 172.21.15.8:0/4231054731 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb881037b0 0x7fdb88103bd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdb840099c0 tx=0x7fdb84009cd0 comp rx=0 tx=0).stop 2023-12-17T12:02:54.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.232+0000 7fdb901ff700 1 -- 172.21.15.8:0/4231054731 shutdown_connections 2023-12-17T12:02:54.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.232+0000 7fdb901ff700 1 --2- 172.21.15.8:0/4231054731 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb88105340 0x7fdb8810bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:54.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.232+0000 7fdb901ff700 1 --2- 172.21.15.8:0/4231054731 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb881037b0 0x7fdb88103bd0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:54.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.232+0000 7fdb901ff700 1 --2- 172.21.15.8:0/4231054731 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb881049a0 0x7fdb88104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:54.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.232+0000 7fdb901ff700 1 -- 172.21.15.8:0/4231054731 >> 172.21.15.8:0/4231054731 conn(0x7fdb880fed20 msgr2=0x7fdb88101160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:54.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.232+0000 7fdb901ff700 1 -- 172.21.15.8:0/4231054731 shutdown_connections 2023-12-17T12:02:54.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.232+0000 7fdb901ff700 1 -- 172.21.15.8:0/4231054731 wait complete. 2023-12-17T12:02:54.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.233+0000 7fdb901ff700 1 Processor -- start 2023-12-17T12:02:54.237 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.234+0000 7fdb901ff700 1 -- start start 2023-12-17T12:02:54.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.234+0000 7fdb901ff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb881037b0 0x7fdb881996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:54.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.234+0000 7fdb901ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb881049a0 0x7fdb88199be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:54.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.234+0000 7fdb901ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb88105340 0x7fdb881a0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:54.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.234+0000 7fdb901ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb881a11d0 con 0x7fdb881049a0 2023-12-17T12:02:54.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.234+0000 7fdb901ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb881a1310 con 0x7fdb88105340 2023-12-17T12:02:54.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.234+0000 7fdb901ff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb881a14a0 con 0x7fdb881037b0 2023-12-17T12:02:54.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.234+0000 7fdb8d79a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb881049a0 0x7fdb88199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:54.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.234+0000 7fdb8df9b700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb881037b0 0x7fdb881996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:54.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.235+0000 7fdb8df9b700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb881037b0 0x7fdb881996a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:56534/0 (socket says 172.21.15.8:56534) 2023-12-17T12:02:54.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.235+0000 7fdb8df9b700 1 -- 172.21.15.8:0/4193686358 learned_addr learned my addr 172.21.15.8:0/4193686358 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:02:54.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.235+0000 7fdb8d79a700 1 --2- 172.21.15.8:0/4193686358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb881049a0 0x7fdb88199be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56286/0 (socket says 172.21.15.8:56286) 2023-12-17T12:02:54.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.235+0000 7fdb8e79c700 1 --2- 172.21.15.8:0/4193686358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb88105340 0x7fdb881a0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:54.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.235+0000 7fdb8d79a700 1 -- 172.21.15.8:0/4193686358 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb881037b0 msgr2=0x7fdb881996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:54.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.235+0000 7fdb8d79a700 1 --2- 172.21.15.8:0/4193686358 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb881037b0 0x7fdb881996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:54.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.235+0000 7fdb8d79a700 1 -- 172.21.15.8:0/4193686358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb88105340 msgr2=0x7fdb881a0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:54.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.235+0000 7fdb8d79a700 1 --2- 172.21.15.8:0/4193686358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb88105340 0x7fdb881a0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:54.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.235+0000 7fdb8d79a700 1 -- 172.21.15.8:0/4193686358 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb840095f0 con 0x7fdb881049a0 2023-12-17T12:02:54.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.235+0000 7fdb8e79c700 1 --2- 172.21.15.8:0/4193686358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb88105340 0x7fdb881a0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T12:02:54.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.236+0000 7fdb8d79a700 1 --2- 172.21.15.8:0/4193686358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb881049a0 0x7fdb88199be0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdb7800d950 tx=0x7fdb7800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:54.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.236+0000 7fdb7effd700 1 -- 172.21.15.8:0/4193686358 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7800f890 con 0x7fdb881049a0 2023-12-17T12:02:54.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.236+0000 7fdb7effd700 1 -- 172.21.15.8:0/4193686358 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb7800fe80 con 0x7fdb881049a0 2023-12-17T12:02:54.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.236+0000 7fdb7effd700 1 -- 172.21.15.8:0/4193686358 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7800e3b0 con 0x7fdb881049a0 2023-12-17T12:02:54.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.236+0000 7fdb901ff700 1 -- 172.21.15.8:0/4193686358 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb881a1780 con 0x7fdb881049a0 2023-12-17T12:02:54.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.236+0000 7fdb901ff700 1 -- 172.21.15.8:0/4193686358 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb881a1c90 con 0x7fdb881049a0 2023-12-17T12:02:54.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.237+0000 7fdb901ff700 1 -- 172.21.15.8:0/4193686358 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb8810ac70 con 0x7fdb881049a0 2023-12-17T12:02:54.241 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.239+0000 7fdb7effd700 1 -- 172.21.15.8:0/4193686358 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7fdb7800f9f0 con 0x7fdb881049a0 2023-12-17T12:02:54.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.240+0000 7fdb7effd700 1 --2- 172.21.15.8:0/4193686358 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fdb740a1500 0x7fdb740a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:54.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.240+0000 7fdb7effd700 1 -- 172.21.15.8:0/4193686358 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fdb780cc8a0 con 0x7fdb881049a0 2023-12-17T12:02:54.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.241+0000 7fdb8df9b700 1 --2- 172.21.15.8:0/4193686358 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fdb740a1500 0x7fdb740a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:54.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.241+0000 7fdb8df9b700 1 --2- 172.21.15.8:0/4193686358 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fdb740a1500 0x7fdb740a39c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdb8400c010 tx=0x7fdb84005e80 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:54.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:53 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/1032238453' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-12-17T12:02:54.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:53 smithi008 ceph-mon[36830]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-17T12:02:54.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:53 smithi008 ceph-mon[36830]: pgmap v266: 97 pgs: 52 active+clean, 41 creating+peering, 4 unknown; 578 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 843 B/s wr, 6 op/s 2023-12-17T12:02:54.246 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:53 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/909665192' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-12-17T12:02:54.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.245+0000 7fdb7effd700 1 -- 172.21.15.8:0/4193686358 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fdb78095fb0 con 0x7fdb881049a0 2023-12-17T12:02:54.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:53 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/1032238453' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-12-17T12:02:54.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:53 smithi100 ceph-mon[41266]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-17T12:02:54.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:53 smithi100 ceph-mon[41266]: pgmap v266: 97 pgs: 52 active+clean, 41 creating+peering, 4 unknown; 578 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 843 B/s wr, 6 op/s 2023-12-17T12:02:54.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:53 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/909665192' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-12-17T12:02:54.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:53 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/1032238453' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-12-17T12:02:54.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:53 smithi186 ceph-mon[41182]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-17T12:02:54.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:53 smithi186 ceph-mon[41182]: pgmap v266: 97 pgs: 52 active+clean, 41 creating+peering, 4 unknown; 578 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 843 B/s wr, 6 op/s 2023-12-17T12:02:54.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:53 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/909665192' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2023-12-17T12:02:54.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.505+0000 7fdb901ff700 1 -- 172.21.15.8:0/4193686358 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7fdb88068310 con 0x7fdb881049a0 2023-12-17T12:02:54.915 INFO:journalctl@ceph.mds.b.smithi100.stdout:Dec 17 12:02:54 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-b[76415]: 2023-12-17T12:02:54.444+0000 7f06b8dcd700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-17T12:02:54.974 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.972+0000 7fdb7effd700 1 -- 172.21.15.8:0/4193686358 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v20) v1 ==== 121+0+0 (secure 0 0 0) 0x7fdb780160c0 con 0x7fdb881049a0 2023-12-17T12:02:54.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.976+0000 7fdb901ff700 1 -- 172.21.15.8:0/4193686358 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fdb740a1500 msgr2=0x7fdb740a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:54.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.976+0000 7fdb901ff700 1 --2- 172.21.15.8:0/4193686358 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fdb740a1500 0x7fdb740a39c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdb8400c010 tx=0x7fdb84005e80 comp rx=0 tx=0).stop 2023-12-17T12:02:54.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.976+0000 7fdb901ff700 1 -- 172.21.15.8:0/4193686358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb881049a0 msgr2=0x7fdb88199be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:54.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.976+0000 7fdb901ff700 1 --2- 172.21.15.8:0/4193686358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb881049a0 0x7fdb88199be0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdb7800d950 tx=0x7fdb7800dc60 comp rx=0 tx=0).stop 2023-12-17T12:02:54.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.976+0000 7fdb901ff700 1 -- 172.21.15.8:0/4193686358 shutdown_connections 2023-12-17T12:02:54.979 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.976+0000 7fdb901ff700 1 --2- 172.21.15.8:0/4193686358 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fdb740a1500 0x7fdb740a39c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:54.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.976+0000 7fdb901ff700 1 --2- 172.21.15.8:0/4193686358 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdb88105340 0x7fdb881a0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:54.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.976+0000 7fdb901ff700 1 --2- 172.21.15.8:0/4193686358 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb881037b0 0x7fdb881996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:54.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.976+0000 7fdb901ff700 1 --2- 172.21.15.8:0/4193686358 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdb881049a0 0x7fdb88199be0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:54.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.976+0000 7fdb901ff700 1 -- 172.21.15.8:0/4193686358 >> 172.21.15.8:0/4193686358 conn(0x7fdb880fed20 msgr2=0x7fdb88107db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:54.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.976+0000 7fdb901ff700 1 -- 172.21.15.8:0/4193686358 shutdown_connections 2023-12-17T12:02:54.980 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:54.977+0000 7fdb901ff700 1 -- 172.21.15.8:0/4193686358 wait complete. 2023-12-17T12:02:55.008 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-12-17T12:02:55.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.215+0000 7f099e7ff700 1 -- 172.21.15.8:0/4273244640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0998102790 msgr2=0x7f0998102bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:55.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.215+0000 7f099e7ff700 1 --2- 172.21.15.8:0/4273244640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0998102790 0x7f0998102bf0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f098c0099c0 tx=0x7f098c009cd0 comp rx=0 tx=0).stop 2023-12-17T12:02:55.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.215+0000 7f099e7ff700 1 -- 172.21.15.8:0/4273244640 shutdown_connections 2023-12-17T12:02:55.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.215+0000 7f099e7ff700 1 --2- 172.21.15.8:0/4273244640 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0998103130 0x7f09981099e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:55.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.215+0000 7f099e7ff700 1 --2- 172.21.15.8:0/4273244640 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f09981015a0 0x7f09981019c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:55.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.215+0000 7f099e7ff700 1 --2- 172.21.15.8:0/4273244640 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0998102790 0x7f0998102bf0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:55.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.215+0000 7f099e7ff700 1 -- 172.21.15.8:0/4273244640 >> 172.21.15.8:0/4273244640 conn(0x7f09980fcb10 msgr2=0x7f09980fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:55.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.215+0000 7f099e7ff700 1 -- 172.21.15.8:0/4273244640 shutdown_connections 2023-12-17T12:02:55.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.215+0000 7f099e7ff700 1 -- 172.21.15.8:0/4273244640 wait complete. 2023-12-17T12:02:55.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.216+0000 7f099e7ff700 1 Processor -- start 2023-12-17T12:02:55.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.216+0000 7f099e7ff700 1 -- start start 2023-12-17T12:02:55.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.216+0000 7f099e7ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09981015a0 0x7f0998199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:55.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.216+0000 7f099e7ff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0998102790 0x7f0998199c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:55.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.216+0000 7f099e7ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0998103130 0x7f09981a0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:55.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.216+0000 7f099e7ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09981a1260 con 0x7f0998103130 2023-12-17T12:02:55.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.216+0000 7f099e7ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09981a13a0 con 0x7f09981015a0 2023-12-17T12:02:55.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.216+0000 7f099e7ff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09981a1530 con 0x7f0998102790 2023-12-17T12:02:55.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.217+0000 7f099cd9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0998103130 0x7f09981a0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:55.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.217+0000 7f099cd9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0998103130 0x7f09981a0c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56310/0 (socket says 172.21.15.8:56310) 2023-12-17T12:02:55.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.217+0000 7f099cd9c700 1 -- 172.21.15.8:0/2105728408 learned_addr learned my addr 172.21.15.8:0/2105728408 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:02:55.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.217+0000 7f0997fff700 1 --2- 172.21.15.8:0/2105728408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09981015a0 0x7f0998199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:55.221 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.217+0000 7f09977fe700 1 --2- 172.21.15.8:0/2105728408 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0998102790 0x7f0998199c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:55.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.217+0000 7f099cd9c700 1 -- 172.21.15.8:0/2105728408 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0998102790 msgr2=0x7f0998199c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:55.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.217+0000 7f099cd9c700 1 --2- 172.21.15.8:0/2105728408 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0998102790 0x7f0998199c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:55.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.217+0000 7f099cd9c700 1 -- 172.21.15.8:0/2105728408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09981015a0 msgr2=0x7f0998199730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:55.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.217+0000 7f099cd9c700 1 --2- 172.21.15.8:0/2105728408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09981015a0 0x7f0998199730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:55.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.217+0000 7f099cd9c700 1 -- 172.21.15.8:0/2105728408 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098c0095f0 con 0x7f0998103130 2023-12-17T12:02:55.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.217+0000 7f099cd9c700 1 --2- 172.21.15.8:0/2105728408 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0998103130 0x7f09981a0c90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f099000b970 tx=0x7f099000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:55.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.218+0000 7f09957fa700 1 -- 172.21.15.8:0/2105728408 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f099000c930 con 0x7f0998103130 2023-12-17T12:02:55.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.218+0000 7f09957fa700 1 -- 172.21.15.8:0/2105728408 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0990014440 con 0x7f0998103130 2023-12-17T12:02:55.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.218+0000 7f099e7ff700 1 -- 172.21.15.8:0/2105728408 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09981a1810 con 0x7f0998103130 2023-12-17T12:02:55.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.218+0000 7f09957fa700 1 -- 172.21.15.8:0/2105728408 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09900075d0 con 0x7f0998103130 2023-12-17T12:02:55.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.218+0000 7f099e7ff700 1 -- 172.21.15.8:0/2105728408 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09981a1d20 con 0x7f0998103130 2023-12-17T12:02:55.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.219+0000 7f099e7ff700 1 -- 172.21.15.8:0/2105728408 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0998068310 con 0x7f0998103130 2023-12-17T12:02:55.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.222+0000 7f09957fa700 1 -- 172.21.15.8:0/2105728408 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7f09900145b0 con 0x7f0998103130 2023-12-17T12:02:55.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.222+0000 7f09957fa700 1 --2- 172.21.15.8:0/2105728408 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f09800a1500 0x7f09800a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:55.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.222+0000 7f09957fa700 1 -- 172.21.15.8:0/2105728408 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f0990006e40 con 0x7f0998103130 2023-12-17T12:02:55.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.222+0000 7f0997fff700 1 --2- 172.21.15.8:0/2105728408 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f09800a1500 0x7f09800a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:55.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.223+0000 7f0997fff700 1 --2- 172.21.15.8:0/2105728408 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f09800a1500 0x7f09800a39c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f09981025f0 tx=0x7f0988009190 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:55.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.226+0000 7f09957fa700 1 -- 172.21.15.8:0/2105728408 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f0990095bc0 con 0x7f0998103130 2023-12-17T12:02:55.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:54 smithi100 ceph-mon[41266]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-17T12:02:55.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:54 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/909665192' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-12-17T12:02:55.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:54 smithi100 ceph-mon[41266]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-12-17T12:02:55.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:54 smithi100 ceph-mon[41266]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-17T12:02:55.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:54 smithi100 ceph-mon[41266]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-12-17T12:02:55.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:54 smithi100 ceph-mon[41266]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-12-17T12:02:55.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:54 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/4193686358' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-12-17T12:02:55.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:54 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/4193686358' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-12-17T12:02:55.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:54 smithi100 ceph-mon[41266]: mds.? [v2:172.21.15.186:6838/91602342,v1:172.21.15.186:6839/91602342] up:active 2023-12-17T12:02:55.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:54 smithi100 ceph-mon[41266]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-12-17T12:02:55.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:54 smithi100 ceph-mon[41266]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 2 up:standby-replay 8 up:standby 2023-12-17T12:02:55.417 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:54 smithi100 ceph-mon[41266]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=e=up:creating} 2 up:standby-replay 7 up:standby 2023-12-17T12:02:55.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:54 smithi186 ceph-mon[41182]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-17T12:02:55.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:54 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/909665192' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-12-17T12:02:55.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:54 smithi186 ceph-mon[41182]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-12-17T12:02:55.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:54 smithi186 ceph-mon[41182]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-17T12:02:55.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:54 smithi186 ceph-mon[41182]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-12-17T12:02:55.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:54 smithi186 ceph-mon[41182]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-12-17T12:02:55.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:54 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/4193686358' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-12-17T12:02:55.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:54 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/4193686358' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-12-17T12:02:55.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:54 smithi186 ceph-mon[41182]: mds.? [v2:172.21.15.186:6838/91602342,v1:172.21.15.186:6839/91602342] up:active 2023-12-17T12:02:55.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:54 smithi186 ceph-mon[41182]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-12-17T12:02:55.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:54 smithi186 ceph-mon[41182]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 2 up:standby-replay 8 up:standby 2023-12-17T12:02:55.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:54 smithi186 ceph-mon[41182]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=e=up:creating} 2 up:standby-replay 7 up:standby 2023-12-17T12:02:55.484 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:55.482+0000 7f099e7ff700 1 -- 172.21.15.8:0/2105728408 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7f099810cdd0 con 0x7f0998103130 2023-12-17T12:02:55.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:54 smithi008 ceph-mon[36830]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-12-17T12:02:55.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:54 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/909665192' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2023-12-17T12:02:55.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:54 smithi008 ceph-mon[36830]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-12-17T12:02:55.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:54 smithi008 ceph-mon[36830]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-12-17T12:02:55.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:54 smithi008 ceph-mon[36830]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-12-17T12:02:55.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:54 smithi008 ceph-mon[36830]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-12-17T12:02:55.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:54 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/4193686358' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-12-17T12:02:55.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:54 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/4193686358' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-12-17T12:02:55.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:54 smithi008 ceph-mon[36830]: mds.? [v2:172.21.15.186:6838/91602342,v1:172.21.15.186:6839/91602342] up:active 2023-12-17T12:02:55.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:54 smithi008 ceph-mon[36830]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-12-17T12:02:55.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:54 smithi008 ceph-mon[36830]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 2 up:standby-replay 8 up:standby 2023-12-17T12:02:55.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:54 smithi008 ceph-mon[36830]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=e=up:creating} 2 up:standby-replay 7 up:standby 2023-12-17T12:02:56.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.002+0000 7f09957fa700 1 -- 172.21.15.8:0/2105728408 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v22) v1 ==== 115+0+0 (secure 0 0 0) 0x7f09900991e0 con 0x7f0998103130 2023-12-17T12:02:56.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.006+0000 7f099e7ff700 1 -- 172.21.15.8:0/2105728408 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f09800a1500 msgr2=0x7f09800a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:56.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.006+0000 7f099e7ff700 1 --2- 172.21.15.8:0/2105728408 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f09800a1500 0x7f09800a39c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f09981025f0 tx=0x7f0988009190 comp rx=0 tx=0).stop 2023-12-17T12:02:56.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.006+0000 7f099e7ff700 1 -- 172.21.15.8:0/2105728408 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0998103130 msgr2=0x7f09981a0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:56.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.006+0000 7f099e7ff700 1 --2- 172.21.15.8:0/2105728408 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0998103130 0x7f09981a0c90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f099000b970 tx=0x7f099000bc80 comp rx=0 tx=0).stop 2023-12-17T12:02:56.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.006+0000 7f099e7ff700 1 -- 172.21.15.8:0/2105728408 shutdown_connections 2023-12-17T12:02:56.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.006+0000 7f099e7ff700 1 --2- 172.21.15.8:0/2105728408 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f09800a1500 0x7f09800a39c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:56.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.006+0000 7f099e7ff700 1 --2- 172.21.15.8:0/2105728408 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0998103130 0x7f09981a0c90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:56.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.006+0000 7f099e7ff700 1 --2- 172.21.15.8:0/2105728408 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f09981015a0 0x7f0998199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:56.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.006+0000 7f099e7ff700 1 --2- 172.21.15.8:0/2105728408 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0998102790 0x7f0998199c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:56.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.006+0000 7f099e7ff700 1 -- 172.21.15.8:0/2105728408 >> 172.21.15.8:0/2105728408 conn(0x7f09980fcb10 msgr2=0x7f0998108000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:56.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.006+0000 7f099e7ff700 1 -- 172.21.15.8:0/2105728408 shutdown_connections 2023-12-17T12:02:56.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.006+0000 7f099e7ff700 1 -- 172.21.15.8:0/2105728408 wait complete. 2023-12-17T12:02:56.034 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2023-12-17T12:02:56.035 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 '' 2023-12-17T12:02:56.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.244+0000 7ff8a3bff700 1 -- 172.21.15.8:0/4067001315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff89c074030 msgr2=0x7ff89c0744b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:56.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.244+0000 7ff8a3bff700 1 --2- 172.21.15.8:0/4067001315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff89c074030 0x7ff89c0744b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff88c009990 tx=0x7ff88c009ca0 comp rx=0 tx=0).stop 2023-12-17T12:02:56.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.245+0000 7ff8a3bff700 1 -- 172.21.15.8:0/4067001315 shutdown_connections 2023-12-17T12:02:56.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.245+0000 7ff8a3bff700 1 --2- 172.21.15.8:0/4067001315 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff89c109460 0x7ff89c10b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:56.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.245+0000 7ff8a3bff700 1 --2- 172.21.15.8:0/4067001315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff89c075610 0x7ff89c073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:56.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.245+0000 7ff8a3bff700 1 --2- 172.21.15.8:0/4067001315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff89c074030 0x7ff89c0744b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:56.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.245+0000 7ff8a3bff700 1 -- 172.21.15.8:0/4067001315 >> 172.21.15.8:0/4067001315 conn(0x7ff89c0fcb10 msgr2=0x7ff89c0fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:56.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.245+0000 7ff8a3bff700 1 -- 172.21.15.8:0/4067001315 shutdown_connections 2023-12-17T12:02:56.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.245+0000 7ff8a3bff700 1 -- 172.21.15.8:0/4067001315 wait complete. 2023-12-17T12:02:56.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.246+0000 7ff8a3bff700 1 Processor -- start 2023-12-17T12:02:56.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.246+0000 7ff8a3bff700 1 -- start start 2023-12-17T12:02:56.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.246+0000 7ff8a3bff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff89c074030 0x7ff89c199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:56.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.246+0000 7ff8a3bff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff89c075610 0x7ff89c199c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:56.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.246+0000 7ff8a3bff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff89c109460 0x7ff89c1a0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:56.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.246+0000 7ff8a3bff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c1a11b0 con 0x7ff89c075610 2023-12-17T12:02:56.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.246+0000 7ff8a3bff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c1a12f0 con 0x7ff89c074030 2023-12-17T12:02:56.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.246+0000 7ff8a3bff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff89c1a1480 con 0x7ff89c109460 2023-12-17T12:02:56.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.246+0000 7ff8a119a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff89c075610 0x7ff89c199c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:56.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.246+0000 7ff8a119a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff89c075610 0x7ff89c199c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56314/0 (socket says 172.21.15.8:56314) 2023-12-17T12:02:56.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.246+0000 7ff8a119a700 1 -- 172.21.15.8:0/3696641538 learned_addr learned my addr 172.21.15.8:0/3696641538 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:02:56.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.246+0000 7ff8a199b700 1 --2- 172.21.15.8:0/3696641538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff89c074030 0x7ff89c199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:56.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.247+0000 7ff8a219c700 1 --2- 172.21.15.8:0/3696641538 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff89c109460 0x7ff89c1a0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:56.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.247+0000 7ff8a119a700 1 -- 172.21.15.8:0/3696641538 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff89c109460 msgr2=0x7ff89c1a0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:56.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.247+0000 7ff8a119a700 1 --2- 172.21.15.8:0/3696641538 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff89c109460 0x7ff89c1a0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:56.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.247+0000 7ff8a119a700 1 -- 172.21.15.8:0/3696641538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff89c074030 msgr2=0x7ff89c199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:56.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.247+0000 7ff8a119a700 1 --2- 172.21.15.8:0/3696641538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff89c074030 0x7ff89c199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:56.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.247+0000 7ff8a119a700 1 -- 172.21.15.8:0/3696641538 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff88c0095f0 con 0x7ff89c075610 2023-12-17T12:02:56.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.247+0000 7ff8a119a700 1 --2- 172.21.15.8:0/3696641538 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff89c075610 0x7ff89c199c60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff88c006010 tx=0x7ff88c005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:56.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.247+0000 7ff892ffd700 1 -- 172.21.15.8:0/3696641538 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c01d070 con 0x7ff89c075610 2023-12-17T12:02:56.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.247+0000 7ff892ffd700 1 -- 172.21.15.8:0/3696641538 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff88c00be30 con 0x7ff89c075610 2023-12-17T12:02:56.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.247+0000 7ff8a3bff700 1 -- 172.21.15.8:0/3696641538 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff89c1a1700 con 0x7ff89c075610 2023-12-17T12:02:56.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.247+0000 7ff892ffd700 1 -- 172.21.15.8:0/3696641538 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff88c021410 con 0x7ff89c075610 2023-12-17T12:02:56.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.247+0000 7ff8a3bff700 1 -- 172.21.15.8:0/3696641538 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff89c1a1b80 con 0x7ff89c075610 2023-12-17T12:02:56.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.248+0000 7ff8a3bff700 1 -- 172.21.15.8:0/3696641538 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff89c108220 con 0x7ff89c075610 2023-12-17T12:02:56.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.250+0000 7ff892ffd700 1 -- 172.21.15.8:0/3696641538 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7ff88c00f640 con 0x7ff89c075610 2023-12-17T12:02:56.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.253+0000 7ff892ffd700 1 --2- 172.21.15.8:0/3696641538 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7ff8880a1500 0x7ff8880a39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:56.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.253+0000 7ff892ffd700 1 -- 172.21.15.8:0/3696641538 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff88c0ce340 con 0x7ff89c075610 2023-12-17T12:02:56.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.253+0000 7ff8a199b700 1 --2- 172.21.15.8:0/3696641538 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7ff8880a1500 0x7ff8880a39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:56.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.253+0000 7ff8a199b700 1 --2- 172.21.15.8:0/3696641538 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7ff8880a1500 0x7ff8880a39c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff898009c60 tx=0x7ff898009260 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:56.256 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.255+0000 7ff892ffd700 1 -- 172.21.15.8:0/3696641538 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ff88c097ae0 con 0x7ff89c075610 2023-12-17T12:02:56.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:55 smithi100 ceph-mon[41266]: daemon mds.e is now active in filesystem cephfs as rank 2 2023-12-17T12:02:56.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:55 smithi100 ceph-mon[41266]: pgmap v267: 97 pgs: 97 active+clean; 580 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 3.0 KiB/s wr, 12 op/s 2023-12-17T12:02:56.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:55 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/2105728408' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-12-17T12:02:56.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:55 smithi186 ceph-mon[41182]: daemon mds.e is now active in filesystem cephfs as rank 2 2023-12-17T12:02:56.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:55 smithi186 ceph-mon[41182]: pgmap v267: 97 pgs: 97 active+clean; 580 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 3.0 KiB/s wr, 12 op/s 2023-12-17T12:02:56.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:55 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/2105728408' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-12-17T12:02:56.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:55 smithi008 ceph-mon[36830]: daemon mds.e is now active in filesystem cephfs as rank 2 2023-12-17T12:02:56.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:55 smithi008 ceph-mon[36830]: pgmap v267: 97 pgs: 97 active+clean; 580 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 3.0 KiB/s wr, 12 op/s 2023-12-17T12:02:56.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:55 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/2105728408' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-12-17T12:02:56.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:56.501+0000 7ff8a3bff700 1 -- 172.21.15.8:0/3696641538 --> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7ff89c061a10 con 0x7ff8880a1500 2023-12-17T12:02:56.995 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 12:02:56 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T12:02:56.508+0000 7f5ba2979700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-17T12:02:56.996 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 12:02:56 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T12:02:56.508+0000 7f5ba2979700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-17T12:02:56.996 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 12:02:56 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T12:02:56.508+0000 7f5ba2979700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-17T12:02:56.996 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 12:02:56 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T12:02:56.508+0000 7f5ba2979700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-17T12:02:56.996 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 12:02:56 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T12:02:56.508+0000 7f5ba2979700 -1 client.0 error registering admin socket command: (17) File exists 2023-12-17T12:02:57.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.067+0000 7ff892ffd700 1 -- 172.21.15.8:0/3696641538 <== mgr.14154 v2:172.21.15.8:6800/268548699 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7ff89c061a10 con 0x7ff8880a1500 2023-12-17T12:02:57.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.070+0000 7ff8a3bff700 1 -- 172.21.15.8:0/3696641538 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7ff8880a1500 msgr2=0x7ff8880a39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:57.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.070+0000 7ff8a3bff700 1 --2- 172.21.15.8:0/3696641538 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7ff8880a1500 0x7ff8880a39c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff898009c60 tx=0x7ff898009260 comp rx=0 tx=0).stop 2023-12-17T12:02:57.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.070+0000 7ff8a3bff700 1 -- 172.21.15.8:0/3696641538 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff89c075610 msgr2=0x7ff89c199c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:57.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.070+0000 7ff8a3bff700 1 --2- 172.21.15.8:0/3696641538 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff89c075610 0x7ff89c199c60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff88c006010 tx=0x7ff88c005740 comp rx=0 tx=0).stop 2023-12-17T12:02:57.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.070+0000 7ff8a3bff700 1 -- 172.21.15.8:0/3696641538 shutdown_connections 2023-12-17T12:02:57.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.070+0000 7ff8a3bff700 1 --2- 172.21.15.8:0/3696641538 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7ff8880a1500 0x7ff8880a39c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:57.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.070+0000 7ff8a3bff700 1 --2- 172.21.15.8:0/3696641538 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff89c109460 0x7ff89c1a0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:57.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.070+0000 7ff8a3bff700 1 --2- 172.21.15.8:0/3696641538 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff89c074030 0x7ff89c199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:57.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.070+0000 7ff8a3bff700 1 --2- 172.21.15.8:0/3696641538 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff89c075610 0x7ff89c199c60 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:57.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.070+0000 7ff8a3bff700 1 -- 172.21.15.8:0/3696641538 >> 172.21.15.8:0/3696641538 conn(0x7ff89c0fcb10 msgr2=0x7ff89c105360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:57.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.070+0000 7ff8a3bff700 1 -- 172.21.15.8:0/3696641538 shutdown_connections 2023-12-17T12:02:57.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.070+0000 7ff8a3bff700 1 -- 172.21.15.8:0/3696641538 wait complete. 2023-12-17T12:02:57.092 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_0 2023-12-17T12:02:57.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.299+0000 7f70ed5ff700 1 -- 172.21.15.8:0/1084286060 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70e8074030 msgr2=0x7f70e80744b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:57.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.299+0000 7f70ed5ff700 1 --2- 172.21.15.8:0/1084286060 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70e8074030 0x7f70e80744b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f70dc009990 tx=0x7f70dc009ca0 comp rx=0 tx=0).stop 2023-12-17T12:02:57.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.299+0000 7f70ed5ff700 1 -- 172.21.15.8:0/1084286060 shutdown_connections 2023-12-17T12:02:57.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.299+0000 7f70ed5ff700 1 --2- 172.21.15.8:0/1084286060 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70e8109460 0x7f70e810b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:57.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.299+0000 7f70ed5ff700 1 --2- 172.21.15.8:0/1084286060 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f70e8075610 0x7f70e8073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:57.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.299+0000 7f70ed5ff700 1 --2- 172.21.15.8:0/1084286060 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70e8074030 0x7f70e80744b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:57.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.299+0000 7f70ed5ff700 1 -- 172.21.15.8:0/1084286060 >> 172.21.15.8:0/1084286060 conn(0x7f70e80fcb10 msgr2=0x7f70e80fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:57.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.299+0000 7f70ed5ff700 1 -- 172.21.15.8:0/1084286060 shutdown_connections 2023-12-17T12:02:57.301 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.299+0000 7f70ed5ff700 1 -- 172.21.15.8:0/1084286060 wait complete. 2023-12-17T12:02:57.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.300+0000 7f70ed5ff700 1 Processor -- start 2023-12-17T12:02:57.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.300+0000 7f70ed5ff700 1 -- start start 2023-12-17T12:02:57.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.301+0000 7f70ed5ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70e8074030 0x7f70e81996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:57.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.301+0000 7f70ed5ff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f70e8075610 0x7f70e8199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:57.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.301+0000 7f70ed5ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70e8109460 0x7f70e81a0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:57.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.301+0000 7f70ed5ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e81a1200 con 0x7f70e8109460 2023-12-17T12:02:57.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.301+0000 7f70ed5ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e81a1340 con 0x7f70e8074030 2023-12-17T12:02:57.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.301+0000 7f70ed5ff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e81a14d0 con 0x7f70e8075610 2023-12-17T12:02:57.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.301+0000 7f70e77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70e8109460 0x7f70e81a0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:57.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.301+0000 7f70e77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70e8109460 0x7f70e81a0c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56336/0 (socket says 172.21.15.8:56336) 2023-12-17T12:02:57.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.301+0000 7f70e77fe700 1 -- 172.21.15.8:0/3019844317 learned_addr learned my addr 172.21.15.8:0/3019844317 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:02:57.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.301+0000 7f70e67fc700 1 --2- 172.21.15.8:0/3019844317 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f70e8075610 0x7f70e8199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:57.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.301+0000 7f70e6ffd700 1 --2- 172.21.15.8:0/3019844317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70e8074030 0x7f70e81996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:57.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.301+0000 7f70e77fe700 1 -- 172.21.15.8:0/3019844317 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f70e8075610 msgr2=0x7f70e8199c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:57.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.301+0000 7f70e77fe700 1 --2- 172.21.15.8:0/3019844317 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f70e8075610 0x7f70e8199c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:57.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.301+0000 7f70e77fe700 1 -- 172.21.15.8:0/3019844317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70e8074030 msgr2=0x7f70e81996d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:57.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.301+0000 7f70e77fe700 1 --2- 172.21.15.8:0/3019844317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70e8074030 0x7f70e81996d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:57.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.301+0000 7f70e77fe700 1 -- 172.21.15.8:0/3019844317 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70dc0095f0 con 0x7f70e8109460 2023-12-17T12:02:57.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.301+0000 7f70e6ffd700 1 --2- 172.21.15.8:0/3019844317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70e8074030 0x7f70e81996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T12:02:57.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.302+0000 7f70e77fe700 1 --2- 172.21.15.8:0/3019844317 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70e8109460 0x7f70e81a0c30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f70e000ef30 tx=0x7f70e000c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:57.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.302+0000 7f70cffff700 1 -- 172.21.15.8:0/3019844317 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e0018070 con 0x7f70e8109460 2023-12-17T12:02:57.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.302+0000 7f70cffff700 1 -- 172.21.15.8:0/3019844317 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f70e000f040 con 0x7f70e8109460 2023-12-17T12:02:57.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.302+0000 7f70ed5ff700 1 -- 172.21.15.8:0/3019844317 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e81a1750 con 0x7f70e8109460 2023-12-17T12:02:57.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.302+0000 7f70cffff700 1 -- 172.21.15.8:0/3019844317 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70e0003d00 con 0x7f70e8109460 2023-12-17T12:02:57.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.302+0000 7f70ed5ff700 1 -- 172.21.15.8:0/3019844317 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e81a1c10 con 0x7f70e8109460 2023-12-17T12:02:57.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.303+0000 7f70ed5ff700 1 -- 172.21.15.8:0/3019844317 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70e8108220 con 0x7f70e8109460 2023-12-17T12:02:57.306 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.305+0000 7f70cffff700 1 -- 172.21.15.8:0/3019844317 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7f70e000caa0 con 0x7f70e8109460 2023-12-17T12:02:57.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.306+0000 7f70cffff700 1 --2- 172.21.15.8:0/3019844317 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f70d00a1480 0x7f70d00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:57.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.306+0000 7f70cffff700 1 -- 172.21.15.8:0/3019844317 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f70e00cc900 con 0x7f70e8109460 2023-12-17T12:02:57.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.306+0000 7f70e6ffd700 1 --2- 172.21.15.8:0/3019844317 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f70d00a1480 0x7f70d00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:57.308 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.307+0000 7f70e6ffd700 1 --2- 172.21.15.8:0/3019844317 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f70d00a1480 0x7f70d00a3940 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f70d8009be0 tx=0x7f70d8009260 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:57.311 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.310+0000 7f70cffff700 1 -- 172.21.15.8:0/3019844317 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f70e0096140 con 0x7f70e8109460 2023-12-17T12:02:57.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:57 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/2105728408' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-12-17T12:02:57.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:57 smithi100 ceph-mon[41266]: mds.? [v2:172.21.15.100:6834/2140351853,v1:172.21.15.100:6835/2140351853] up:active 2023-12-17T12:02:57.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:57 smithi100 ceph-mon[41266]: daemon mds.k assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-12-17T12:02:57.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:57 smithi100 ceph-mon[41266]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=e=up:active} 2 up:standby-replay 7 up:standby 2023-12-17T12:02:57.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:57 smithi100 ceph-mon[41266]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=e=up:active,3=k=up:creating} 2 up:standby-replay 6 up:standby 2023-12-17T12:02:57.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:57 smithi100 ceph-mon[41266]: daemon mds.k is now active in filesystem cephfs as rank 3 2023-12-17T12:02:57.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:57 smithi100 ceph-mon[41266]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:02:57.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:57 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/2105728408' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-12-17T12:02:57.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:57 smithi186 ceph-mon[41182]: mds.? [v2:172.21.15.100:6834/2140351853,v1:172.21.15.100:6835/2140351853] up:active 2023-12-17T12:02:57.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:57 smithi186 ceph-mon[41182]: daemon mds.k assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-12-17T12:02:57.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:57 smithi186 ceph-mon[41182]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=e=up:active} 2 up:standby-replay 7 up:standby 2023-12-17T12:02:57.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:57 smithi186 ceph-mon[41182]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=e=up:active,3=k=up:creating} 2 up:standby-replay 6 up:standby 2023-12-17T12:02:57.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:57 smithi186 ceph-mon[41182]: daemon mds.k is now active in filesystem cephfs as rank 3 2023-12-17T12:02:57.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:57 smithi186 ceph-mon[41182]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:02:57.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:57 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/2105728408' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-12-17T12:02:57.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:57 smithi008 ceph-mon[36830]: mds.? [v2:172.21.15.100:6834/2140351853,v1:172.21.15.100:6835/2140351853] up:active 2023-12-17T12:02:57.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:57 smithi008 ceph-mon[36830]: daemon mds.k assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2023-12-17T12:02:57.497 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:57 smithi008 ceph-mon[36830]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=e=up:active} 2 up:standby-replay 7 up:standby 2023-12-17T12:02:57.497 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:57 smithi008 ceph-mon[36830]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=e=up:active,3=k=up:creating} 2 up:standby-replay 6 up:standby 2023-12-17T12:02:57.497 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:57 smithi008 ceph-mon[36830]: daemon mds.k is now active in filesystem cephfs as rank 3 2023-12-17T12:02:57.497 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:57 smithi008 ceph-mon[36830]: from='client.14784 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:02:57.559 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.558+0000 7f70ed5ff700 1 -- 172.21.15.8:0/3019844317 --> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7f70e80682c0 con 0x7f70d00a1480 2023-12-17T12:02:57.564 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.562+0000 7f70cffff700 1 -- 172.21.15.8:0/3019844317 <== mgr.14154 v2:172.21.15.8:6800/268548699 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f70e80682c0 con 0x7f70d00a1480 2023-12-17T12:02:57.564 INFO:teuthology.orchestra.run.smithi008.stdout:/volumes/_nogroup/sv_0/174f5769-9c7a-4168-a008-e65372bf8d1a 2023-12-17T12:02:57.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.565+0000 7f70ed5ff700 1 -- 172.21.15.8:0/3019844317 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f70d00a1480 msgr2=0x7f70d00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:57.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.565+0000 7f70ed5ff700 1 --2- 172.21.15.8:0/3019844317 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f70d00a1480 0x7f70d00a3940 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f70d8009be0 tx=0x7f70d8009260 comp rx=0 tx=0).stop 2023-12-17T12:02:57.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.565+0000 7f70ed5ff700 1 -- 172.21.15.8:0/3019844317 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70e8109460 msgr2=0x7f70e81a0c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:57.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.565+0000 7f70ed5ff700 1 --2- 172.21.15.8:0/3019844317 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70e8109460 0x7f70e81a0c30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f70e000ef30 tx=0x7f70e000c450 comp rx=0 tx=0).stop 2023-12-17T12:02:57.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.565+0000 7f70ed5ff700 1 -- 172.21.15.8:0/3019844317 shutdown_connections 2023-12-17T12:02:57.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.565+0000 7f70ed5ff700 1 --2- 172.21.15.8:0/3019844317 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f70d00a1480 0x7f70d00a3940 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:57.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.565+0000 7f70ed5ff700 1 --2- 172.21.15.8:0/3019844317 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f70e8109460 0x7f70e81a0c30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:57.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.565+0000 7f70ed5ff700 1 --2- 172.21.15.8:0/3019844317 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f70e8074030 0x7f70e81996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:57.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.565+0000 7f70ed5ff700 1 --2- 172.21.15.8:0/3019844317 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f70e8075610 0x7f70e8199c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:57.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.565+0000 7f70ed5ff700 1 -- 172.21.15.8:0/3019844317 >> 172.21.15.8:0/3019844317 conn(0x7f70e80fcb10 msgr2=0x7f70e8105360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:57.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.565+0000 7f70ed5ff700 1 -- 172.21.15.8:0/3019844317 shutdown_connections 2023-12-17T12:02:57.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.565+0000 7f70ed5ff700 1 -- 172.21.15.8:0/3019844317 wait complete. 2023-12-17T12:02:57.585 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 '' 2023-12-17T12:02:57.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.795+0000 7f244adff700 1 -- 172.21.15.8:0/3749967820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24440ffe50 msgr2=0x7f2444100270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:57.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.795+0000 7f244adff700 1 --2- 172.21.15.8:0/3749967820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24440ffe50 0x7f2444100270 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f24380099c0 tx=0x7f2438009cd0 comp rx=0 tx=0).stop 2023-12-17T12:02:57.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.795+0000 7f244adff700 1 -- 172.21.15.8:0/3749967820 shutdown_connections 2023-12-17T12:02:57.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.795+0000 7f244adff700 1 --2- 172.21.15.8:0/3749967820 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2444101170 0x7f24441015f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:57.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.795+0000 7f244adff700 1 --2- 172.21.15.8:0/3749967820 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24440ffe50 0x7f2444100270 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:57.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.795+0000 7f244adff700 1 --2- 172.21.15.8:0/3749967820 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24441007b0 0x7f2444100c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:57.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.795+0000 7f244adff700 1 -- 172.21.15.8:0/3749967820 >> 172.21.15.8:0/3749967820 conn(0x7f24440fb9f0 msgr2=0x7f24440fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:57.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.795+0000 7f244adff700 1 -- 172.21.15.8:0/3749967820 shutdown_connections 2023-12-17T12:02:57.797 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.795+0000 7f244adff700 1 -- 172.21.15.8:0/3749967820 wait complete. 2023-12-17T12:02:57.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.796+0000 7f244adff700 1 Processor -- start 2023-12-17T12:02:57.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.796+0000 7f244adff700 1 -- start start 2023-12-17T12:02:57.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.796+0000 7f244adff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24440ffe50 0x7f2444199530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:57.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.797+0000 7f244adff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24441007b0 0x7f2444199a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:57.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.797+0000 7f244adff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2444101170 0x7f24441a0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:57.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.797+0000 7f244adff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24441a1060 con 0x7f24440ffe50 2023-12-17T12:02:57.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.797+0000 7f244adff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24441a11a0 con 0x7f2444101170 2023-12-17T12:02:57.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.797+0000 7f244adff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24441a1330 con 0x7f24441007b0 2023-12-17T12:02:57.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.797+0000 7f2448b9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24440ffe50 0x7f2444199530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:57.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.797+0000 7f2448b9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24440ffe50 0x7f2444199530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56358/0 (socket says 172.21.15.8:56358) 2023-12-17T12:02:57.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.797+0000 7f2448b9b700 1 -- 172.21.15.8:0/3832920083 learned_addr learned my addr 172.21.15.8:0/3832920083 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:02:57.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.797+0000 7f2448b9b700 1 -- 172.21.15.8:0/3832920083 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24441007b0 msgr2=0x7f2444199a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:57.799 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.797+0000 7f2448b9b700 1 --2- 172.21.15.8:0/3832920083 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24441007b0 0x7f2444199a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:57.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.797+0000 7f2448b9b700 1 -- 172.21.15.8:0/3832920083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2444101170 msgr2=0x7f24441a0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:57.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.797+0000 7f244939c700 1 --2- 172.21.15.8:0/3832920083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2444101170 0x7f24441a0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:57.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.797+0000 7f2448b9b700 1 --2- 172.21.15.8:0/3832920083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2444101170 0x7f24441a0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:57.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.797+0000 7f2448b9b700 1 -- 172.21.15.8:0/3832920083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24380095f0 con 0x7f24440ffe50 2023-12-17T12:02:57.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.797+0000 7f244939c700 1 --2- 172.21.15.8:0/3832920083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2444101170 0x7f24441a0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T12:02:57.800 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.797+0000 7f2448b9b700 1 --2- 172.21.15.8:0/3832920083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24440ffe50 0x7f2444199530 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2438000c00 tx=0x7f2438003b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:57.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.798+0000 7f2441ffb700 1 -- 172.21.15.8:0/3832920083 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243801d070 con 0x7f24440ffe50 2023-12-17T12:02:57.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.798+0000 7f2441ffb700 1 -- 172.21.15.8:0/3832920083 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f243800bd30 con 0x7f24440ffe50 2023-12-17T12:02:57.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.798+0000 7f244adff700 1 -- 172.21.15.8:0/3832920083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24441a15b0 con 0x7f24440ffe50 2023-12-17T12:02:57.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.798+0000 7f2441ffb700 1 -- 172.21.15.8:0/3832920083 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2438022e50 con 0x7f24440ffe50 2023-12-17T12:02:57.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.798+0000 7f244adff700 1 -- 172.21.15.8:0/3832920083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24441a19d0 con 0x7f24440ffe50 2023-12-17T12:02:57.801 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.799+0000 7f244adff700 1 -- 172.21.15.8:0/3832920083 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f244410adb0 con 0x7f24440ffe50 2023-12-17T12:02:57.802 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.801+0000 7f2441ffb700 1 -- 172.21.15.8:0/3832920083 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 16) v1 ==== 136005+0+0 (secure 0 0 0) 0x7f2438004080 con 0x7f24440ffe50 2023-12-17T12:02:57.804 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.803+0000 7f2441ffb700 1 --2- 172.21.15.8:0/3832920083 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f24340a1480 0x7f24340a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:57.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.803+0000 7f2441ffb700 1 -- 172.21.15.8:0/3832920083 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f24380cdfe0 con 0x7f24440ffe50 2023-12-17T12:02:57.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.804+0000 7f2443fff700 1 --2- 172.21.15.8:0/3832920083 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f24340a1480 0x7f24340a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:57.805 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.804+0000 7f2443fff700 1 --2- 172.21.15.8:0/3832920083 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f24340a1480 0x7f24340a3940 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2430005fd0 tx=0x7f2430005d00 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:57.809 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:57.807+0000 7f2441ffb700 1 -- 172.21.15.8:0/3832920083 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f243805d2f0 con 0x7f24440ffe50 2023-12-17T12:02:58.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.040+0000 7f2441ffb700 1 -- 172.21.15.8:0/3832920083 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f2438097bb0 con 0x7f24440ffe50 2023-12-17T12:02:58.061 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.060+0000 7f244adff700 1 -- 172.21.15.8:0/3832920083 --> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7f244402d360 con 0x7f24340a1480 2023-12-17T12:02:58.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.084+0000 7f2441ffb700 1 -- 172.21.15.8:0/3832920083 <== mgr.14154 v2:172.21.15.8:6800/268548699 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f244402d360 con 0x7f24340a1480 2023-12-17T12:02:58.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.086+0000 7f244adff700 1 -- 172.21.15.8:0/3832920083 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f24340a1480 msgr2=0x7f24340a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:58.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.086+0000 7f244adff700 1 --2- 172.21.15.8:0/3832920083 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f24340a1480 0x7f24340a3940 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2430005fd0 tx=0x7f2430005d00 comp rx=0 tx=0).stop 2023-12-17T12:02:58.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.086+0000 7f244adff700 1 -- 172.21.15.8:0/3832920083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24440ffe50 msgr2=0x7f2444199530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:58.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.086+0000 7f244adff700 1 --2- 172.21.15.8:0/3832920083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24440ffe50 0x7f2444199530 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2438000c00 tx=0x7f2438003b00 comp rx=0 tx=0).stop 2023-12-17T12:02:58.088 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.086+0000 7f244adff700 1 -- 172.21.15.8:0/3832920083 shutdown_connections 2023-12-17T12:02:58.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.086+0000 7f244adff700 1 --2- 172.21.15.8:0/3832920083 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f24340a1480 0x7f24340a3940 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:58.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.086+0000 7f244adff700 1 --2- 172.21.15.8:0/3832920083 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2444101170 0x7f24441a0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:58.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.087+0000 7f244adff700 1 --2- 172.21.15.8:0/3832920083 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f24440ffe50 0x7f2444199530 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:58.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.087+0000 7f244adff700 1 --2- 172.21.15.8:0/3832920083 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24441007b0 0x7f2444199a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:58.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.087+0000 7f244adff700 1 -- 172.21.15.8:0/3832920083 >> 172.21.15.8:0/3832920083 conn(0x7f24440fb9f0 msgr2=0x7f24440fd150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:58.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.087+0000 7f244adff700 1 -- 172.21.15.8:0/3832920083 shutdown_connections 2023-12-17T12:02:58.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.087+0000 7f244adff700 1 -- 172.21.15.8:0/3832920083 wait complete. 2023-12-17T12:02:58.109 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_1 2023-12-17T12:02:58.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.314+0000 7f79a6fff700 1 -- 172.21.15.8:0/1546842217 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79a0102790 msgr2=0x7f79a0102bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:58.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.314+0000 7f79a6fff700 1 --2- 172.21.15.8:0/1546842217 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79a0102790 0x7f79a0102bf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f798c0099c0 tx=0x7f798c009cd0 comp rx=0 tx=0).stop 2023-12-17T12:02:58.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.315+0000 7f79a6fff700 1 -- 172.21.15.8:0/1546842217 shutdown_connections 2023-12-17T12:02:58.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.315+0000 7f79a6fff700 1 --2- 172.21.15.8:0/1546842217 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79a0103130 0x7f79a01099e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:58.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.315+0000 7f79a6fff700 1 --2- 172.21.15.8:0/1546842217 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79a01015a0 0x7f79a01019c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:58.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.315+0000 7f79a6fff700 1 --2- 172.21.15.8:0/1546842217 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79a0102790 0x7f79a0102bf0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:58.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.315+0000 7f79a6fff700 1 -- 172.21.15.8:0/1546842217 >> 172.21.15.8:0/1546842217 conn(0x7f79a00fcb10 msgr2=0x7f79a00fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:58.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.315+0000 7f79a6fff700 1 -- 172.21.15.8:0/1546842217 shutdown_connections 2023-12-17T12:02:58.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.315+0000 7f79a6fff700 1 -- 172.21.15.8:0/1546842217 wait complete. 2023-12-17T12:02:58.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.316+0000 7f79a6fff700 1 Processor -- start 2023-12-17T12:02:58.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.316+0000 7f79a6fff700 1 -- start start 2023-12-17T12:02:58.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.317+0000 7f79a6fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79a01015a0 0x7f79a0075330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:58.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.317+0000 7f79a6fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79a0102790 0x7f79a00739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:58.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.317+0000 7f79a6fff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79a0103130 0x7f79a0073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:58.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.317+0000 7f79a6fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a00746a0 con 0x7f79a0102790 2023-12-17T12:02:58.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.317+0000 7f79a6fff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a0074810 con 0x7f79a01015a0 2023-12-17T12:02:58.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.317+0000 7f79a6fff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a01a14d0 con 0x7f79a0103130 2023-12-17T12:02:58.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.317+0000 7f799ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79a0102790 0x7f79a00739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:58.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.317+0000 7f799ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79a0102790 0x7f79a00739c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56378/0 (socket says 172.21.15.8:56378) 2023-12-17T12:02:58.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.317+0000 7f799ffff700 1 -- 172.21.15.8:0/2636106133 learned_addr learned my addr 172.21.15.8:0/2636106133 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:02:58.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.317+0000 7f79a4d9b700 1 --2- 172.21.15.8:0/2636106133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79a01015a0 0x7f79a0075330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:58.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.317+0000 7f799ffff700 1 -- 172.21.15.8:0/2636106133 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79a0103130 msgr2=0x7f79a0073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:58.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.317+0000 7f79a559c700 1 --2- 172.21.15.8:0/2636106133 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79a0103130 0x7f79a0073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:58.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.317+0000 7f799ffff700 1 --2- 172.21.15.8:0/2636106133 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79a0103130 0x7f79a0073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:58.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.317+0000 7f799ffff700 1 -- 172.21.15.8:0/2636106133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79a01015a0 msgr2=0x7f79a0075330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:58.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.318+0000 7f799ffff700 1 --2- 172.21.15.8:0/2636106133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79a01015a0 0x7f79a0075330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:58.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.318+0000 7f799ffff700 1 -- 172.21.15.8:0/2636106133 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f798c0095f0 con 0x7f79a0102790 2023-12-17T12:02:58.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.318+0000 7f79a559c700 1 --2- 172.21.15.8:0/2636106133 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79a0103130 0x7f79a0073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T12:02:58.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.318+0000 7f799ffff700 1 --2- 172.21.15.8:0/2636106133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79a0102790 0x7f79a00739c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f798c005910 tx=0x7f798c005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:58.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.318+0000 7f799dffb700 1 -- 172.21.15.8:0/2636106133 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c01d070 con 0x7f79a0102790 2023-12-17T12:02:58.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.318+0000 7f799dffb700 1 -- 172.21.15.8:0/2636106133 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f798c00bd30 con 0x7f79a0102790 2023-12-17T12:02:58.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.318+0000 7f79a6fff700 1 -- 172.21.15.8:0/2636106133 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79a01a1700 con 0x7f79a0102790 2023-12-17T12:02:58.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.318+0000 7f799dffb700 1 -- 172.21.15.8:0/2636106133 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798c022dc0 con 0x7f79a0102790 2023-12-17T12:02:58.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.318+0000 7f79a6fff700 1 -- 172.21.15.8:0/2636106133 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a01a1b20 con 0x7f79a0102790 2023-12-17T12:02:58.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.319+0000 7f79a6fff700 1 -- 172.21.15.8:0/2636106133 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79a0108ac0 con 0x7f79a0102790 2023-12-17T12:02:58.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.321+0000 7f799dffb700 1 -- 172.21.15.8:0/2636106133 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f798c004010 con 0x7f79a0102790 2023-12-17T12:02:58.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.323+0000 7f799dffb700 1 --2- 172.21.15.8:0/2636106133 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f79900a1590 0x7f79900a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:58.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.323+0000 7f799dffb700 1 -- 172.21.15.8:0/2636106133 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f798c0cdca0 con 0x7f79a0102790 2023-12-17T12:02:58.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.323+0000 7f79a4d9b700 1 --2- 172.21.15.8:0/2636106133 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f79900a1590 0x7f79900a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:58.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.324+0000 7f79a4d9b700 1 --2- 172.21.15.8:0/2636106133 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f79900a1590 0x7f79900a3a50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f79a01025f0 tx=0x7f799400b5b0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:58.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.327+0000 7f799dffb700 1 -- 172.21.15.8:0/2636106133 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f798c0973e0 con 0x7f79a0102790 2023-12-17T12:02:58.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:58 smithi100 ceph-mon[41266]: mds.? [v2:172.21.15.100:6832/305815776,v1:172.21.15.100:6833/305815776] up:active 2023-12-17T12:02:58.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:58 smithi100 ceph-mon[41266]: daemon mds.l assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-12-17T12:02:58.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:58 smithi100 ceph-mon[41266]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-17T12:02:58.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:58 smithi100 ceph-mon[41266]: Cluster is now healthy 2023-12-17T12:02:58.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:58 smithi100 ceph-mon[41266]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=e=up:active,3=k=up:active} 2 up:standby-replay 6 up:standby 2023-12-17T12:02:58.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:58 smithi100 ceph-mon[41266]: fsmap cephfs:5 2 up:standby-replay 1 up:creating 5 up:standby 4 up:active 2023-12-17T12:02:58.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:58 smithi100 ceph-mon[41266]: daemon mds.l is now active in filesystem cephfs as rank 4 2023-12-17T12:02:58.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:58 smithi100 ceph-mon[41266]: pgmap v268: 97 pgs: 97 active+clean; 598 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 6.0 KiB/s wr, 16 op/s 2023-12-17T12:02:58.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:58 smithi186 ceph-mon[41182]: mds.? [v2:172.21.15.100:6832/305815776,v1:172.21.15.100:6833/305815776] up:active 2023-12-17T12:02:58.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:58 smithi186 ceph-mon[41182]: daemon mds.l assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-12-17T12:02:58.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:58 smithi186 ceph-mon[41182]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-17T12:02:58.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:58 smithi186 ceph-mon[41182]: Cluster is now healthy 2023-12-17T12:02:58.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:58 smithi186 ceph-mon[41182]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=e=up:active,3=k=up:active} 2 up:standby-replay 6 up:standby 2023-12-17T12:02:58.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:58 smithi186 ceph-mon[41182]: fsmap cephfs:5 2 up:standby-replay 1 up:creating 5 up:standby 4 up:active 2023-12-17T12:02:58.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:58 smithi186 ceph-mon[41182]: daemon mds.l is now active in filesystem cephfs as rank 4 2023-12-17T12:02:58.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:58 smithi186 ceph-mon[41182]: pgmap v268: 97 pgs: 97 active+clean; 598 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 6.0 KiB/s wr, 16 op/s 2023-12-17T12:02:58.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:58 smithi008 ceph-mon[36830]: mds.? [v2:172.21.15.100:6832/305815776,v1:172.21.15.100:6833/305815776] up:active 2023-12-17T12:02:58.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:58 smithi008 ceph-mon[36830]: daemon mds.l assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2023-12-17T12:02:58.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:58 smithi008 ceph-mon[36830]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-12-17T12:02:58.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:58 smithi008 ceph-mon[36830]: Cluster is now healthy 2023-12-17T12:02:58.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:58 smithi008 ceph-mon[36830]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=e=up:active,3=k=up:active} 2 up:standby-replay 6 up:standby 2023-12-17T12:02:58.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:58 smithi008 ceph-mon[36830]: fsmap cephfs:5 2 up:standby-replay 1 up:creating 5 up:standby 4 up:active 2023-12-17T12:02:58.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:58 smithi008 ceph-mon[36830]: daemon mds.l is now active in filesystem cephfs as rank 4 2023-12-17T12:02:58.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:58 smithi008 ceph-mon[36830]: pgmap v268: 97 pgs: 97 active+clean; 598 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s rd, 6.0 KiB/s wr, 16 op/s 2023-12-17T12:02:58.579 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.578+0000 7f79a6fff700 1 -- 172.21.15.8:0/2636106133 --> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f79a002d3d0 con 0x7f79900a1590 2023-12-17T12:02:58.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.582+0000 7f799dffb700 1 -- 172.21.15.8:0/2636106133 <== mgr.14154 v2:172.21.15.8:6800/268548699 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7f79a002d3d0 con 0x7f79900a1590 2023-12-17T12:02:58.584 INFO:teuthology.orchestra.run.smithi008.stdout:/volumes/_nogroup/sv_1/1514ad8a-999a-4302-afbc-9e3e5e5454f1 2023-12-17T12:02:58.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.585+0000 7f79a6fff700 1 -- 172.21.15.8:0/2636106133 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f79900a1590 msgr2=0x7f79900a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:58.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.585+0000 7f79a6fff700 1 --2- 172.21.15.8:0/2636106133 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f79900a1590 0x7f79900a3a50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f79a01025f0 tx=0x7f799400b5b0 comp rx=0 tx=0).stop 2023-12-17T12:02:58.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.585+0000 7f79a6fff700 1 -- 172.21.15.8:0/2636106133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79a0102790 msgr2=0x7f79a00739c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:58.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.585+0000 7f79a6fff700 1 --2- 172.21.15.8:0/2636106133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79a0102790 0x7f79a00739c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f798c005910 tx=0x7f798c005b00 comp rx=0 tx=0).stop 2023-12-17T12:02:58.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.585+0000 7f79a6fff700 1 -- 172.21.15.8:0/2636106133 shutdown_connections 2023-12-17T12:02:58.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.585+0000 7f79a6fff700 1 --2- 172.21.15.8:0/2636106133 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f79900a1590 0x7f79900a3a50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:58.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.585+0000 7f79a6fff700 1 --2- 172.21.15.8:0/2636106133 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79a0103130 0x7f79a0073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:58.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.585+0000 7f79a6fff700 1 --2- 172.21.15.8:0/2636106133 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79a01015a0 0x7f79a0075330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:58.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.585+0000 7f79a6fff700 1 --2- 172.21.15.8:0/2636106133 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79a0102790 0x7f79a00739c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:58.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.585+0000 7f79a6fff700 1 -- 172.21.15.8:0/2636106133 >> 172.21.15.8:0/2636106133 conn(0x7f79a00fcb10 msgr2=0x7f79a0105c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:58.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.585+0000 7f79a6fff700 1 -- 172.21.15.8:0/2636106133 shutdown_connections 2023-12-17T12:02:58.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.585+0000 7f79a6fff700 1 -- 172.21.15.8:0/2636106133 wait complete. 2023-12-17T12:02:58.605 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-17T12:02:58.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.811+0000 7f4743bff700 1 -- 172.21.15.8:0/911988034 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f473c1014a0 msgr2=0x7f473c1018c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:58.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.811+0000 7f4743bff700 1 --2- 172.21.15.8:0/911988034 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f473c1014a0 0x7f473c1018c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f47380099c0 tx=0x7f4738009cd0 comp rx=0 tx=0).stop 2023-12-17T12:02:58.813 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.812+0000 7f4743bff700 1 -- 172.21.15.8:0/911988034 shutdown_connections 2023-12-17T12:02:58.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.812+0000 7f4743bff700 1 --2- 172.21.15.8:0/911988034 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f473c103030 0x7f473c1098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:58.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.812+0000 7f4743bff700 1 --2- 172.21.15.8:0/911988034 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f473c1014a0 0x7f473c1018c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:58.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.812+0000 7f4743bff700 1 --2- 172.21.15.8:0/911988034 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f473c102690 0x7f473c102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:58.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.812+0000 7f4743bff700 1 -- 172.21.15.8:0/911988034 >> 172.21.15.8:0/911988034 conn(0x7f473c0fca10 msgr2=0x7f473c0fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:58.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.812+0000 7f4743bff700 1 -- 172.21.15.8:0/911988034 shutdown_connections 2023-12-17T12:02:58.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.812+0000 7f4743bff700 1 -- 172.21.15.8:0/911988034 wait complete. 2023-12-17T12:02:58.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.813+0000 7f4743bff700 1 Processor -- start 2023-12-17T12:02:58.815 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.813+0000 7f4743bff700 1 -- start start 2023-12-17T12:02:58.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.814+0000 7f4743bff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f473c1014a0 0x7f473c197390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:58.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.814+0000 7f4743bff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f473c102690 0x7f473c1978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:58.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.814+0000 7f4743bff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f473c103030 0x7f473c19e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:58.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.814+0000 7f4743bff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473c19eec0 con 0x7f473c103030 2023-12-17T12:02:58.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.814+0000 7f4743bff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473c19f000 con 0x7f473c102690 2023-12-17T12:02:58.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.814+0000 7f4743bff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473c19f190 con 0x7f473c1014a0 2023-12-17T12:02:58.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.814+0000 7f474219c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f473c103030 0x7f473c19e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:58.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.814+0000 7f474219c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f473c103030 0x7f473c19e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56398/0 (socket says 172.21.15.8:56398) 2023-12-17T12:02:58.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.814+0000 7f474219c700 1 -- 172.21.15.8:0/1482000827 learned_addr learned my addr 172.21.15.8:0/1482000827 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:02:58.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.814+0000 7f474199b700 1 --2- 172.21.15.8:0/1482000827 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f473c1014a0 0x7f473c197390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:58.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.814+0000 7f474119a700 1 --2- 172.21.15.8:0/1482000827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f473c102690 0x7f473c1978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:58.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.814+0000 7f474219c700 1 -- 172.21.15.8:0/1482000827 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f473c1014a0 msgr2=0x7f473c197390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:58.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.814+0000 7f474219c700 1 --2- 172.21.15.8:0/1482000827 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f473c1014a0 0x7f473c197390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:58.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.814+0000 7f474219c700 1 -- 172.21.15.8:0/1482000827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f473c102690 msgr2=0x7f473c1978d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:58.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.814+0000 7f474219c700 1 --2- 172.21.15.8:0/1482000827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f473c102690 0x7f473c1978d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:58.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.814+0000 7f474219c700 1 -- 172.21.15.8:0/1482000827 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47380095f0 con 0x7f473c103030 2023-12-17T12:02:58.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.814+0000 7f474199b700 1 --2- 172.21.15.8:0/1482000827 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f473c1014a0 0x7f473c197390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T12:02:58.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.814+0000 7f474119a700 1 --2- 172.21.15.8:0/1482000827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f473c102690 0x7f473c1978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T12:02:58.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.815+0000 7f474219c700 1 --2- 172.21.15.8:0/1482000827 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f473c103030 0x7f473c19e8f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4734007ee0 tx=0x7f473400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:58.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.815+0000 7f4732ffd700 1 -- 172.21.15.8:0/1482000827 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4734017070 con 0x7f473c103030 2023-12-17T12:02:58.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.815+0000 7f4732ffd700 1 -- 172.21.15.8:0/1482000827 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f473400f040 con 0x7f473c103030 2023-12-17T12:02:58.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.815+0000 7f4743bff700 1 -- 172.21.15.8:0/1482000827 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f473c19f470 con 0x7f473c103030 2023-12-17T12:02:58.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.815+0000 7f4732ffd700 1 -- 172.21.15.8:0/1482000827 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4734005710 con 0x7f473c103030 2023-12-17T12:02:58.818 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.815+0000 7f4743bff700 1 -- 172.21.15.8:0/1482000827 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f473c19f980 con 0x7f473c103030 2023-12-17T12:02:58.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.816+0000 7f4743bff700 1 -- 172.21.15.8:0/1482000827 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f473c1089e0 con 0x7f473c103030 2023-12-17T12:02:58.819 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.818+0000 7f4732ffd700 1 -- 172.21.15.8:0/1482000827 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f4734005870 con 0x7f473c103030 2023-12-17T12:02:58.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.820+0000 7f4732ffd700 1 --2- 172.21.15.8:0/1482000827 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f47280a1590 0x7f47280a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:58.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.820+0000 7f4732ffd700 1 -- 172.21.15.8:0/1482000827 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f47340cc520 con 0x7f473c103030 2023-12-17T12:02:58.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.820+0000 7f474199b700 1 --2- 172.21.15.8:0/1482000827 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f47280a1590 0x7f47280a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:58.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.820+0000 7f474199b700 1 --2- 172.21.15.8:0/1482000827 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f47280a1590 0x7f47280a3a50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4738009990 tx=0x7f473801a040 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:58.825 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:58.824+0000 7f4732ffd700 1 -- 172.21.15.8:0/1482000827 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4734095bd0 con 0x7f473c103030 2023-12-17T12:02:59.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.085+0000 7f4743bff700 1 -- 172.21.15.8:0/1482000827 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f473c068230 con 0x7f473c103030 2023-12-17T12:02:59.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.085+0000 7f4732ffd700 1 -- 172.21.15.8:0/1482000827 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11347 (secure 0 0 0) 0x7f47340991f0 con 0x7f473c103030 2023-12-17T12:02:59.087 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:02:59.087 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2669069079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2669069079},{"type":"v1","addr":"172.21.15.8:6835","nonce":2669069079}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/4241050553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":4241050553},{"type":"v1","addr":"172.21.15.8:6837","nonce":4241050553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-17T12:02:50.176951+0000","modified":"2023-12-17T12:02:58.040005+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24569,"mds_1":24541,"mds_2":24503,"mds_3":24470,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14640":{"gid":14640,"name":"f","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/2765387309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2765387309},{"type":"v1","addr":"172.21.15.186:6835","nonce":2765387309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14679":{"gid":14679,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/487046247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":487046247},{"type":"v1","addr":"172.21.15.8:6839","nonce":487046247}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14691":{"gid":14691,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6841/338406768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":338406768},{"type":"v1","addr":"172.21.15.8:6841","nonce":338406768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24451":{"gid":24451,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.186:6833/582753561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":582753561},{"type":"v1","addr":"172.21.15.186:6833","nonce":582753561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24470":{"gid":24470,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.100:6833/305815776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":305815776},{"type":"v1","addr":"172.21.15.100:6833","nonce":305815776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24503":{"gid":24503,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6835/2140351853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2140351853},{"type":"v1","addr":"172.21.15.100:6835","nonce":2140351853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24520":{"gid":24520,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/822451724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":822451724},{"type":"v1","addr":"172.21.15.186:6837","nonce":822451724}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24530":{"gid":24530,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6837/4176831844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":4176831844},{"type":"v1","addr":"172.21.15.100:6837","nonce":4176831844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.186:6839/91602342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":91602342},{"type":"v1","addr":"172.21.15.186:6839","nonce":91602342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24569":{"gid":24569,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6839/3921737538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3921737538},{"type":"v1","addr":"172.21.15.100:6839","nonce":3921737538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-17T12:02:59.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.088+0000 7f4743bff700 1 -- 172.21.15.8:0/1482000827 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f47280a1590 msgr2=0x7f47280a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:59.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.088+0000 7f4743bff700 1 --2- 172.21.15.8:0/1482000827 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f47280a1590 0x7f47280a3a50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f4738009990 tx=0x7f473801a040 comp rx=0 tx=0).stop 2023-12-17T12:02:59.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.088+0000 7f4743bff700 1 -- 172.21.15.8:0/1482000827 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f473c103030 msgr2=0x7f473c19e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:59.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.088+0000 7f4743bff700 1 --2- 172.21.15.8:0/1482000827 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f473c103030 0x7f473c19e8f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f4734007ee0 tx=0x7f473400d3b0 comp rx=0 tx=0).stop 2023-12-17T12:02:59.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.088+0000 7f4743bff700 1 -- 172.21.15.8:0/1482000827 shutdown_connections 2023-12-17T12:02:59.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.088+0000 7f4743bff700 1 --2- 172.21.15.8:0/1482000827 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f47280a1590 0x7f47280a3a50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:59.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.088+0000 7f4743bff700 1 --2- 172.21.15.8:0/1482000827 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f473c103030 0x7f473c19e8f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:59.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.088+0000 7f4743bff700 1 --2- 172.21.15.8:0/1482000827 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f473c1014a0 0x7f473c197390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:59.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.088+0000 7f4743bff700 1 --2- 172.21.15.8:0/1482000827 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f473c102690 0x7f473c1978d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:59.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.088+0000 7f4743bff700 1 -- 172.21.15.8:0/1482000827 >> 172.21.15.8:0/1482000827 conn(0x7f473c0fca10 msgr2=0x7f473c105b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:59.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.088+0000 7f4743bff700 1 -- 172.21.15.8:0/1482000827 shutdown_connections 2023-12-17T12:02:59.091 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.088+0000 7f4743bff700 1 -- 172.21.15.8:0/1482000827 wait complete. 2023-12-17T12:02:59.091 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 27 2023-12-17T12:02:59.108 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T12:02:59.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.311+0000 7f4b645ff700 1 -- 172.21.15.8:0/73285833 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b5c1014a0 msgr2=0x7f4b5c1018c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:59.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.311+0000 7f4b645ff700 1 --2- 172.21.15.8:0/73285833 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b5c1014a0 0x7f4b5c1018c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f4b580099c0 tx=0x7f4b58009cd0 comp rx=0 tx=0).stop 2023-12-17T12:02:59.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.311+0000 7f4b645ff700 1 -- 172.21.15.8:0/73285833 shutdown_connections 2023-12-17T12:02:59.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.311+0000 7f4b645ff700 1 --2- 172.21.15.8:0/73285833 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4b5c103030 0x7f4b5c1098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:59.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.311+0000 7f4b645ff700 1 --2- 172.21.15.8:0/73285833 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b5c1014a0 0x7f4b5c1018c0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:59.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.311+0000 7f4b645ff700 1 --2- 172.21.15.8:0/73285833 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b5c102690 0x7f4b5c102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:59.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.311+0000 7f4b645ff700 1 -- 172.21.15.8:0/73285833 >> 172.21.15.8:0/73285833 conn(0x7f4b5c0fca10 msgr2=0x7f4b5c0fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:59.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.311+0000 7f4b645ff700 1 -- 172.21.15.8:0/73285833 shutdown_connections 2023-12-17T12:02:59.313 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.311+0000 7f4b645ff700 1 -- 172.21.15.8:0/73285833 wait complete. 2023-12-17T12:02:59.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.312+0000 7f4b645ff700 1 Processor -- start 2023-12-17T12:02:59.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.312+0000 7f4b645ff700 1 -- start start 2023-12-17T12:02:59.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.312+0000 7f4b645ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b5c1014a0 0x7f4b5c199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:59.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.312+0000 7f4b645ff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4b5c102690 0x7f4b5c199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:59.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.312+0000 7f4b645ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b5c103030 0x7f4b5c1a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:59.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.312+0000 7f4b645ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c1a10c0 con 0x7f4b5c103030 2023-12-17T12:02:59.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.312+0000 7f4b645ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c1a1200 con 0x7f4b5c1014a0 2023-12-17T12:02:59.314 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.312+0000 7f4b645ff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b5c1a1390 con 0x7f4b5c102690 2023-12-17T12:02:59.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.313+0000 7f4b6239b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b5c1014a0 0x7f4b5c199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:59.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.313+0000 7f4b6239b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b5c1014a0 0x7f4b5c199590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.8:53532/0 (socket says 172.21.15.8:53532) 2023-12-17T12:02:59.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.313+0000 7f4b61b9a700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4b5c102690 0x7f4b5c199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:59.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.313+0000 7f4b6239b700 1 -- 172.21.15.8:0/1504722630 learned_addr learned my addr 172.21.15.8:0/1504722630 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:02:59.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.313+0000 7f4b62b9c700 1 --2- 172.21.15.8:0/1504722630 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b5c103030 0x7f4b5c1a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:59.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.313+0000 7f4b62b9c700 1 -- 172.21.15.8:0/1504722630 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4b5c102690 msgr2=0x7f4b5c199ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:59.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.313+0000 7f4b62b9c700 1 --2- 172.21.15.8:0/1504722630 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4b5c102690 0x7f4b5c199ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:59.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.313+0000 7f4b62b9c700 1 -- 172.21.15.8:0/1504722630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b5c1014a0 msgr2=0x7f4b5c199590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:59.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.313+0000 7f4b62b9c700 1 --2- 172.21.15.8:0/1504722630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b5c1014a0 0x7f4b5c199590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:59.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.313+0000 7f4b62b9c700 1 -- 172.21.15.8:0/1504722630 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b580095f0 con 0x7f4b5c103030 2023-12-17T12:02:59.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.314+0000 7f4b62b9c700 1 --2- 172.21.15.8:0/1504722630 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b5c103030 0x7f4b5c1a0af0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4b54007f10 tx=0x7f4b5400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:59.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.314+0000 7f4b537fe700 1 -- 172.21.15.8:0/1504722630 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b54004db0 con 0x7f4b5c103030 2023-12-17T12:02:59.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.314+0000 7f4b537fe700 1 -- 172.21.15.8:0/1504722630 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4b5400f040 con 0x7f4b5c103030 2023-12-17T12:02:59.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.314+0000 7f4b645ff700 1 -- 172.21.15.8:0/1504722630 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b5c1a1670 con 0x7f4b5c103030 2023-12-17T12:02:59.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.314+0000 7f4b537fe700 1 -- 172.21.15.8:0/1504722630 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b54005960 con 0x7f4b5c103030 2023-12-17T12:02:59.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.314+0000 7f4b645ff700 1 -- 172.21.15.8:0/1504722630 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b5c1a1b30 con 0x7f4b5c103030 2023-12-17T12:02:59.317 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.315+0000 7f4b645ff700 1 -- 172.21.15.8:0/1504722630 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b5c068230 con 0x7f4b5c103030 2023-12-17T12:02:59.318 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.317+0000 7f4b537fe700 1 -- 172.21.15.8:0/1504722630 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f4b5400db20 con 0x7f4b5c103030 2023-12-17T12:02:59.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.319+0000 7f4b537fe700 1 --2- 172.21.15.8:0/1504722630 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4b480a1510 0x7f4b480a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:59.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.319+0000 7f4b537fe700 1 -- 172.21.15.8:0/1504722630 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f4b540cc690 con 0x7f4b5c103030 2023-12-17T12:02:59.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.319+0000 7f4b6239b700 1 --2- 172.21.15.8:0/1504722630 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4b480a1510 0x7f4b480a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:59.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.320+0000 7f4b6239b700 1 --2- 172.21.15.8:0/1504722630 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4b480a1510 0x7f4b480a39d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4b58003780 tx=0x7f4b58005e80 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:59.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.323+0000 7f4b537fe700 1 -- 172.21.15.8:0/1504722630 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4b5404f2f0 con 0x7f4b5c103030 2023-12-17T12:02:59.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:59 smithi100 ceph-mon[41266]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:02:59.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:59 smithi100 ceph-mon[41266]: mds.? [v2:172.21.15.186:6832/582753561,v1:172.21.15.186:6833/582753561] up:active 2023-12-17T12:02:59.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:59 smithi100 ceph-mon[41266]: fsmap cephfs:5 2 up:standby-replay 5 up:standby 5 up:active 2023-12-17T12:02:59.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:59 smithi100 ceph-mon[41266]: mgrmap e17: x(active, since 6m), standbys: z, y 2023-12-17T12:02:59.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:59 smithi100 ceph-mon[41266]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-12-17T12:02:59.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:02:59 smithi100 ceph-mon[41266]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:02:59.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:59 smithi186 ceph-mon[41182]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:02:59.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:59 smithi186 ceph-mon[41182]: mds.? [v2:172.21.15.186:6832/582753561,v1:172.21.15.186:6833/582753561] up:active 2023-12-17T12:02:59.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:59 smithi186 ceph-mon[41182]: fsmap cephfs:5 2 up:standby-replay 5 up:standby 5 up:active 2023-12-17T12:02:59.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:59 smithi186 ceph-mon[41182]: mgrmap e17: x(active, since 6m), standbys: z, y 2023-12-17T12:02:59.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:59 smithi186 ceph-mon[41182]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-12-17T12:02:59.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:02:59 smithi186 ceph-mon[41182]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:02:59.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:59 smithi008 ceph-mon[36830]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:02:59.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:59 smithi008 ceph-mon[36830]: mds.? [v2:172.21.15.186:6832/582753561,v1:172.21.15.186:6833/582753561] up:active 2023-12-17T12:02:59.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:59 smithi008 ceph-mon[36830]: fsmap cephfs:5 2 up:standby-replay 5 up:standby 5 up:active 2023-12-17T12:02:59.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:59 smithi008 ceph-mon[36830]: mgrmap e17: x(active, since 6m), standbys: z, y 2023-12-17T12:02:59.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:59 smithi008 ceph-mon[36830]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2023-12-17T12:02:59.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:02:59 smithi008 ceph-mon[36830]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:02:59.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.541+0000 7f4b645ff700 1 -- 172.21.15.8:0/1504722630 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b5c10cbb0 con 0x7f4b5c103030 2023-12-17T12:02:59.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.543+0000 7f4b537fe700 1 -- 172.21.15.8:0/1504722630 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22046 (secure 0 0 0) 0x7f4b54095c40 con 0x7f4b5c103030 2023-12-17T12:02:59.545 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:02:59.545 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":83,"fsid":"f43f508a-9cd2-11ee-95a5-87774f69a715","created":"2023-12-17T11:55:30.666634+0000","modified":"2023-12-17T12:02:51.656934+0000","last_up_change":"2023-12-17T12:02:04.656573+0000","last_in_change":"2023-12-17T12:01:45.526832+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:58:43.972745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-17T12:02:48.278153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-17T12:02:49.637968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1f8acaf-a47b-4b74-a78d-e0b6be49a10e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6803","nonce":297519189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6805","nonce":297519189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6809","nonce":297519189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6807","nonce":297519189}]},"public_addr":"172.21.15.8:6803/297519189","cluster_addr":"172.21.15.8:6805/297519189","heartbeat_back_addr":"172.21.15.8:6809/297519189","heartbeat_front_addr":"172.21.15.8:6807/297519189","state":["exists","up"]},{"osd":1,"uuid":"d7138889-77de-43ba-b36b-7628f6f66bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6801","nonce":2496516573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6803","nonce":2496516573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6807","nonce":2496516573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6805","nonce":2496516573}]},"public_addr":"172.21.15.100:6801/2496516573","cluster_addr":"172.21.15.100:6803/2496516573","heartbeat_back_addr":"172.21.15.100:6807/2496516573","heartbeat_front_addr":"172.21.15.100:6805/2496516573","state":["exists","up"]},{"osd":2,"uuid":"ff452a6b-a11e-47be-9eaf-ec1001b51447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6801","nonce":2454925270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6803","nonce":2454925270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6807","nonce":2454925270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6805","nonce":2454925270}]},"public_addr":"172.21.15.186:6801/2454925270","cluster_addr":"172.21.15.186:6803/2454925270","heartbeat_back_addr":"172.21.15.186:6807/2454925270","heartbeat_front_addr":"172.21.15.186:6805/2454925270","state":["exists","up"]},{"osd":3,"uuid":"d19ab765-df7b-48c7-9012-8a3ac7d81aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6811","nonce":1141622701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6813","nonce":1141622701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6817","nonce":1141622701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6815","nonce":1141622701}]},"public_addr":"172.21.15.8:6811/1141622701","cluster_addr":"172.21.15.8:6813/1141622701","heartbeat_back_addr":"172.21.15.8:6817/1141622701","heartbeat_front_addr":"172.21.15.8:6815/1141622701","state":["exists","up"]},{"osd":4,"uuid":"8ecc3a01-f19a-40a7-93a2-8870116afe6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6809","nonce":1902152516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6811","nonce":1902152516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6815","nonce":1902152516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6813","nonce":1902152516}]},"public_addr":"172.21.15.100:6809/1902152516","cluster_addr":"172.21.15.100:6811/1902152516","heartbeat_back_addr":"172.21.15.100:6815/1902152516","heartbeat_front_addr":"172.21.15.100:6813/1902152516","state":["exists","up"]},{"osd":5,"uuid":"ac057cc9-2a27-4216-a7ae-fc60d9796eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6809","nonce":648349934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6811","nonce":648349934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6815","nonce":648349934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6813","nonce":648349934}]},"public_addr":"172.21.15.186:6809/648349934","cluster_addr":"172.21.15.186:6811/648349934","heartbeat_back_addr":"172.21.15.186:6815/648349934","heartbeat_front_addr":"172.21.15.186:6813/648349934","state":["exists","up"]},{"osd":6,"uuid":"bb5325e0-fe12-4bbc-96a9-86c228106a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6819","nonce":3266909294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6821","nonce":3266909294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6825","nonce":3266909294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6823","nonce":3266909294}]},"public_addr":"172.21.15.8:6819/3266909294","cluster_addr":"172.21.15.8:6821/3266909294","heartbeat_back_addr":"172.21.15.8:6825/3266909294","heartbeat_front_addr":"172.21.15.8:6823/3266909294","state":["exists","up"]},{"osd":7,"uuid":"48939d99-29dd-436b-b9f1-fdfe1ee26315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6817","nonce":1631494583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6819","nonce":1631494583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6823","nonce":1631494583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6821","nonce":1631494583}]},"public_addr":"172.21.15.100:6817/1631494583","cluster_addr":"172.21.15.100:6819/1631494583","heartbeat_back_addr":"172.21.15.100:6823/1631494583","heartbeat_front_addr":"172.21.15.100:6821/1631494583","state":["exists","up"]},{"osd":8,"uuid":"e3414f7f-7665-406f-89ec-79cbb3d3e274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6817","nonce":3569004799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6819","nonce":3569004799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6823","nonce":3569004799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6821","nonce":3569004799}]},"public_addr":"172.21.15.186:6817/3569004799","cluster_addr":"172.21.15.186:6819/3569004799","heartbeat_back_addr":"172.21.15.186:6823/3569004799","heartbeat_front_addr":"172.21.15.186:6821/3569004799","state":["exists","up"]},{"osd":9,"uuid":"b04f519d-6e44-4158-b6e1-aa4d64be3404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6827","nonce":3980647643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6829","nonce":3980647643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6833","nonce":3980647643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6831","nonce":3980647643}]},"public_addr":"172.21.15.8:6827/3980647643","cluster_addr":"172.21.15.8:6829/3980647643","heartbeat_back_addr":"172.21.15.8:6833/3980647643","heartbeat_front_addr":"172.21.15.8:6831/3980647643","state":["exists","up"]},{"osd":10,"uuid":"779fde04-620b-4b44-bd35-39be1470eec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6825","nonce":34112410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6827","nonce":34112410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6831","nonce":34112410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6829","nonce":34112410}]},"public_addr":"172.21.15.100:6825/34112410","cluster_addr":"172.21.15.100:6827/34112410","heartbeat_back_addr":"172.21.15.100:6831/34112410","heartbeat_front_addr":"172.21.15.100:6829/34112410","state":["exists","up"]},{"osd":11,"uuid":"6bbcb42f-aa99-44e4-9c3f-d818423eb5b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6825","nonce":3779371472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6827","nonce":3779371472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6831","nonce":3779371472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6829","nonce":3779371472}]},"public_addr":"172.21.15.186:6825/3779371472","cluster_addr":"172.21.15.186:6827/3779371472","heartbeat_back_addr":"172.21.15.186:6831/3779371472","heartbeat_front_addr":"172.21.15.186:6829/3779371472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:57:56.955667+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:58:18.433916+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:58:40.589590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:59:03.635858+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:59:25.544564+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:59:48.171593+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:00:10.876885+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:00:32.920759+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:00:55.273330+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:01:18.131720+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:01:40.259620+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:02:02.776536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/4074020814":"2023-12-18T11:56:27.362306+0000","172.21.15.8:6801/222068650":"2023-12-18T11:56:27.362306+0000","172.21.15.8:6801/4187398661":"2023-12-18T11:56:00.731492+0000","172.21.15.8:6800/222068650":"2023-12-18T11:56:27.362306+0000","172.21.15.8:6800/4187398661":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/2964092603":"2023-12-18T11:56:27.362306+0000","172.21.15.8:0/35186087":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/1429868241":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/174719729":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/2106317618":"2023-12-18T11:56:27.362306+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T12:02:59.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.545+0000 7f4b645ff700 1 -- 172.21.15.8:0/1504722630 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4b480a1510 msgr2=0x7f4b480a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:59.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.545+0000 7f4b645ff700 1 --2- 172.21.15.8:0/1504722630 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4b480a1510 0x7f4b480a39d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4b58003780 tx=0x7f4b58005e80 comp rx=0 tx=0).stop 2023-12-17T12:02:59.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.545+0000 7f4b645ff700 1 -- 172.21.15.8:0/1504722630 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b5c103030 msgr2=0x7f4b5c1a0af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:59.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.545+0000 7f4b645ff700 1 --2- 172.21.15.8:0/1504722630 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b5c103030 0x7f4b5c1a0af0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4b54007f10 tx=0x7f4b5400d3b0 comp rx=0 tx=0).stop 2023-12-17T12:02:59.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.545+0000 7f4b645ff700 1 -- 172.21.15.8:0/1504722630 shutdown_connections 2023-12-17T12:02:59.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.545+0000 7f4b645ff700 1 --2- 172.21.15.8:0/1504722630 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4b480a1510 0x7f4b480a39d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:59.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.545+0000 7f4b645ff700 1 --2- 172.21.15.8:0/1504722630 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4b5c103030 0x7f4b5c1a0af0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:59.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.545+0000 7f4b645ff700 1 --2- 172.21.15.8:0/1504722630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4b5c1014a0 0x7f4b5c199590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:59.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.545+0000 7f4b645ff700 1 --2- 172.21.15.8:0/1504722630 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4b5c102690 0x7f4b5c199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:59.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.545+0000 7f4b645ff700 1 -- 172.21.15.8:0/1504722630 >> 172.21.15.8:0/1504722630 conn(0x7f4b5c0fca10 msgr2=0x7f4b5c107eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:59.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.545+0000 7f4b645ff700 1 -- 172.21.15.8:0/1504722630 shutdown_connections 2023-12-17T12:02:59.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.546+0000 7f4b645ff700 1 -- 172.21.15.8:0/1504722630 wait complete. 2023-12-17T12:02:59.566 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-17T12:02:59.566 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-17T12:02:59.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.769+0000 7fcab67ff700 1 -- 172.21.15.8:0/498442839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcab0102690 msgr2=0x7fcab0102af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:59.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.769+0000 7fcab67ff700 1 --2- 172.21.15.8:0/498442839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcab0102690 0x7fcab0102af0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcaa40099c0 tx=0x7fcaa4009cd0 comp rx=0 tx=0).stop 2023-12-17T12:02:59.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.770+0000 7fcab67ff700 1 -- 172.21.15.8:0/498442839 shutdown_connections 2023-12-17T12:02:59.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.770+0000 7fcab67ff700 1 --2- 172.21.15.8:0/498442839 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcab0103030 0x7fcab01098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:59.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.770+0000 7fcab67ff700 1 --2- 172.21.15.8:0/498442839 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcab01014a0 0x7fcab01018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:59.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.770+0000 7fcab67ff700 1 --2- 172.21.15.8:0/498442839 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcab0102690 0x7fcab0102af0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:59.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.770+0000 7fcab67ff700 1 -- 172.21.15.8:0/498442839 >> 172.21.15.8:0/498442839 conn(0x7fcab00fca10 msgr2=0x7fcab00fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:02:59.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.770+0000 7fcab67ff700 1 -- 172.21.15.8:0/498442839 shutdown_connections 2023-12-17T12:02:59.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.770+0000 7fcab67ff700 1 -- 172.21.15.8:0/498442839 wait complete. 2023-12-17T12:02:59.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.771+0000 7fcab67ff700 1 Processor -- start 2023-12-17T12:02:59.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.771+0000 7fcab67ff700 1 -- start start 2023-12-17T12:02:59.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.771+0000 7fcab67ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcab01014a0 0x7fcab0197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:59.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.771+0000 7fcab67ff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcab0102690 0x7fcab0197870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:59.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.771+0000 7fcab67ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcab0103030 0x7fcab019e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:59.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.771+0000 7fcab67ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab019ee60 con 0x7fcab01014a0 2023-12-17T12:02:59.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.771+0000 7fcab67ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab019efa0 con 0x7fcab0103030 2023-12-17T12:02:59.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.771+0000 7fcab67ff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab019f130 con 0x7fcab0102690 2023-12-17T12:02:59.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.771+0000 7fcaaffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcab01014a0 0x7fcab0197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:59.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.771+0000 7fcaaffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcab01014a0 0x7fcab0197330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56430/0 (socket says 172.21.15.8:56430) 2023-12-17T12:02:59.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.771+0000 7fcaaffff700 1 -- 172.21.15.8:0/912186941 learned_addr learned my addr 172.21.15.8:0/912186941 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:02:59.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.772+0000 7fcaaf7fe700 1 --2- 172.21.15.8:0/912186941 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcab0102690 0x7fcab0197870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:59.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.772+0000 7fcab4d9c700 1 --2- 172.21.15.8:0/912186941 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcab0103030 0x7fcab019e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:59.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.772+0000 7fcaaffff700 1 -- 172.21.15.8:0/912186941 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcab0102690 msgr2=0x7fcab0197870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:59.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.772+0000 7fcaaffff700 1 --2- 172.21.15.8:0/912186941 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcab0102690 0x7fcab0197870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:59.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.772+0000 7fcaaffff700 1 -- 172.21.15.8:0/912186941 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcab0103030 msgr2=0x7fcab019e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:02:59.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.772+0000 7fcaaffff700 1 --2- 172.21.15.8:0/912186941 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcab0103030 0x7fcab019e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:02:59.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.772+0000 7fcaaffff700 1 -- 172.21.15.8:0/912186941 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa40095f0 con 0x7fcab01014a0 2023-12-17T12:02:59.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.772+0000 7fcaaf7fe700 1 --2- 172.21.15.8:0/912186941 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcab0102690 0x7fcab0197870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T12:02:59.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.772+0000 7fcaaffff700 1 --2- 172.21.15.8:0/912186941 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcab01014a0 0x7fcab0197330 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcaa000e970 tx=0x7fcaa000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:59.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.772+0000 7fcaad7fa700 1 -- 172.21.15.8:0/912186941 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa0009790 con 0x7fcab01014a0 2023-12-17T12:02:59.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.772+0000 7fcab67ff700 1 -- 172.21.15.8:0/912186941 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcab019f410 con 0x7fcab01014a0 2023-12-17T12:02:59.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.772+0000 7fcaad7fa700 1 -- 172.21.15.8:0/912186941 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcaa00044b0 con 0x7fcab01014a0 2023-12-17T12:02:59.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.772+0000 7fcaad7fa700 1 -- 172.21.15.8:0/912186941 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa0003dd0 con 0x7fcab01014a0 2023-12-17T12:02:59.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.773+0000 7fcab67ff700 1 -- 172.21.15.8:0/912186941 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcab019f920 con 0x7fcab01014a0 2023-12-17T12:02:59.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.774+0000 7fcab67ff700 1 -- 172.21.15.8:0/912186941 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcab01089c0 con 0x7fcab01014a0 2023-12-17T12:02:59.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.775+0000 7fcaad7fa700 1 -- 172.21.15.8:0/912186941 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7fcaa0004000 con 0x7fcab01014a0 2023-12-17T12:02:59.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.778+0000 7fcaad7fa700 1 --2- 172.21.15.8:0/912186941 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fca980a1510 0x7fca980a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:02:59.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.778+0000 7fcaad7fa700 1 -- 172.21.15.8:0/912186941 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fcaa0014070 con 0x7fcab01014a0 2023-12-17T12:02:59.779 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.778+0000 7fcaaf7fe700 1 --2- 172.21.15.8:0/912186941 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fca980a1510 0x7fca980a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:02:59.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.778+0000 7fcaaf7fe700 1 --2- 172.21.15.8:0/912186941 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fca980a1510 0x7fca980a39d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcaa400b580 tx=0x7fcaa401a040 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:02:59.783 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.782+0000 7fcaad7fa700 1 -- 172.21.15.8:0/912186941 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fcaa00966d0 con 0x7fcab01014a0 2023-12-17T12:02:59.916 INFO:journalctl@ceph.mds.b.smithi100.stdout:Dec 17 12:02:59 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-b[76415]: 2023-12-17T12:02:59.445+0000 7f06b8dcd700 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2023-12-17T12:02:59.916 INFO:journalctl@ceph.mds.b.smithi100.stdout:Dec 17 12:02:59 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-b[76415]: 2023-12-17T12:02:59.445+0000 7f06b8dcd700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2023-12-17T12:02:59.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:02:59.993+0000 7fcab67ff700 1 -- 172.21.15.8:0/912186941 --> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcab002d3b0 con 0x7fca980a1510 2023-12-17T12:03:00.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.006+0000 7fcaad7fa700 1 -- 172.21.15.8:0/912186941 <== mgr.14154 v2:172.21.15.8:6800/268548699 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+334885 (secure 0 0 0) 0x7fcab002d3b0 con 0x7fca980a1510 2023-12-17T12:03:00.012 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:03:00.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.011+0000 7fcab67ff700 1 -- 172.21.15.8:0/912186941 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fca980a1510 msgr2=0x7fca980a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:00.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.011+0000 7fcab67ff700 1 --2- 172.21.15.8:0/912186941 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fca980a1510 0x7fca980a39d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcaa400b580 tx=0x7fcaa401a040 comp rx=0 tx=0).stop 2023-12-17T12:03:00.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.011+0000 7fcab67ff700 1 -- 172.21.15.8:0/912186941 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcab01014a0 msgr2=0x7fcab0197330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:00.015 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.011+0000 7fcab67ff700 1 --2- 172.21.15.8:0/912186941 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcab01014a0 0x7fcab0197330 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fcaa000e970 tx=0x7fcaa000ed30 comp rx=0 tx=0).stop 2023-12-17T12:03:00.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.011+0000 7fcab67ff700 1 -- 172.21.15.8:0/912186941 shutdown_connections 2023-12-17T12:03:00.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.011+0000 7fcab67ff700 1 --2- 172.21.15.8:0/912186941 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fca980a1510 0x7fca980a39d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:00.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.011+0000 7fcab67ff700 1 --2- 172.21.15.8:0/912186941 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fcab0103030 0x7fcab019e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:00.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.011+0000 7fcab67ff700 1 --2- 172.21.15.8:0/912186941 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fcab01014a0 0x7fcab0197330 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:00.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.011+0000 7fcab67ff700 1 --2- 172.21.15.8:0/912186941 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcab0102690 0x7fcab0197870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:00.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.011+0000 7fcab67ff700 1 -- 172.21.15.8:0/912186941 >> 172.21.15.8:0/912186941 conn(0x7fcab00fca10 msgr2=0x7fcab0105b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:00.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.011+0000 7fcab67ff700 1 -- 172.21.15.8:0/912186941 shutdown_connections 2023-12-17T12:03:00.016 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.011+0000 7fcab67ff700 1 -- 172.21.15.8:0/912186941 wait complete. 2023-12-17T12:03:00.016 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-12-17T12:03:00.032 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":269,"stamp":"2023-12-17T12:02:59.441031+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":614928,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":165,"num_read_kb":142,"num_write":362,"num_write_kb":3010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":55,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":292,"ondisk_log_size":292,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":282,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335044,"kb_used_data":10840,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606780,"statfs":{"total":1151940427776,"available":1151597342720,"internally_reserved":0,"allocated":11100160,"data_stored":6968835,"data_compressed":108432,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19138,"internal_metadata":331855166},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":24560,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":39,"num_read_kb":33,"num_write":181,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":55,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.783769"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.939655+0000","last_change":"2023-12-17T12:02:50.685108+0000","last_active":"2023-12-17T12:02:51.939655+0000","last_peered":"2023-12-17T12:02:51.939655+0000","last_clean":"2023-12-17T12:02:51.939655+0000","last_became_active":"2023-12-17T12:02:50.684394+0000","last_became_peered":"2023-12-17T12:02:50.684394+0000","last_unstale":"2023-12-17T12:02:51.939655+0000","last_undegraded":"2023-12-17T12:02:51.939655+0000","last_fullsized":"2023-12-17T12:02:51.939655+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:42:03.271558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.941125+0000","last_change":"2023-12-17T12:02:50.676657+0000","last_active":"2023-12-17T12:02:51.941125+0000","last_peered":"2023-12-17T12:02:51.941125+0000","last_clean":"2023-12-17T12:02:51.941125+0000","last_became_active":"2023-12-17T12:02:50.676310+0000","last_became_peered":"2023-12-17T12:02:50.676310+0000","last_unstale":"2023-12-17T12:02:51.941125+0000","last_undegraded":"2023-12-17T12:02:51.941125+0000","last_fullsized":"2023-12-17T12:02:51.941125+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:58:16.704219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.940923+0000","last_change":"2023-12-17T12:02:50.691978+0000","last_active":"2023-12-17T12:02:51.940923+0000","last_peered":"2023-12-17T12:02:51.940923+0000","last_clean":"2023-12-17T12:02:51.940923+0000","last_became_active":"2023-12-17T12:02:50.691639+0000","last_became_peered":"2023-12-17T12:02:50.691639+0000","last_unstale":"2023-12-17T12:02:51.940923+0000","last_undegraded":"2023-12-17T12:02:51.940923+0000","last_fullsized":"2023-12-17T12:02:51.940923+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:55:24.002885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.939301+0000","last_change":"2023-12-17T12:02:50.687062+0000","last_active":"2023-12-17T12:02:51.939301+0000","last_peered":"2023-12-17T12:02:51.939301+0000","last_clean":"2023-12-17T12:02:51.939301+0000","last_became_active":"2023-12-17T12:02:50.685906+0000","last_became_peered":"2023-12-17T12:02:50.685906+0000","last_unstale":"2023-12-17T12:02:51.939301+0000","last_undegraded":"2023-12-17T12:02:51.939301+0000","last_fullsized":"2023-12-17T12:02:51.939301+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:15:22.367700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.669679+0000","last_change":"2023-12-17T12:02:50.681528+0000","last_active":"2023-12-17T12:02:51.669679+0000","last_peered":"2023-12-17T12:02:51.669679+0000","last_clean":"2023-12-17T12:02:51.669679+0000","last_became_active":"2023-12-17T12:02:50.681206+0000","last_became_peered":"2023-12-17T12:02:50.681206+0000","last_unstale":"2023-12-17T12:02:51.669679+0000","last_undegraded":"2023-12-17T12:02:51.669679+0000","last_fullsized":"2023-12-17T12:02:51.669679+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:46:48.146735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.939349+0000","last_change":"2023-12-17T12:02:50.678512+0000","last_active":"2023-12-17T12:02:51.939349+0000","last_peered":"2023-12-17T12:02:51.939349+0000","last_clean":"2023-12-17T12:02:51.939349+0000","last_became_active":"2023-12-17T12:02:50.678157+0000","last_became_peered":"2023-12-17T12:02:50.678157+0000","last_unstale":"2023-12-17T12:02:51.939349+0000","last_undegraded":"2023-12-17T12:02:51.939349+0000","last_fullsized":"2023-12-17T12:02:51.939349+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:03:39.313077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.813223+0000","last_change":"2023-12-17T12:02:50.677804+0000","last_active":"2023-12-17T12:02:51.813223+0000","last_peered":"2023-12-17T12:02:51.813223+0000","last_clean":"2023-12-17T12:02:51.813223+0000","last_became_active":"2023-12-17T12:02:50.677453+0000","last_became_peered":"2023-12-17T12:02:50.677453+0000","last_unstale":"2023-12-17T12:02:51.813223+0000","last_undegraded":"2023-12-17T12:02:51.813223+0000","last_fullsized":"2023-12-17T12:02:51.813223+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:16:09.552128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.939321+0000","last_change":"2023-12-17T12:02:50.687583+0000","last_active":"2023-12-17T12:02:51.939321+0000","last_peered":"2023-12-17T12:02:51.939321+0000","last_clean":"2023-12-17T12:02:51.939321+0000","last_became_active":"2023-12-17T12:02:50.687232+0000","last_became_peered":"2023-12-17T12:02:50.687232+0000","last_unstale":"2023-12-17T12:02:51.939321+0000","last_undegraded":"2023-12-17T12:02:51.939321+0000","last_fullsized":"2023-12-17T12:02:51.939321+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:48:22.795244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.668726+0000","last_change":"2023-12-17T12:02:50.683443+0000","last_active":"2023-12-17T12:02:51.668726+0000","last_peered":"2023-12-17T12:02:51.668726+0000","last_clean":"2023-12-17T12:02:51.668726+0000","last_became_active":"2023-12-17T12:02:50.683092+0000","last_became_peered":"2023-12-17T12:02:50.683092+0000","last_unstale":"2023-12-17T12:02:51.668726+0000","last_undegraded":"2023-12-17T12:02:51.668726+0000","last_fullsized":"2023-12-17T12:02:51.668726+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:56:24.455890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.939764+0000","last_change":"2023-12-17T12:02:50.689885+0000","last_active":"2023-12-17T12:02:51.939764+0000","last_peered":"2023-12-17T12:02:51.939764+0000","last_clean":"2023-12-17T12:02:51.939764+0000","last_became_active":"2023-12-17T12:02:50.689312+0000","last_became_peered":"2023-12-17T12:02:50.689312+0000","last_unstale":"2023-12-17T12:02:51.939764+0000","last_undegraded":"2023-12-17T12:02:51.939764+0000","last_fullsized":"2023-12-17T12:02:51.939764+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:23:35.348565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.813498+0000","last_change":"2023-12-17T12:02:50.684120+0000","last_active":"2023-12-17T12:02:51.813498+0000","last_peered":"2023-12-17T12:02:51.813498+0000","last_clean":"2023-12-17T12:02:51.813498+0000","last_became_active":"2023-12-17T12:02:50.683811+0000","last_became_peered":"2023-12-17T12:02:50.683811+0000","last_unstale":"2023-12-17T12:02:51.813498+0000","last_undegraded":"2023-12-17T12:02:51.813498+0000","last_fullsized":"2023-12-17T12:02:51.813498+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:58:14.651264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.939215+0000","last_change":"2023-12-17T12:02:50.678350+0000","last_active":"2023-12-17T12:02:51.939215+0000","last_peered":"2023-12-17T12:02:51.939215+0000","last_clean":"2023-12-17T12:02:51.939215+0000","last_became_active":"2023-12-17T12:02:50.677640+0000","last_became_peered":"2023-12-17T12:02:50.677640+0000","last_unstale":"2023-12-17T12:02:51.939215+0000","last_undegraded":"2023-12-17T12:02:51.939215+0000","last_fullsized":"2023-12-17T12:02:51.939215+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:01:54.303216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.940127+0000","last_change":"2023-12-17T12:02:50.686173+0000","last_active":"2023-12-17T12:02:51.940127+0000","last_peered":"2023-12-17T12:02:51.940127+0000","last_clean":"2023-12-17T12:02:51.940127+0000","last_became_active":"2023-12-17T12:02:50.685839+0000","last_became_peered":"2023-12-17T12:02:50.685839+0000","last_unstale":"2023-12-17T12:02:51.940127+0000","last_undegraded":"2023-12-17T12:02:51.940127+0000","last_fullsized":"2023-12-17T12:02:51.940127+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:11:09.034032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.938592+0000","last_change":"2023-12-17T12:02:50.686975+0000","last_active":"2023-12-17T12:02:51.938592+0000","last_peered":"2023-12-17T12:02:51.938592+0000","last_clean":"2023-12-17T12:02:51.938592+0000","last_became_active":"2023-12-17T12:02:50.684301+0000","last_became_peered":"2023-12-17T12:02:50.684301+0000","last_unstale":"2023-12-17T12:02:51.938592+0000","last_undegraded":"2023-12-17T12:02:51.938592+0000","last_fullsized":"2023-12-17T12:02:51.938592+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:43:43.676085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.938523+0000","last_change":"2023-12-17T12:02:50.683486+0000","last_active":"2023-12-17T12:02:51.938523+0000","last_peered":"2023-12-17T12:02:51.938523+0000","last_clean":"2023-12-17T12:02:51.938523+0000","last_became_active":"2023-12-17T12:02:50.683143+0000","last_became_peered":"2023-12-17T12:02:50.683143+0000","last_unstale":"2023-12-17T12:02:51.938523+0000","last_undegraded":"2023-12-17T12:02:51.938523+0000","last_fullsized":"2023-12-17T12:02:51.938523+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:25:02.498460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.667976+0000","last_change":"2023-12-17T12:02:50.691615+0000","last_active":"2023-12-17T12:02:51.667976+0000","last_peered":"2023-12-17T12:02:51.667976+0000","last_clean":"2023-12-17T12:02:51.667976+0000","last_became_active":"2023-12-17T12:02:50.690942+0000","last_became_peered":"2023-12-17T12:02:50.690942+0000","last_unstale":"2023-12-17T12:02:51.667976+0000","last_undegraded":"2023-12-17T12:02:51.667976+0000","last_fullsized":"2023-12-17T12:02:51.667976+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:29:03.412722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.939680+0000","last_change":"2023-12-17T12:02:50.685709+0000","last_active":"2023-12-17T12:02:51.939680+0000","last_peered":"2023-12-17T12:02:51.939680+0000","last_clean":"2023-12-17T12:02:51.939680+0000","last_became_active":"2023-12-17T12:02:50.685111+0000","last_became_peered":"2023-12-17T12:02:50.685111+0000","last_unstale":"2023-12-17T12:02:51.939680+0000","last_undegraded":"2023-12-17T12:02:51.939680+0000","last_fullsized":"2023-12-17T12:02:51.939680+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:26:56.486285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.939283+0000","last_change":"2023-12-17T12:02:50.683639+0000","last_active":"2023-12-17T12:02:51.939283+0000","last_peered":"2023-12-17T12:02:51.939283+0000","last_clean":"2023-12-17T12:02:51.939283+0000","last_became_active":"2023-12-17T12:02:50.683267+0000","last_became_peered":"2023-12-17T12:02:50.683267+0000","last_unstale":"2023-12-17T12:02:51.939283+0000","last_undegraded":"2023-12-17T12:02:51.939283+0000","last_fullsized":"2023-12-17T12:02:51.939283+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:09:01.026688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.671313+0000","last_change":"2023-12-17T12:02:50.690116+0000","last_active":"2023-12-17T12:02:51.671313+0000","last_peered":"2023-12-17T12:02:51.671313+0000","last_clean":"2023-12-17T12:02:51.671313+0000","last_became_active":"2023-12-17T12:02:50.688731+0000","last_became_peered":"2023-12-17T12:02:50.688731+0000","last_unstale":"2023-12-17T12:02:51.671313+0000","last_undegraded":"2023-12-17T12:02:51.671313+0000","last_fullsized":"2023-12-17T12:02:51.671313+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:21:37.730460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'9","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:54.996773+0000","last_change":"2023-12-17T12:02:49.662068+0000","last_active":"2023-12-17T12:02:54.996773+0000","last_peered":"2023-12-17T12:02:54.996773+0000","last_clean":"2023-12-17T12:02:54.996773+0000","last_became_active":"2023-12-17T12:02:49.661755+0000","last_became_peered":"2023-12-17T12:02:49.661755+0000","last_unstale":"2023-12-17T12:02:54.996773+0000","last_undegraded":"2023-12-17T12:02:54.996773+0000","last_fullsized":"2023-12-17T12:02:54.996773+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:51:16.128618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.940109+0000","last_change":"2023-12-17T12:02:50.687855+0000","last_active":"2023-12-17T12:02:51.940109+0000","last_peered":"2023-12-17T12:02:51.940109+0000","last_clean":"2023-12-17T12:02:51.940109+0000","last_became_active":"2023-12-17T12:02:50.687567+0000","last_became_peered":"2023-12-17T12:02:50.687567+0000","last_unstale":"2023-12-17T12:02:51.940109+0000","last_undegraded":"2023-12-17T12:02:51.940109+0000","last_fullsized":"2023-12-17T12:02:51.940109+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:49:51.627898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-17T12:02:50.990596+0000","last_change":"2023-12-17T12:02:49.673995+0000","last_active":"2023-12-17T12:02:50.990596+0000","last_peered":"2023-12-17T12:02:50.990596+0000","last_clean":"2023-12-17T12:02:50.990596+0000","last_became_active":"2023-12-17T12:02:49.673509+0000","last_became_peered":"2023-12-17T12:02:49.673509+0000","last_unstale":"2023-12-17T12:02:50.990596+0000","last_undegraded":"2023-12-17T12:02:50.990596+0000","last_fullsized":"2023-12-17T12:02:50.990596+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:53:19.695998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.941209+0000","last_change":"2023-12-17T12:02:50.687537+0000","last_active":"2023-12-17T12:02:51.941209+0000","last_peered":"2023-12-17T12:02:51.941209+0000","last_clean":"2023-12-17T12:02:51.941209+0000","last_became_active":"2023-12-17T12:02:50.687203+0000","last_became_peered":"2023-12-17T12:02:50.687203+0000","last_unstale":"2023-12-17T12:02:51.941209+0000","last_undegraded":"2023-12-17T12:02:51.941209+0000","last_fullsized":"2023-12-17T12:02:51.941209+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:08:27.551628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'11","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:57.038095+0000","last_change":"2023-12-17T12:02:49.666605+0000","last_active":"2023-12-17T12:02:57.038095+0000","last_peered":"2023-12-17T12:02:57.038095+0000","last_clean":"2023-12-17T12:02:57.038095+0000","last_became_active":"2023-12-17T12:02:49.666203+0000","last_became_peered":"2023-12-17T12:02:49.666203+0000","last_unstale":"2023-12-17T12:02:57.038095+0000","last_undegraded":"2023-12-17T12:02:57.038095+0000","last_fullsized":"2023-12-17T12:02:57.038095+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:06:19.429798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.668177+0000","last_change":"2023-12-17T12:02:50.683718+0000","last_active":"2023-12-17T12:02:51.668177+0000","last_peered":"2023-12-17T12:02:51.668177+0000","last_clean":"2023-12-17T12:02:51.668177+0000","last_became_active":"2023-12-17T12:02:50.683417+0000","last_became_peered":"2023-12-17T12:02:50.683417+0000","last_unstale":"2023-12-17T12:02:51.668177+0000","last_undegraded":"2023-12-17T12:02:51.668177+0000","last_fullsized":"2023-12-17T12:02:51.668177+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:10:10.662913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:57.036195+0000","last_change":"2023-12-17T12:02:49.667711+0000","last_active":"2023-12-17T12:02:57.036195+0000","last_peered":"2023-12-17T12:02:57.036195+0000","last_clean":"2023-12-17T12:02:57.036195+0000","last_became_active":"2023-12-17T12:02:49.667358+0000","last_became_peered":"2023-12-17T12:02:49.667358+0000","last_unstale":"2023-12-17T12:02:57.036195+0000","last_undegraded":"2023-12-17T12:02:57.036195+0000","last_fullsized":"2023-12-17T12:02:57.036195+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:54:38.336318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.939200+0000","last_change":"2023-12-17T12:02:50.684036+0000","last_active":"2023-12-17T12:02:51.939200+0000","last_peered":"2023-12-17T12:02:51.939200+0000","last_clean":"2023-12-17T12:02:51.939200+0000","last_became_active":"2023-12-17T12:02:50.683580+0000","last_became_peered":"2023-12-17T12:02:50.683580+0000","last_unstale":"2023-12-17T12:02:51.939200+0000","last_undegraded":"2023-12-17T12:02:51.939200+0000","last_fullsized":"2023-12-17T12:02:51.939200+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:08:40.380574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'5","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:54.984155+0000","last_change":"2023-12-17T12:02:49.664481+0000","last_active":"2023-12-17T12:02:54.984155+0000","last_peered":"2023-12-17T12:02:54.984155+0000","last_clean":"2023-12-17T12:02:54.984155+0000","last_became_active":"2023-12-17T12:02:49.659106+0000","last_became_peered":"2023-12-17T12:02:49.659106+0000","last_unstale":"2023-12-17T12:02:54.984155+0000","last_undegraded":"2023-12-17T12:02:54.984155+0000","last_fullsized":"2023-12-17T12:02:54.984155+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:41:05.093724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.669500+0000","last_change":"2023-12-17T12:02:50.677862+0000","last_active":"2023-12-17T12:02:51.669500+0000","last_peered":"2023-12-17T12:02:51.669500+0000","last_clean":"2023-12-17T12:02:51.669500+0000","last_became_active":"2023-12-17T12:02:50.677511+0000","last_became_peered":"2023-12-17T12:02:50.677511+0000","last_unstale":"2023-12-17T12:02:51.669500+0000","last_undegraded":"2023-12-17T12:02:51.669500+0000","last_fullsized":"2023-12-17T12:02:51.669500+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:16:05.792201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:56.021944+0000","last_change":"2023-12-17T12:02:49.654735+0000","last_active":"2023-12-17T12:02:56.021944+0000","last_peered":"2023-12-17T12:02:56.021944+0000","last_clean":"2023-12-17T12:02:56.021944+0000","last_became_active":"2023-12-17T12:02:49.654192+0000","last_became_peered":"2023-12-17T12:02:49.654192+0000","last_unstale":"2023-12-17T12:02:56.021944+0000","last_undegraded":"2023-12-17T12:02:56.021944+0000","last_fullsized":"2023-12-17T12:02:56.021944+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:37:04.500685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.938750+0000","last_change":"2023-12-17T12:02:50.676395+0000","last_active":"2023-12-17T12:02:51.938750+0000","last_peered":"2023-12-17T12:02:51.938750+0000","last_clean":"2023-12-17T12:02:51.938750+0000","last_became_active":"2023-12-17T12:02:50.675969+0000","last_became_peered":"2023-12-17T12:02:50.675969+0000","last_unstale":"2023-12-17T12:02:51.938750+0000","last_undegraded":"2023-12-17T12:02:51.938750+0000","last_fullsized":"2023-12-17T12:02:51.938750+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:36:27.541564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:54.998329+0000","last_change":"2023-12-17T12:02:49.660990+0000","last_active":"2023-12-17T12:02:54.998329+0000","last_peered":"2023-12-17T12:02:54.998329+0000","last_clean":"2023-12-17T12:02:54.998329+0000","last_became_active":"2023-12-17T12:02:49.660623+0000","last_became_peered":"2023-12-17T12:02:49.660623+0000","last_unstale":"2023-12-17T12:02:54.998329+0000","last_undegraded":"2023-12-17T12:02:54.998329+0000","last_fullsized":"2023-12-17T12:02:54.998329+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:59:58.462681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.939183+0000","last_change":"2023-12-17T12:02:50.677481+0000","last_active":"2023-12-17T12:02:51.939183+0000","last_peered":"2023-12-17T12:02:51.939183+0000","last_clean":"2023-12-17T12:02:51.939183+0000","last_became_active":"2023-12-17T12:02:50.677101+0000","last_became_peered":"2023-12-17T12:02:50.677101+0000","last_unstale":"2023-12-17T12:02:51.939183+0000","last_undegraded":"2023-12-17T12:02:51.939183+0000","last_fullsized":"2023-12-17T12:02:51.939183+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:47:24.777071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.938296+0000","last_change":"2023-12-17T12:02:49.662973+0000","last_active":"2023-12-17T12:02:51.938296+0000","last_peered":"2023-12-17T12:02:51.938296+0000","last_clean":"2023-12-17T12:02:51.938296+0000","last_became_active":"2023-12-17T12:02:49.662653+0000","last_became_peered":"2023-12-17T12:02:49.662653+0000","last_unstale":"2023-12-17T12:02:51.938296+0000","last_undegraded":"2023-12-17T12:02:51.938296+0000","last_fullsized":"2023-12-17T12:02:51.938296+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:01:34.858207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.938759+0000","last_change":"2023-12-17T12:02:50.684823+0000","last_active":"2023-12-17T12:02:51.938759+0000","last_peered":"2023-12-17T12:02:51.938759+0000","last_clean":"2023-12-17T12:02:51.938759+0000","last_became_active":"2023-12-17T12:02:50.684437+0000","last_became_peered":"2023-12-17T12:02:50.684437+0000","last_unstale":"2023-12-17T12:02:51.938759+0000","last_undegraded":"2023-12-17T12:02:51.938759+0000","last_fullsized":"2023-12-17T12:02:51.938759+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:16:15.230812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:56.021735+0000","last_change":"2023-12-17T12:02:49.656001+0000","last_active":"2023-12-17T12:02:56.021735+0000","last_peered":"2023-12-17T12:02:56.021735+0000","last_clean":"2023-12-17T12:02:56.021735+0000","last_became_active":"2023-12-17T12:02:49.655292+0000","last_became_peered":"2023-12-17T12:02:49.655292+0000","last_unstale":"2023-12-17T12:02:56.021735+0000","last_undegraded":"2023-12-17T12:02:56.021735+0000","last_fullsized":"2023-12-17T12:02:56.021735+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:41:34.836929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.668670+0000","last_change":"2023-12-17T12:02:50.692734+0000","last_active":"2023-12-17T12:02:51.668670+0000","last_peered":"2023-12-17T12:02:51.668670+0000","last_clean":"2023-12-17T12:02:51.668670+0000","last_became_active":"2023-12-17T12:02:50.691567+0000","last_became_peered":"2023-12-17T12:02:50.691567+0000","last_unstale":"2023-12-17T12:02:51.668670+0000","last_undegraded":"2023-12-17T12:02:51.668670+0000","last_fullsized":"2023-12-17T12:02:51.668670+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:23:39.685352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:54.014453+0000","last_change":"2023-12-17T12:02:49.664634+0000","last_active":"2023-12-17T12:02:54.014453+0000","last_peered":"2023-12-17T12:02:54.014453+0000","last_clean":"2023-12-17T12:02:54.014453+0000","last_became_active":"2023-12-17T12:02:49.664260+0000","last_became_peered":"2023-12-17T12:02:49.664260+0000","last_unstale":"2023-12-17T12:02:54.014453+0000","last_undegraded":"2023-12-17T12:02:54.014453+0000","last_fullsized":"2023-12-17T12:02:54.014453+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:55:06.887646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.941299+0000","last_change":"2023-12-17T12:02:50.679341+0000","last_active":"2023-12-17T12:02:51.941299+0000","last_peered":"2023-12-17T12:02:51.941299+0000","last_clean":"2023-12-17T12:02:51.941299+0000","last_became_active":"2023-12-17T12:02:50.677115+0000","last_became_peered":"2023-12-17T12:02:50.677115+0000","last_unstale":"2023-12-17T12:02:51.941299+0000","last_undegraded":"2023-12-17T12:02:51.941299+0000","last_fullsized":"2023-12-17T12:02:51.941299+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:59:09.665514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:54.014406+0000","last_change":"2023-12-17T12:02:49.653748+0000","last_active":"2023-12-17T12:02:54.014406+0000","last_peered":"2023-12-17T12:02:54.014406+0000","last_clean":"2023-12-17T12:02:54.014406+0000","last_became_active":"2023-12-17T12:02:49.652647+0000","last_became_peered":"2023-12-17T12:02:49.652647+0000","last_unstale":"2023-12-17T12:02:54.014406+0000","last_undegraded":"2023-12-17T12:02:54.014406+0000","last_fullsized":"2023-12-17T12:02:54.014406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:13:40.817124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.668473+0000","last_change":"2023-12-17T12:02:50.686787+0000","last_active":"2023-12-17T12:02:51.668473+0000","last_peered":"2023-12-17T12:02:51.668473+0000","last_clean":"2023-12-17T12:02:51.668473+0000","last_became_active":"2023-12-17T12:02:50.685133+0000","last_became_peered":"2023-12-17T12:02:50.685133+0000","last_unstale":"2023-12-17T12:02:51.668473+0000","last_undegraded":"2023-12-17T12:02:51.668473+0000","last_fullsized":"2023-12-17T12:02:51.668473+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:35:17.972258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'16","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:57.059889+0000","last_change":"2023-12-17T12:02:49.662054+0000","last_active":"2023-12-17T12:02:57.059889+0000","last_peered":"2023-12-17T12:02:57.059889+0000","last_clean":"2023-12-17T12:02:57.059889+0000","last_became_active":"2023-12-17T12:02:49.661675+0000","last_became_peered":"2023-12-17T12:02:49.661675+0000","last_unstale":"2023-12-17T12:02:57.059889+0000","last_undegraded":"2023-12-17T12:02:57.059889+0000","last_fullsized":"2023-12-17T12:02:57.059889+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:44:32.547926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18976,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":18,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.670339+0000","last_change":"2023-12-17T12:02:50.678514+0000","last_active":"2023-12-17T12:02:51.670339+0000","last_peered":"2023-12-17T12:02:51.670339+0000","last_clean":"2023-12-17T12:02:51.670339+0000","last_became_active":"2023-12-17T12:02:50.677739+0000","last_became_peered":"2023-12-17T12:02:50.677739+0000","last_unstale":"2023-12-17T12:02:51.670339+0000","last_undegraded":"2023-12-17T12:02:51.670339+0000","last_fullsized":"2023-12-17T12:02:51.670339+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:42:36.269803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:57.032411+0000","last_change":"2023-12-17T12:02:49.655037+0000","last_active":"2023-12-17T12:02:57.032411+0000","last_peered":"2023-12-17T12:02:57.032411+0000","last_clean":"2023-12-17T12:02:57.032411+0000","last_became_active":"2023-12-17T12:02:49.654263+0000","last_became_peered":"2023-12-17T12:02:49.654263+0000","last_unstale":"2023-12-17T12:02:57.032411+0000","last_undegraded":"2023-12-17T12:02:57.032411+0000","last_fullsized":"2023-12-17T12:02:57.032411+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:42:16.512434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.940093+0000","last_change":"2023-12-17T12:02:50.682099+0000","last_active":"2023-12-17T12:02:51.940093+0000","last_peered":"2023-12-17T12:02:51.940093+0000","last_clean":"2023-12-17T12:02:51.940093+0000","last_became_active":"2023-12-17T12:02:50.681124+0000","last_became_peered":"2023-12-17T12:02:50.681124+0000","last_unstale":"2023-12-17T12:02:51.940093+0000","last_undegraded":"2023-12-17T12:02:51.940093+0000","last_fullsized":"2023-12-17T12:02:51.940093+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:03:25.163070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'3","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:54.014413+0000","last_change":"2023-12-17T12:02:49.660993+0000","last_active":"2023-12-17T12:02:54.014413+0000","last_peered":"2023-12-17T12:02:54.014413+0000","last_clean":"2023-12-17T12:02:54.014413+0000","last_became_active":"2023-12-17T12:02:49.658165+0000","last_became_peered":"2023-12-17T12:02:49.658165+0000","last_unstale":"2023-12-17T12:02:54.014413+0000","last_undegraded":"2023-12-17T12:02:54.014413+0000","last_fullsized":"2023-12-17T12:02:54.014413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:22:41.721994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.813550+0000","last_change":"2023-12-17T12:02:50.679349+0000","last_active":"2023-12-17T12:02:51.813550+0000","last_peered":"2023-12-17T12:02:51.813550+0000","last_clean":"2023-12-17T12:02:51.813550+0000","last_became_active":"2023-12-17T12:02:50.678932+0000","last_became_peered":"2023-12-17T12:02:50.678932+0000","last_unstale":"2023-12-17T12:02:51.813550+0000","last_undegraded":"2023-12-17T12:02:51.813550+0000","last_fullsized":"2023-12-17T12:02:51.813550+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:05:41.517038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'6","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:58.050598+0000","last_change":"2023-12-17T12:02:49.656800+0000","last_active":"2023-12-17T12:02:58.050598+0000","last_peered":"2023-12-17T12:02:58.050598+0000","last_clean":"2023-12-17T12:02:58.050598+0000","last_became_active":"2023-12-17T12:02:49.656440+0000","last_became_peered":"2023-12-17T12:02:49.656440+0000","last_unstale":"2023-12-17T12:02:58.050598+0000","last_undegraded":"2023-12-17T12:02:58.050598+0000","last_fullsized":"2023-12-17T12:02:58.050598+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:04:17.951090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":977,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.813165+0000","last_change":"2023-12-17T12:02:50.684650+0000","last_active":"2023-12-17T12:02:51.813165+0000","last_peered":"2023-12-17T12:02:51.813165+0000","last_clean":"2023-12-17T12:02:51.813165+0000","last_became_active":"2023-12-17T12:02:50.684209+0000","last_became_peered":"2023-12-17T12:02:50.684209+0000","last_unstale":"2023-12-17T12:02:51.813165+0000","last_undegraded":"2023-12-17T12:02:51.813165+0000","last_fullsized":"2023-12-17T12:02:51.813165+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:51:15.756837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:57.035776+0000","last_change":"2023-12-17T12:02:49.673270+0000","last_active":"2023-12-17T12:02:57.035776+0000","last_peered":"2023-12-17T12:02:57.035776+0000","last_clean":"2023-12-17T12:02:57.035776+0000","last_became_active":"2023-12-17T12:02:49.672935+0000","last_became_peered":"2023-12-17T12:02:49.672935+0000","last_unstale":"2023-12-17T12:02:57.035776+0000","last_undegraded":"2023-12-17T12:02:57.035776+0000","last_fullsized":"2023-12-17T12:02:57.035776+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:41:00.777171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.938498+0000","last_change":"2023-12-17T12:02:50.683449+0000","last_active":"2023-12-17T12:02:51.938498+0000","last_peered":"2023-12-17T12:02:51.938498+0000","last_clean":"2023-12-17T12:02:51.938498+0000","last_became_active":"2023-12-17T12:02:50.683138+0000","last_became_peered":"2023-12-17T12:02:50.683138+0000","last_unstale":"2023-12-17T12:02:51.938498+0000","last_undegraded":"2023-12-17T12:02:51.938498+0000","last_fullsized":"2023-12-17T12:02:51.938498+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:39:08.145766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:54.980589+0000","last_change":"2023-12-17T12:02:49.667849+0000","last_active":"2023-12-17T12:02:54.980589+0000","last_peered":"2023-12-17T12:02:54.980589+0000","last_clean":"2023-12-17T12:02:54.980589+0000","last_became_active":"2023-12-17T12:02:49.667565+0000","last_became_peered":"2023-12-17T12:02:49.667565+0000","last_unstale":"2023-12-17T12:02:54.980589+0000","last_undegraded":"2023-12-17T12:02:54.980589+0000","last_fullsized":"2023-12-17T12:02:54.980589+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:39:56.248614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.939401+0000","last_change":"2023-12-17T12:02:50.669342+0000","last_active":"2023-12-17T12:02:51.939401+0000","last_peered":"2023-12-17T12:02:51.939401+0000","last_clean":"2023-12-17T12:02:51.939401+0000","last_became_active":"2023-12-17T12:02:50.668007+0000","last_became_peered":"2023-12-17T12:02:50.668007+0000","last_unstale":"2023-12-17T12:02:51.939401+0000","last_undegraded":"2023-12-17T12:02:51.939401+0000","last_fullsized":"2023-12-17T12:02:51.939401+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:54:56.753474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-17T12:02:50.669944+0000","last_change":"2023-12-17T12:02:49.656914+0000","last_active":"2023-12-17T12:02:50.669944+0000","last_peered":"2023-12-17T12:02:50.669944+0000","last_clean":"2023-12-17T12:02:50.669944+0000","last_became_active":"2023-12-17T12:02:49.656531+0000","last_became_peered":"2023-12-17T12:02:49.656531+0000","last_unstale":"2023-12-17T12:02:50.669944+0000","last_undegraded":"2023-12-17T12:02:50.669944+0000","last_fullsized":"2023-12-17T12:02:50.669944+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:45:14.558037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'1","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:52.348724+0000","last_change":"2023-12-17T12:02:50.677659+0000","last_active":"2023-12-17T12:02:52.348724+0000","last_peered":"2023-12-17T12:02:52.348724+0000","last_clean":"2023-12-17T12:02:52.348724+0000","last_became_active":"2023-12-17T12:02:50.677311+0000","last_became_peered":"2023-12-17T12:02:50.677311+0000","last_unstale":"2023-12-17T12:02:52.348724+0000","last_undegraded":"2023-12-17T12:02:52.348724+0000","last_fullsized":"2023-12-17T12:02:52.348724+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:20:23.134613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-17T12:02:50.674617+0000","last_change":"2023-12-17T12:02:49.665031+0000","last_active":"2023-12-17T12:02:50.674617+0000","last_peered":"2023-12-17T12:02:50.674617+0000","last_clean":"2023-12-17T12:02:50.674617+0000","last_became_active":"2023-12-17T12:02:49.663004+0000","last_became_peered":"2023-12-17T12:02:49.663004+0000","last_unstale":"2023-12-17T12:02:50.674617+0000","last_undegraded":"2023-12-17T12:02:50.674617+0000","last_fullsized":"2023-12-17T12:02:50.674617+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:19:44.410346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.939345+0000","last_change":"2023-12-17T12:02:50.685113+0000","last_active":"2023-12-17T12:02:51.939345+0000","last_peered":"2023-12-17T12:02:51.939345+0000","last_clean":"2023-12-17T12:02:51.939345+0000","last_became_active":"2023-12-17T12:02:50.684804+0000","last_became_peered":"2023-12-17T12:02:50.684804+0000","last_unstale":"2023-12-17T12:02:51.939345+0000","last_undegraded":"2023-12-17T12:02:51.939345+0000","last_fullsized":"2023-12-17T12:02:51.939345+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:54:32.686360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.938696+0000","last_change":"2023-12-17T12:02:50.688514+0000","last_active":"2023-12-17T12:02:51.938696+0000","last_peered":"2023-12-17T12:02:51.938696+0000","last_clean":"2023-12-17T12:02:51.938696+0000","last_became_active":"2023-12-17T12:02:50.687800+0000","last_became_peered":"2023-12-17T12:02:50.687800+0000","last_unstale":"2023-12-17T12:02:51.938696+0000","last_undegraded":"2023-12-17T12:02:51.938696+0000","last_fullsized":"2023-12-17T12:02:51.938696+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:41:45.981241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:54.999221+0000","last_change":"2023-12-17T12:02:49.669423+0000","last_active":"2023-12-17T12:02:54.999221+0000","last_peered":"2023-12-17T12:02:54.999221+0000","last_clean":"2023-12-17T12:02:54.999221+0000","last_became_active":"2023-12-17T12:02:49.668652+0000","last_became_peered":"2023-12-17T12:02:49.668652+0000","last_unstale":"2023-12-17T12:02:54.999221+0000","last_undegraded":"2023-12-17T12:02:54.999221+0000","last_fullsized":"2023-12-17T12:02:54.999221+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:32:02.981652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.939451+0000","last_change":"2023-12-17T12:02:50.685913+0000","last_active":"2023-12-17T12:02:51.939451+0000","last_peered":"2023-12-17T12:02:51.939451+0000","last_clean":"2023-12-17T12:02:51.939451+0000","last_became_active":"2023-12-17T12:02:50.684652+0000","last_became_peered":"2023-12-17T12:02:50.684652+0000","last_unstale":"2023-12-17T12:02:51.939451+0000","last_undegraded":"2023-12-17T12:02:51.939451+0000","last_fullsized":"2023-12-17T12:02:51.939451+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:07:11.077987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:58.048059+0000","last_change":"2023-12-17T12:02:49.653594+0000","last_active":"2023-12-17T12:02:58.048059+0000","last_peered":"2023-12-17T12:02:58.048059+0000","last_clean":"2023-12-17T12:02:58.048059+0000","last_became_active":"2023-12-17T12:02:49.653183+0000","last_became_peered":"2023-12-17T12:02:49.653183+0000","last_unstale":"2023-12-17T12:02:58.048059+0000","last_undegraded":"2023-12-17T12:02:58.048059+0000","last_fullsized":"2023-12-17T12:02:58.048059+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:17:38.111876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":310,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-17T12:02:50.671310+0000","last_change":"2023-12-17T12:01:45.376881+0000","last_active":"2023-12-17T12:02:50.671310+0000","last_peered":"2023-12-17T12:02:50.671310+0000","last_clean":"2023-12-17T12:02:50.671310+0000","last_became_active":"2023-12-17T12:01:45.376453+0000","last_became_peered":"2023-12-17T12:01:45.376453+0000","last_unstale":"2023-12-17T12:02:50.671310+0000","last_undegraded":"2023-12-17T12:02:50.671310+0000","last_fullsized":"2023-12-17T12:02:50.671310+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:58:44.022902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:58:44.022902+0000","last_clean_scrub_stamp":"2023-12-17T11:58:44.022902+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:31:55.352161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.939022+0000","last_change":"2023-12-17T12:02:50.683902+0000","last_active":"2023-12-17T12:02:51.939022+0000","last_peered":"2023-12-17T12:02:51.939022+0000","last_clean":"2023-12-17T12:02:51.939022+0000","last_became_active":"2023-12-17T12:02:50.682977+0000","last_became_peered":"2023-12-17T12:02:50.682977+0000","last_unstale":"2023-12-17T12:02:51.939022+0000","last_undegraded":"2023-12-17T12:02:51.939022+0000","last_fullsized":"2023-12-17T12:02:51.939022+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:40:51.002822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.813588+0000","last_change":"2023-12-17T12:02:49.659631+0000","last_active":"2023-12-17T12:02:51.813588+0000","last_peered":"2023-12-17T12:02:51.813588+0000","last_clean":"2023-12-17T12:02:51.813588+0000","last_became_active":"2023-12-17T12:02:49.658336+0000","last_became_peered":"2023-12-17T12:02:49.658336+0000","last_unstale":"2023-12-17T12:02:51.813588+0000","last_undegraded":"2023-12-17T12:02:51.813588+0000","last_fullsized":"2023-12-17T12:02:51.813588+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:05:27.210484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:56.023607+0000","last_change":"2023-12-17T12:02:49.675201+0000","last_active":"2023-12-17T12:02:56.023607+0000","last_peered":"2023-12-17T12:02:56.023607+0000","last_clean":"2023-12-17T12:02:56.023607+0000","last_became_active":"2023-12-17T12:02:49.674759+0000","last_became_peered":"2023-12-17T12:02:49.674759+0000","last_unstale":"2023-12-17T12:02:56.023607+0000","last_undegraded":"2023-12-17T12:02:56.023607+0000","last_fullsized":"2023-12-17T12:02:56.023607+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:20:04.166073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.940033+0000","last_change":"2023-12-17T12:02:50.687776+0000","last_active":"2023-12-17T12:02:51.940033+0000","last_peered":"2023-12-17T12:02:51.940033+0000","last_clean":"2023-12-17T12:02:51.940033+0000","last_became_active":"2023-12-17T12:02:50.687428+0000","last_became_peered":"2023-12-17T12:02:50.687428+0000","last_unstale":"2023-12-17T12:02:51.940033+0000","last_undegraded":"2023-12-17T12:02:51.940033+0000","last_fullsized":"2023-12-17T12:02:51.940033+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:59:33.970025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'3","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:54.995710+0000","last_change":"2023-12-17T12:02:49.655786+0000","last_active":"2023-12-17T12:02:54.995710+0000","last_peered":"2023-12-17T12:02:54.995710+0000","last_clean":"2023-12-17T12:02:54.995710+0000","last_became_active":"2023-12-17T12:02:49.655141+0000","last_became_peered":"2023-12-17T12:02:49.655141+0000","last_unstale":"2023-12-17T12:02:54.995710+0000","last_undegraded":"2023-12-17T12:02:54.995710+0000","last_fullsized":"2023-12-17T12:02:54.995710+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:53:08.992755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.940436+0000","last_change":"2023-12-17T12:02:50.677999+0000","last_active":"2023-12-17T12:02:51.940436+0000","last_peered":"2023-12-17T12:02:51.940436+0000","last_clean":"2023-12-17T12:02:51.940436+0000","last_became_active":"2023-12-17T12:02:50.677631+0000","last_became_peered":"2023-12-17T12:02:50.677631+0000","last_unstale":"2023-12-17T12:02:51.940436+0000","last_undegraded":"2023-12-17T12:02:51.940436+0000","last_fullsized":"2023-12-17T12:02:51.940436+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:07:16.006293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:57.031950+0000","last_change":"2023-12-17T12:02:49.654073+0000","last_active":"2023-12-17T12:02:57.031950+0000","last_peered":"2023-12-17T12:02:57.031950+0000","last_clean":"2023-12-17T12:02:57.031950+0000","last_became_active":"2023-12-17T12:02:49.653064+0000","last_became_peered":"2023-12-17T12:02:49.653064+0000","last_unstale":"2023-12-17T12:02:57.031950+0000","last_undegraded":"2023-12-17T12:02:57.031950+0000","last_fullsized":"2023-12-17T12:02:57.031950+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:48:53.075054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.941150+0000","last_change":"2023-12-17T12:02:50.675577+0000","last_active":"2023-12-17T12:02:51.941150+0000","last_peered":"2023-12-17T12:02:51.941150+0000","last_clean":"2023-12-17T12:02:51.941150+0000","last_became_active":"2023-12-17T12:02:50.675142+0000","last_became_peered":"2023-12-17T12:02:50.675142+0000","last_unstale":"2023-12-17T12:02:51.941150+0000","last_undegraded":"2023-12-17T12:02:51.941150+0000","last_fullsized":"2023-12-17T12:02:51.941150+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:38:38.865207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:54.013652+0000","last_change":"2023-12-17T12:02:49.666092+0000","last_active":"2023-12-17T12:02:54.013652+0000","last_peered":"2023-12-17T12:02:54.013652+0000","last_clean":"2023-12-17T12:02:54.013652+0000","last_became_active":"2023-12-17T12:02:49.665672+0000","last_became_peered":"2023-12-17T12:02:49.665672+0000","last_unstale":"2023-12-17T12:02:54.013652+0000","last_undegraded":"2023-12-17T12:02:54.013652+0000","last_fullsized":"2023-12-17T12:02:54.013652+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:34:00.978073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.669516+0000","last_change":"2023-12-17T12:02:50.677089+0000","last_active":"2023-12-17T12:02:51.669516+0000","last_peered":"2023-12-17T12:02:51.669516+0000","last_clean":"2023-12-17T12:02:51.669516+0000","last_became_active":"2023-12-17T12:02:50.676405+0000","last_became_peered":"2023-12-17T12:02:50.676405+0000","last_unstale":"2023-12-17T12:02:51.669516+0000","last_undegraded":"2023-12-17T12:02:51.669516+0000","last_fullsized":"2023-12-17T12:02:51.669516+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:32:55.011141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'3","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:54.014327+0000","last_change":"2023-12-17T12:02:49.659949+0000","last_active":"2023-12-17T12:02:54.014327+0000","last_peered":"2023-12-17T12:02:54.014327+0000","last_clean":"2023-12-17T12:02:54.014327+0000","last_became_active":"2023-12-17T12:02:49.659552+0000","last_became_peered":"2023-12-17T12:02:49.659552+0000","last_unstale":"2023-12-17T12:02:54.014327+0000","last_undegraded":"2023-12-17T12:02:54.014327+0000","last_fullsized":"2023-12-17T12:02:54.014327+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:39:26.912670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.938747+0000","last_change":"2023-12-17T12:02:50.680666+0000","last_active":"2023-12-17T12:02:51.938747+0000","last_peered":"2023-12-17T12:02:51.938747+0000","last_clean":"2023-12-17T12:02:51.938747+0000","last_became_active":"2023-12-17T12:02:50.680288+0000","last_became_peered":"2023-12-17T12:02:50.680288+0000","last_unstale":"2023-12-17T12:02:51.938747+0000","last_undegraded":"2023-12-17T12:02:51.938747+0000","last_fullsized":"2023-12-17T12:02:51.938747+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:52:36.966423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:56.324690+0000","last_change":"2023-12-17T12:02:49.655780+0000","last_active":"2023-12-17T12:02:56.324690+0000","last_peered":"2023-12-17T12:02:56.324690+0000","last_clean":"2023-12-17T12:02:56.324690+0000","last_became_active":"2023-12-17T12:02:49.655455+0000","last_became_peered":"2023-12-17T12:02:49.655455+0000","last_unstale":"2023-12-17T12:02:56.324690+0000","last_undegraded":"2023-12-17T12:02:56.324690+0000","last_fullsized":"2023-12-17T12:02:56.324690+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:14:42.145280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.939427+0000","last_change":"2023-12-17T12:02:50.682874+0000","last_active":"2023-12-17T12:02:51.939427+0000","last_peered":"2023-12-17T12:02:51.939427+0000","last_clean":"2023-12-17T12:02:51.939427+0000","last_became_active":"2023-12-17T12:02:50.682521+0000","last_became_peered":"2023-12-17T12:02:50.682521+0000","last_unstale":"2023-12-17T12:02:51.939427+0000","last_undegraded":"2023-12-17T12:02:51.939427+0000","last_fullsized":"2023-12-17T12:02:51.939427+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:51:21.609286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:54.013325+0000","last_change":"2023-12-17T12:02:49.666401+0000","last_active":"2023-12-17T12:02:54.013325+0000","last_peered":"2023-12-17T12:02:54.013325+0000","last_clean":"2023-12-17T12:02:54.013325+0000","last_became_active":"2023-12-17T12:02:49.663964+0000","last_became_peered":"2023-12-17T12:02:49.663964+0000","last_unstale":"2023-12-17T12:02:54.013325+0000","last_undegraded":"2023-12-17T12:02:54.013325+0000","last_fullsized":"2023-12-17T12:02:54.013325+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:07:45.806809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.813517+0000","last_change":"2023-12-17T12:02:50.689647+0000","last_active":"2023-12-17T12:02:51.813517+0000","last_peered":"2023-12-17T12:02:51.813517+0000","last_clean":"2023-12-17T12:02:51.813517+0000","last_became_active":"2023-12-17T12:02:50.686507+0000","last_became_peered":"2023-12-17T12:02:50.686507+0000","last_unstale":"2023-12-17T12:02:51.813517+0000","last_undegraded":"2023-12-17T12:02:51.813517+0000","last_fullsized":"2023-12-17T12:02:51.813517+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:44:33.359008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'5","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:58.052362+0000","last_change":"2023-12-17T12:02:49.661156+0000","last_active":"2023-12-17T12:02:58.052362+0000","last_peered":"2023-12-17T12:02:58.052362+0000","last_clean":"2023-12-17T12:02:58.052362+0000","last_became_active":"2023-12-17T12:02:49.660277+0000","last_became_peered":"2023-12-17T12:02:49.660277+0000","last_unstale":"2023-12-17T12:02:58.052362+0000","last_undegraded":"2023-12-17T12:02:58.052362+0000","last_fullsized":"2023-12-17T12:02:58.052362+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:58:57.108942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.813675+0000","last_change":"2023-12-17T12:02:50.684018+0000","last_active":"2023-12-17T12:02:51.813675+0000","last_peered":"2023-12-17T12:02:51.813675+0000","last_clean":"2023-12-17T12:02:51.813675+0000","last_became_active":"2023-12-17T12:02:50.683381+0000","last_became_peered":"2023-12-17T12:02:50.683381+0000","last_unstale":"2023-12-17T12:02:51.813675+0000","last_undegraded":"2023-12-17T12:02:51.813675+0000","last_fullsized":"2023-12-17T12:02:51.813675+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:13:45.847989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.939144+0000","last_change":"2023-12-17T12:02:49.651097+0000","last_active":"2023-12-17T12:02:51.939144+0000","last_peered":"2023-12-17T12:02:51.939144+0000","last_clean":"2023-12-17T12:02:51.939144+0000","last_became_active":"2023-12-17T12:02:49.650677+0000","last_became_peered":"2023-12-17T12:02:49.650677+0000","last_unstale":"2023-12-17T12:02:51.939144+0000","last_undegraded":"2023-12-17T12:02:51.939144+0000","last_fullsized":"2023-12-17T12:02:51.939144+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:43:51.383835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.813387+0000","last_change":"2023-12-17T12:02:50.680988+0000","last_active":"2023-12-17T12:02:51.813387+0000","last_peered":"2023-12-17T12:02:51.813387+0000","last_clean":"2023-12-17T12:02:51.813387+0000","last_became_active":"2023-12-17T12:02:50.680254+0000","last_became_peered":"2023-12-17T12:02:50.680254+0000","last_unstale":"2023-12-17T12:02:51.813387+0000","last_undegraded":"2023-12-17T12:02:51.813387+0000","last_fullsized":"2023-12-17T12:02:51.813387+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:18:12.341302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:57.030038+0000","last_change":"2023-12-17T12:02:49.670420+0000","last_active":"2023-12-17T12:02:57.030038+0000","last_peered":"2023-12-17T12:02:57.030038+0000","last_clean":"2023-12-17T12:02:57.030038+0000","last_became_active":"2023-12-17T12:02:49.668729+0000","last_became_peered":"2023-12-17T12:02:49.668729+0000","last_unstale":"2023-12-17T12:02:57.030038+0000","last_undegraded":"2023-12-17T12:02:57.030038+0000","last_fullsized":"2023-12-17T12:02:57.030038+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:07:14.206167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.813705+0000","last_change":"2023-12-17T12:02:50.681966+0000","last_active":"2023-12-17T12:02:51.813705+0000","last_peered":"2023-12-17T12:02:51.813705+0000","last_clean":"2023-12-17T12:02:51.813705+0000","last_became_active":"2023-12-17T12:02:50.681628+0000","last_became_peered":"2023-12-17T12:02:50.681628+0000","last_unstale":"2023-12-17T12:02:51.813705+0000","last_undegraded":"2023-12-17T12:02:51.813705+0000","last_fullsized":"2023-12-17T12:02:51.813705+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:11:59.882145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.938967+0000","last_change":"2023-12-17T12:02:50.686865+0000","last_active":"2023-12-17T12:02:51.938967+0000","last_peered":"2023-12-17T12:02:51.938967+0000","last_clean":"2023-12-17T12:02:51.938967+0000","last_became_active":"2023-12-17T12:02:50.684800+0000","last_became_peered":"2023-12-17T12:02:50.684800+0000","last_unstale":"2023-12-17T12:02:51.938967+0000","last_undegraded":"2023-12-17T12:02:51.938967+0000","last_fullsized":"2023-12-17T12:02:51.938967+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:14:27.121624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.671099+0000","last_change":"2023-12-17T12:02:50.682010+0000","last_active":"2023-12-17T12:02:51.671099+0000","last_peered":"2023-12-17T12:02:51.671099+0000","last_clean":"2023-12-17T12:02:51.671099+0000","last_became_active":"2023-12-17T12:02:50.681698+0000","last_became_peered":"2023-12-17T12:02:50.681698+0000","last_unstale":"2023-12-17T12:02:51.671099+0000","last_undegraded":"2023-12-17T12:02:51.671099+0000","last_fullsized":"2023-12-17T12:02:51.671099+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:30:58.762792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.670936+0000","last_change":"2023-12-17T12:02:50.690916+0000","last_active":"2023-12-17T12:02:51.670936+0000","last_peered":"2023-12-17T12:02:51.670936+0000","last_clean":"2023-12-17T12:02:51.670936+0000","last_became_active":"2023-12-17T12:02:50.690551+0000","last_became_peered":"2023-12-17T12:02:50.690551+0000","last_unstale":"2023-12-17T12:02:51.670936+0000","last_undegraded":"2023-12-17T12:02:51.670936+0000","last_fullsized":"2023-12-17T12:02:51.670936+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:08:42.166489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.940562+0000","last_change":"2023-12-17T12:02:50.680813+0000","last_active":"2023-12-17T12:02:51.940562+0000","last_peered":"2023-12-17T12:02:51.940562+0000","last_clean":"2023-12-17T12:02:51.940562+0000","last_became_active":"2023-12-17T12:02:50.680501+0000","last_became_peered":"2023-12-17T12:02:50.680501+0000","last_unstale":"2023-12-17T12:02:51.940562+0000","last_undegraded":"2023-12-17T12:02:51.940562+0000","last_fullsized":"2023-12-17T12:02:51.940562+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:11:50.421163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.940130+0000","last_change":"2023-12-17T12:02:50.678160+0000","last_active":"2023-12-17T12:02:51.940130+0000","last_peered":"2023-12-17T12:02:51.940130+0000","last_clean":"2023-12-17T12:02:51.940130+0000","last_became_active":"2023-12-17T12:02:50.677801+0000","last_became_peered":"2023-12-17T12:02:50.677801+0000","last_unstale":"2023-12-17T12:02:51.940130+0000","last_undegraded":"2023-12-17T12:02:51.940130+0000","last_fullsized":"2023-12-17T12:02:51.940130+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:23:50.851920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.939191+0000","last_change":"2023-12-17T12:02:50.671312+0000","last_active":"2023-12-17T12:02:51.939191+0000","last_peered":"2023-12-17T12:02:51.939191+0000","last_clean":"2023-12-17T12:02:51.939191+0000","last_became_active":"2023-12-17T12:02:50.670331+0000","last_became_peered":"2023-12-17T12:02:50.670331+0000","last_unstale":"2023-12-17T12:02:51.939191+0000","last_undegraded":"2023-12-17T12:02:51.939191+0000","last_fullsized":"2023-12-17T12:02:51.939191+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:53:35.185205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.671487+0000","last_change":"2023-12-17T12:02:50.686991+0000","last_active":"2023-12-17T12:02:51.671487+0000","last_peered":"2023-12-17T12:02:51.671487+0000","last_clean":"2023-12-17T12:02:51.671487+0000","last_became_active":"2023-12-17T12:02:50.686669+0000","last_became_peered":"2023-12-17T12:02:50.686669+0000","last_unstale":"2023-12-17T12:02:51.671487+0000","last_undegraded":"2023-12-17T12:02:51.671487+0000","last_fullsized":"2023-12-17T12:02:51.671487+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:16:20.440745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.940257+0000","last_change":"2023-12-17T12:02:50.692248+0000","last_active":"2023-12-17T12:02:51.940257+0000","last_peered":"2023-12-17T12:02:51.940257+0000","last_clean":"2023-12-17T12:02:51.940257+0000","last_became_active":"2023-12-17T12:02:50.691902+0000","last_became_peered":"2023-12-17T12:02:50.691902+0000","last_unstale":"2023-12-17T12:02:51.940257+0000","last_undegraded":"2023-12-17T12:02:51.940257+0000","last_fullsized":"2023-12-17T12:02:51.940257+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:00:43.992500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.938220+0000","last_change":"2023-12-17T12:02:50.677912+0000","last_active":"2023-12-17T12:02:51.938220+0000","last_peered":"2023-12-17T12:02:51.938220+0000","last_clean":"2023-12-17T12:02:51.938220+0000","last_became_active":"2023-12-17T12:02:50.676818+0000","last_became_peered":"2023-12-17T12:02:50.676818+0000","last_unstale":"2023-12-17T12:02:51.938220+0000","last_undegraded":"2023-12-17T12:02:51.938220+0000","last_fullsized":"2023-12-17T12:02:51.938220+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:16:53.103771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.939553+0000","last_change":"2023-12-17T12:02:50.684966+0000","last_active":"2023-12-17T12:02:51.939553+0000","last_peered":"2023-12-17T12:02:51.939553+0000","last_clean":"2023-12-17T12:02:51.939553+0000","last_became_active":"2023-12-17T12:02:50.684622+0000","last_became_peered":"2023-12-17T12:02:50.684622+0000","last_unstale":"2023-12-17T12:02:51.939553+0000","last_undegraded":"2023-12-17T12:02:51.939553+0000","last_fullsized":"2023-12-17T12:02:51.939553+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:58:41.810005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.668255+0000","last_change":"2023-12-17T12:02:50.683939+0000","last_active":"2023-12-17T12:02:51.668255+0000","last_peered":"2023-12-17T12:02:51.668255+0000","last_clean":"2023-12-17T12:02:51.668255+0000","last_became_active":"2023-12-17T12:02:50.682306+0000","last_became_peered":"2023-12-17T12:02:50.682306+0000","last_unstale":"2023-12-17T12:02:51.668255+0000","last_undegraded":"2023-12-17T12:02:51.668255+0000","last_fullsized":"2023-12-17T12:02:51.668255+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:02:24.342403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.940178+0000","last_change":"2023-12-17T12:02:50.684219+0000","last_active":"2023-12-17T12:02:51.940178+0000","last_peered":"2023-12-17T12:02:51.940178+0000","last_clean":"2023-12-17T12:02:51.940178+0000","last_became_active":"2023-12-17T12:02:50.681446+0000","last_became_peered":"2023-12-17T12:02:50.681446+0000","last_unstale":"2023-12-17T12:02:51.940178+0000","last_undegraded":"2023-12-17T12:02:51.940178+0000","last_fullsized":"2023-12-17T12:02:51.940178+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:14:09.223818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.938981+0000","last_change":"2023-12-17T12:02:50.669333+0000","last_active":"2023-12-17T12:02:51.938981+0000","last_peered":"2023-12-17T12:02:51.938981+0000","last_clean":"2023-12-17T12:02:51.938981+0000","last_became_active":"2023-12-17T12:02:50.668958+0000","last_became_peered":"2023-12-17T12:02:50.668958+0000","last_unstale":"2023-12-17T12:02:51.938981+0000","last_undegraded":"2023-12-17T12:02:51.938981+0000","last_fullsized":"2023-12-17T12:02:51.938981+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:34:37.234282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":248082,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":24437,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":39,"num_read_kb":33,"num_write":180,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":55,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":323584,"data_stored":69637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449100,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":427559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]}]},{"osd":10,"up_from":70,"seq":300647710738,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":1038820,"data_compressed":36144,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":1,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.57899999999999996}]},{"osd":2,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.76500000000000001}]},{"osd":3,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.88600000000000001}]},{"osd":4,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.79400000000000004}]},{"osd":5,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.70599999999999996}]},{"osd":6,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.78200000000000003}]},{"osd":7,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.748}]},{"osd":8,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.84699999999999998}]},{"osd":9,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.81200000000000006}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]}]},{"osd":9,"up_from":65,"seq":279172874260,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":905216,"data_stored":428343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 12:02:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.36699999999999999}]},{"osd":1,"last update":"Sun Dec 17 12:02:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.499}]},{"osd":2,"last update":"Sun Dec 17 12:02:21 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.61299999999999999}]},{"osd":3,"last update":"Sun Dec 17 12:02:21 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.442}]},{"osd":4,"last update":"Sun Dec 17 12:02:21 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.56899999999999995}]},{"osd":5,"last update":"Sun Dec 17 12:02:21 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.75900000000000001}]},{"osd":6,"last update":"Sun Dec 17 12:02:21 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.67700000000000005}]},{"osd":7,"last update":"Sun Dec 17 12:02:21 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.80200000000000005}]},{"osd":8,"last update":"Sun Dec 17 12:02:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.747}]},{"osd":10,"last update":"Sun Dec 17 12:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.84399999999999997}]}]},{"osd":8,"up_from":58,"seq":249108103194,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":428728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 12:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.747},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.76800000000000002}]},{"osd":1,"last update":"Sun Dec 17 12:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.61299999999999999}]},{"osd":2,"last update":"Sun Dec 17 12:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.52400000000000002}]},{"osd":3,"last update":"Sun Dec 17 12:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.91500000000000004}]},{"osd":4,"last update":"Sun Dec 17 12:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.84999999999999998}]},{"osd":5,"last update":"Sun Dec 17 12:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.70899999999999996}]},{"osd":6,"last update":"Sun Dec 17 12:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.006}]},{"osd":7,"last update":"Sun Dec 17 12:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.93000000000000005}]},{"osd":9,"last update":"Sun Dec 17 12:02:25 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.96999999999999997}]},{"osd":10,"last update":"Sun Dec 17 12:02:43 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.873},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":1.2}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]}]},{"osd":7,"up_from":50,"seq":214748364830,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":1019131,"data_compressed":36144,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.627,"15min":0.61899999999999999},"min":{"1min":0.47999999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.61499999999999999,"15min":0.60799999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91500000000000004,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.67500000000000004}]},{"osd":1,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.48399999999999999,"15min":0.47599999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.38300000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83399999999999996,"5min":1.056,"15min":1.056},"last":0.32600000000000001}]},{"osd":2,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":0.80100000000000005,"15min":0.76200000000000001},"min":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":5.8949999999999996,"5min":5.8949999999999996,"15min":5.8949999999999996},"last":0.66100000000000003},{"interface":"front","average":{"1min":1.024,"5min":0.77900000000000003,"15min":0.73799999999999999},"min":{"1min":0.52100000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":5.9210000000000003,"5min":5.9210000000000003,"15min":5.9210000000000003},"last":0.76600000000000001}]},{"osd":3,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.66600000000000004,"15min":0.66200000000000003},"min":{"1min":0.53400000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.84699999999999998,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.70499999999999996,"15min":0.70099999999999996},"min":{"1min":0.46700000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.54000000000000004}]},{"osd":4,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.437,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.96899999999999997,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.63500000000000001,"15min":0.626},"min":{"1min":0.45900000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.61199999999999999}]},{"osd":5,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80500000000000005,"15min":0.80400000000000005},"min":{"1min":0.63700000000000001,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98499999999999999,"5min":1.022,"15min":1.022},"last":0.55400000000000005}]},{"osd":6,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.79900000000000004,"15min":0.79300000000000004},"min":{"1min":0.60399999999999998,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.036,"5min":1.125,"15min":1.125},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.79300000000000004,"15min":0.78300000000000003},"min":{"1min":0.66800000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.79100000000000004}]},{"osd":8,"last update":"Sun Dec 17 12:02:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.71899999999999997}]},{"osd":9,"last update":"Sun Dec 17 12:02:23 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.69999999999999996}]},{"osd":10,"last update":"Sun Dec 17 12:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.751},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.84299999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]}]},{"osd":6,"up_from":45,"seq":193273528355,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":892928,"data_stored":427398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 12:02:15 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48699999999999999,"15min":0.48399999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.626}]},{"osd":1,"last update":"Sun Dec 17 12:02:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66700000000000004,"15min":0.66600000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68600000000000005,"15min":0.68799999999999994},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.47599999999999998}]},{"osd":2,"last update":"Sun Dec 17 12:02:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70899999999999996,"15min":0.70699999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.95699999999999996,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.68899999999999995,"15min":0.68500000000000005},"min":{"1min":0.51600000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.67900000000000005}]},{"osd":3,"last update":"Sun Dec 17 12:02:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.63200000000000001,"15min":0.63100000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69099999999999995,"15min":0.68999999999999995},"min":{"1min":0.54500000000000004,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.054,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.52600000000000002}]},{"osd":4,"last update":"Sun Dec 17 12:02:15 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.78300000000000003,"15min":0.78200000000000003},"min":{"1min":0.56599999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.81200000000000006,"15min":0.81599999999999995},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.60199999999999998}]},{"osd":5,"last update":"Sun Dec 17 12:02:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.84399999999999997,"15min":0.84499999999999997},"min":{"1min":0.59799999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.2190000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.86599999999999999,"15min":0.85999999999999999},"min":{"1min":0.63300000000000001,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.69499999999999995}]},{"osd":7,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1639999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.89000000000000001,"15min":0.89800000000000002},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.0960000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.83899999999999997}]},{"osd":8,"last update":"Sun Dec 17 12:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.79300000000000004}]},{"osd":9,"last update":"Sun Dec 17 12:02:21 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.86499999999999999}]},{"osd":10,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.66000000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574905,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":905216,"data_stored":429753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 12:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.67000000000000004,"15min":0.64300000000000002},"min":{"1min":0.377,"5min":0.312,"15min":0.312},"max":{"1min":1.3100000000000001,"5min":4.7089999999999996,"15min":4.7089999999999996},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.629,"15min":0.60799999999999998},"min":{"1min":0.47399999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.81799999999999995}]},{"osd":2,"last update":"Sun Dec 17 12:02:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.68000000000000005,"15min":0.60299999999999998},"min":{"1min":0.53800000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.139,"5min":3.8809999999999998,"15min":3.8809999999999998},"last":0.878},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.69499999999999995,"15min":0.60399999999999998},"min":{"1min":0.59299999999999997,"5min":0.312,"15min":0.312},"max":{"1min":1.0369999999999999,"5min":4.7270000000000003,"15min":4.7270000000000003},"last":0.89500000000000002}]},{"osd":3,"last update":"Sun Dec 17 12:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.63800000000000001,"15min":0.60399999999999998},"min":{"1min":0.36099999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1499999999999999,"5min":3.9510000000000001,"15min":3.9510000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.67800000000000005,"15min":0.63500000000000001},"min":{"1min":0.42899999999999999,"5min":0.374,"15min":0.374},"max":{"1min":1.175,"5min":3.8639999999999999,"15min":3.8639999999999999},"last":0.51500000000000001}]},{"osd":4,"last update":"Sun Dec 17 12:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.51600000000000001,"15min":0.48399999999999999},"min":{"1min":0.35399999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.50900000000000001,"15min":0.47599999999999998},"min":{"1min":0.39500000000000002,"5min":0.307,"15min":0.307},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.60699999999999998}]},{"osd":5,"last update":"Sun Dec 17 12:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.71699999999999997,"15min":0.70099999999999996},"min":{"1min":0.52000000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1060000000000001,"5min":1.196,"15min":1.196},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.85799999999999998,"15min":0.872},"min":{"1min":0.64000000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.157,"5min":4.7619999999999996,"15min":4.7619999999999996},"last":0.86199999999999999}]},{"osd":6,"last update":"Sun Dec 17 12:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.79800000000000004,"15min":0.80900000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.075,"5min":3.895,"15min":3.895},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.879,"15min":0.89000000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.2729999999999999,"5min":3.9260000000000002,"15min":3.9260000000000002},"last":0.83899999999999997}]},{"osd":7,"last update":"Sun Dec 17 12:02:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.76400000000000001,"15min":0.75},"min":{"1min":0.48399999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.70499999999999996,"15min":0.69999999999999996},"min":{"1min":0.503,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.95099999999999996,"5min":1.175,"15min":1.175},"last":0.80100000000000005}]},{"osd":8,"last update":"Sun Dec 17 12:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":1.01}]},{"osd":9,"last update":"Sun Dec 17 12:02:20 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.98999999999999999}]},{"osd":10,"last update":"Sun Dec 17 12:02:45 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.94599999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]}]},{"osd":0,"up_from":8,"seq":34359738430,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":897024,"data_stored":427980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 17 12:02:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.61299999999999999,"15min":0.56699999999999995},"min":{"1min":0.54200000000000004,"5min":0.375,"15min":0.375},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.59999999999999998,"15min":0.57599999999999996},"min":{"1min":0.59699999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.57199999999999995}]},{"osd":2,"last update":"Sun Dec 17 12:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.65700000000000003,"15min":0.621},"min":{"1min":0.52400000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.74099999999999999,"15min":0.65300000000000002},"min":{"1min":0.49099999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.998,"5min":6.9859999999999998,"15min":6.9859999999999998},"last":0.81599999999999995}]},{"osd":3,"last update":"Sun Dec 17 12:01:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46100000000000002,"15min":0.45900000000000002},"min":{"1min":0.34000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72899999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.47399999999999998,"15min":0.46800000000000003},"min":{"1min":0.374,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.67300000000000004,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.45400000000000001}]},{"osd":4,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.67800000000000005,"15min":0.63},"min":{"1min":0.56200000000000006,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.65800000000000003,"15min":0.629},"min":{"1min":0.45900000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.66900000000000004}]},{"osd":5,"last update":"Sun Dec 17 12:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.71599999999999997,"15min":0.70599999999999996},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.72099999999999997,"15min":0.70999999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.87}]},{"osd":6,"last update":"Sun Dec 17 12:02:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.65300000000000002,"15min":0.625},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.624},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.68600000000000005,"15min":0.66600000000000004},"min":{"1min":0.46500000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":1.022}]},{"osd":7,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.77500000000000002,"15min":0.77200000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.81899999999999995,"15min":0.80800000000000005},"min":{"1min":0.69399999999999995,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.78600000000000003}]},{"osd":8,"last update":"Sun Dec 17 12:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.997},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.93500000000000005}]},{"osd":9,"last update":"Sun Dec 17 12:02:21 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.97899999999999998}]},{"osd":10,"last update":"Sun Dec 17 12:02:46 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.071},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.84699999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411382,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":465931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 12:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.63800000000000001,"15min":0.60399999999999998},"min":{"1min":0.38400000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.60999999999999999,"15min":0.59499999999999997},"min":{"1min":0.442,"5min":0.377,"15min":0.377},"max":{"1min":0.84199999999999997,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.81899999999999995}]},{"osd":1,"last update":"Sun Dec 17 12:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.63100000000000001,"15min":0.61799999999999999},"min":{"1min":0.50600000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82399999999999995,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.498},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.63700000000000001,"15min":0.60699999999999998},"min":{"1min":0.48899999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.81799999999999995,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.92000000000000004}]},{"osd":3,"last update":"Sun Dec 17 12:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.67400000000000004,"15min":0.65300000000000002},"min":{"1min":0.45200000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65500000000000003,"15min":0.65100000000000002},"min":{"1min":0.5,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.53300000000000003}]},{"osd":4,"last update":"Sun Dec 17 12:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64300000000000002,"15min":0.63200000000000001},"min":{"1min":0.46000000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.76700000000000002,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.68200000000000005,"15min":0.64600000000000002},"min":{"1min":0.52600000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95999999999999996,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.877}]},{"osd":5,"last update":"Sun Dec 17 12:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.56000000000000005,"15min":0.53400000000000003},"min":{"1min":0.36099999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.625,"15min":0.60899999999999999},"min":{"1min":0.41799999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.97499999999999998,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.95499999999999996}]},{"osd":6,"last update":"Sun Dec 17 12:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.79600000000000004,"15min":0.78800000000000003},"min":{"1min":0.63700000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.74399999999999999,"15min":0.73399999999999999},"min":{"1min":0.60599999999999998,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.89900000000000002}]},{"osd":7,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.75600000000000001,"15min":0.76200000000000001},"min":{"1min":0.53700000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.86499999999999999,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.62},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.72599999999999998,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.0549999999999999,"5min":1.212,"15min":1.212},"last":0.54200000000000004}]},{"osd":8,"last update":"Sun Dec 17 12:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.55800000000000005}]},{"osd":9,"last update":"Sun Dec 17 12:02:23 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.97599999999999998}]},{"osd":10,"last update":"Sun Dec 17 12:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":1.022}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]}]},{"osd":3,"up_from":25,"seq":107374182448,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":897024,"data_stored":427472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 12:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.43099999999999999,"15min":0.41299999999999998},"min":{"1min":0.32600000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.5},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.45200000000000001,"15min":0.432},"min":{"1min":0.32800000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.58999999999999997}]},{"osd":1,"last update":"Sun Dec 17 12:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.65200000000000002,"15min":0.61599999999999999},"min":{"1min":0.54600000000000004,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.66000000000000003,"15min":0.63200000000000001},"min":{"1min":0.498,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.873}]},{"osd":2,"last update":"Sun Dec 17 12:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.61799999999999999,"15min":0.61499999999999999},"min":{"1min":0.436,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.625},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.65900000000000003,"15min":0.63700000000000001},"min":{"1min":0.46899999999999997,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.91600000000000004}]},{"osd":4,"last update":"Sun Dec 17 12:02:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.68100000000000005,"15min":0.65500000000000003},"min":{"1min":0.64400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.70399999999999996,"15min":0.67000000000000004},"min":{"1min":0.57899999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.85199999999999998}]},{"osd":5,"last update":"Sun Dec 17 12:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.70999999999999996,"15min":0.69399999999999995},"min":{"1min":0.56899999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.69699999999999995,"15min":0.68500000000000005},"min":{"1min":0.499,"5min":0.441,"15min":0.441},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.754}]},{"osd":6,"last update":"Sun Dec 17 12:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.58899999999999997,"15min":0.57499999999999996},"min":{"1min":0.40000000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.69899999999999995,"15min":0.67300000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.68300000000000005}]},{"osd":7,"last update":"Sun Dec 17 12:02:45 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.66100000000000003,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0209999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.91500000000000004,"15min":0.90600000000000003},"min":{"1min":0.70499999999999996,"5min":0.622,"15min":0.622},"max":{"1min":1.345,"5min":1.395,"15min":1.395},"last":1.0189999999999999}]},{"osd":8,"last update":"Sun Dec 17 12:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.92800000000000005}]},{"osd":9,"last update":"Sun Dec 17 12:02:20 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":1.073}]},{"osd":10,"last update":"Sun Dec 17 12:02:45 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.94999999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]}]},{"osd":4,"up_from":33,"seq":141733920812,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":909312,"data_stored":428648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 12:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.57199999999999995,"15min":0.54300000000000004},"min":{"1min":0.48999999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.96899999999999997,"15min":1.103},"min":{"1min":0.46899999999999997,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.294,"5min":13.124000000000001,"15min":13.124000000000001},"last":0.52400000000000002}]},{"osd":1,"last update":"Sun Dec 17 12:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.47999999999999998,"15min":0.442},"min":{"1min":0.33500000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.47999999999999998,"15min":0.45000000000000001},"min":{"1min":0.34200000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.72999999999999998,"5min":0.75,"15min":0.75},"last":0.55100000000000005}]},{"osd":2,"last update":"Sun Dec 17 12:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.67700000000000005,"15min":0.64500000000000002},"min":{"1min":0.57099999999999995,"5min":0.435,"15min":0.435},"max":{"1min":1.05,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.68500000000000005,"15min":0.66000000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":1.1160000000000001}]},{"osd":3,"last update":"Sun Dec 17 12:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.63700000000000001,"15min":0.59099999999999997},"min":{"1min":0.52600000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.65400000000000003,"15min":0.60399999999999998},"min":{"1min":0.57799999999999996,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1120000000000001,"5min":1.121,"15min":1.121},"last":0.96499999999999997}]},{"osd":5,"last update":"Sun Dec 17 12:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.69199999999999995,"15min":0.64800000000000002},"min":{"1min":0.54900000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1970000000000001,"5min":1.21,"15min":1.21},"last":1.022},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72699999999999998,"15min":0.69899999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0509999999999999,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.91600000000000004}]},{"osd":6,"last update":"Sun Dec 17 12:02:17 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.77400000000000002,"15min":0.76200000000000001},"min":{"1min":0.56799999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.78800000000000003,"15min":0.78300000000000003},"min":{"1min":0.57099999999999995,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.754}]},{"osd":7,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.752,"15min":0.746},"min":{"1min":0.52400000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.77500000000000002,"15min":0.76500000000000001},"min":{"1min":0.48399999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.68700000000000006}]},{"osd":8,"last update":"Sun Dec 17 12:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":1.137}]},{"osd":9,"last update":"Sun Dec 17 12:02:24 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":1.087}]},{"osd":10,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.78200000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]}]},{"osd":5,"up_from":38,"seq":163208757287,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":1019072,"data_compressed":36144,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 12:01:52 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.64300000000000002,"15min":0.58499999999999996},"min":{"1min":0.39600000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":7.077,"5min":7.077,"15min":7.077},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.59799999999999998,"15min":0.58999999999999997},"min":{"1min":0.44700000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.879,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.47499999999999998}]},{"osd":1,"last update":"Sun Dec 17 12:01:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.63700000000000001,"15min":0.625},"min":{"1min":0.47899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.64300000000000002,"15min":0.629},"min":{"1min":0.504,"5min":0.441,"15min":0.441},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.67900000000000005}]},{"osd":2,"last update":"Sun Dec 17 12:01:52 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.48499999999999999,"15min":0.48299999999999998},"min":{"1min":0.371,"5min":0.307,"15min":0.307},"max":{"1min":0.66900000000000004,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53800000000000003,"15min":0.54300000000000004},"min":{"1min":0.39300000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73399999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.42399999999999999}]},{"osd":3,"last update":"Sun Dec 17 12:01:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.64800000000000002,"15min":0.64000000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.66300000000000003,"15min":0.64400000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.71499999999999997}]},{"osd":4,"last update":"Sun Dec 17 12:01:52 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.71899999999999997,"15min":0.70599999999999996},"min":{"1min":0.61199999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.73399999999999999,"15min":0.72999999999999998},"min":{"1min":0.48999999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.96099999999999997,"5min":1.345,"15min":1.345},"last":0.70299999999999996}]},{"osd":6,"last update":"Sun Dec 17 12:02:18 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.70199999999999996,"15min":0.69199999999999995},"min":{"1min":0.50700000000000001,"5min":0.504,"15min":0.504},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.74399999999999999,"15min":0.72999999999999998},"min":{"1min":0.60099999999999998,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.876}]},{"osd":7,"last update":"Sun Dec 17 12:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76100000000000001,"15min":0.75900000000000001},"min":{"1min":0.49199999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.629},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.90100000000000002,"15min":0.91500000000000004},"min":{"1min":0.54500000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.034,"5min":3.4620000000000002,"15min":3.4620000000000002},"last":0.93899999999999995}]},{"osd":8,"last update":"Sun Dec 17 12:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.85099999999999998}]},{"osd":9,"last update":"Sun Dec 17 12:02:20 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.98299999999999998}]},{"osd":10,"last update":"Sun Dec 17 12:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":1.022}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34502,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34502,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34502,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36144,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36144,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36144,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36144,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":38645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":21101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-17T12:03:00.039 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-17T12:03:00.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.275+0000 7f0d6ddff700 1 -- 172.21.15.8:0/1716109223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d68102690 msgr2=0x7f0d68102af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:00.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.275+0000 7f0d6ddff700 1 --2- 172.21.15.8:0/1716109223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d68102690 0x7f0d68102af0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0d5c0099c0 tx=0x7f0d5c009cd0 comp rx=0 tx=0).stop 2023-12-17T12:03:00.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.275+0000 7f0d6ddff700 1 -- 172.21.15.8:0/1716109223 shutdown_connections 2023-12-17T12:03:00.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.275+0000 7f0d6ddff700 1 --2- 172.21.15.8:0/1716109223 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d68103030 0x7f0d681098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:00.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.275+0000 7f0d6ddff700 1 --2- 172.21.15.8:0/1716109223 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d681014a0 0x7f0d681018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:00.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.275+0000 7f0d6ddff700 1 --2- 172.21.15.8:0/1716109223 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d68102690 0x7f0d68102af0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:00.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.275+0000 7f0d6ddff700 1 -- 172.21.15.8:0/1716109223 >> 172.21.15.8:0/1716109223 conn(0x7f0d680fca10 msgr2=0x7f0d680fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:00.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.275+0000 7f0d6ddff700 1 -- 172.21.15.8:0/1716109223 shutdown_connections 2023-12-17T12:03:00.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.275+0000 7f0d6ddff700 1 -- 172.21.15.8:0/1716109223 wait complete. 2023-12-17T12:03:00.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.277+0000 7f0d6ddff700 1 Processor -- start 2023-12-17T12:03:00.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.277+0000 7f0d6ddff700 1 -- start start 2023-12-17T12:03:00.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.277+0000 7f0d6ddff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d681014a0 0x7f0d681071d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:00.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.277+0000 7f0d6ddff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d68102690 0x7f0d68107710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:00.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.277+0000 7f0d6ddff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d68103030 0x7f0d68103d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:00.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.277+0000 7f0d6ddff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d68104500 con 0x7f0d68103030 2023-12-17T12:03:00.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.277+0000 7f0d6ddff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d68104670 con 0x7f0d681014a0 2023-12-17T12:03:00.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.277+0000 7f0d6ddff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d68104830 con 0x7f0d68102690 2023-12-17T12:03:00.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.278+0000 7f0d67fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d68103030 0x7f0d68103d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:00.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.278+0000 7f0d67fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d68103030 0x7f0d68103d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:56448/0 (socket says 172.21.15.8:56448) 2023-12-17T12:03:00.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.278+0000 7f0d67fff700 1 -- 172.21.15.8:0/86649072 learned_addr learned my addr 172.21.15.8:0/86649072 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:00.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.278+0000 7f0d677fe700 1 --2- 172.21.15.8:0/86649072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d681014a0 0x7f0d681071d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:00.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.278+0000 7f0d66ffd700 1 --2- 172.21.15.8:0/86649072 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d68102690 0x7f0d68107710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:00.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.278+0000 7f0d67fff700 1 -- 172.21.15.8:0/86649072 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d68102690 msgr2=0x7f0d68107710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:00.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.278+0000 7f0d67fff700 1 --2- 172.21.15.8:0/86649072 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d68102690 0x7f0d68107710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:00.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.278+0000 7f0d67fff700 1 -- 172.21.15.8:0/86649072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d681014a0 msgr2=0x7f0d681071d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:00.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.278+0000 7f0d67fff700 1 --2- 172.21.15.8:0/86649072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d681014a0 0x7f0d681071d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:00.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.278+0000 7f0d67fff700 1 -- 172.21.15.8:0/86649072 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d5c0095f0 con 0x7f0d68103030 2023-12-17T12:03:00.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.278+0000 7f0d67fff700 1 --2- 172.21.15.8:0/86649072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d68103030 0x7f0d68103d60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0d6000ef30 tx=0x7f0d6000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:00.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.279+0000 7f0d64ff9700 1 -- 172.21.15.8:0/86649072 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d60018070 con 0x7f0d68103030 2023-12-17T12:03:00.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.279+0000 7f0d64ff9700 1 -- 172.21.15.8:0/86649072 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0d6000f040 con 0x7f0d68103030 2023-12-17T12:03:00.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.279+0000 7f0d6ddff700 1 -- 172.21.15.8:0/86649072 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d681a5a20 con 0x7f0d68103030 2023-12-17T12:03:00.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.279+0000 7f0d64ff9700 1 -- 172.21.15.8:0/86649072 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6000cbc0 con 0x7f0d68103030 2023-12-17T12:03:00.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.279+0000 7f0d6ddff700 1 -- 172.21.15.8:0/86649072 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d681a5f00 con 0x7f0d68103030 2023-12-17T12:03:00.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.280+0000 7f0d6ddff700 1 -- 172.21.15.8:0/86649072 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d68068230 con 0x7f0d68103030 2023-12-17T12:03:00.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.282+0000 7f0d64ff9700 1 -- 172.21.15.8:0/86649072 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f0d60007500 con 0x7f0d68103030 2023-12-17T12:03:00.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.283+0000 7f0d64ff9700 1 --2- 172.21.15.8:0/86649072 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f0d500a1590 0x7f0d500a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:00.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.283+0000 7f0d64ff9700 1 -- 172.21.15.8:0/86649072 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f0d600cc820 con 0x7f0d68103030 2023-12-17T12:03:00.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.283+0000 7f0d677fe700 1 --2- 172.21.15.8:0/86649072 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f0d500a1590 0x7f0d500a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:00.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.284+0000 7f0d677fe700 1 --2- 172.21.15.8:0/86649072 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f0d500a1590 0x7f0d500a3a50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0d681024f0 tx=0x7f0d5800b410 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:00.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.287+0000 7f0d64ff9700 1 -- 172.21.15.8:0/86649072 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f0d60095e60 con 0x7f0d68103030 2023-12-17T12:03:00.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:00 smithi100 ceph-mon[41266]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:03:00.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:00 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/1482000827' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:03:00.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:00 smithi100 ceph-mon[41266]: pgmap v269: 97 pgs: 97 active+clean; 601 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 8.2 KiB/s wr, 25 op/s 2023-12-17T12:03:00.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:00 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/1504722630' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:03:00.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:00 smithi186 ceph-mon[41182]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:03:00.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:00 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/1482000827' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:03:00.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:00 smithi186 ceph-mon[41182]: pgmap v269: 97 pgs: 97 active+clean; 601 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 8.2 KiB/s wr, 25 op/s 2023-12-17T12:03:00.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:00 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/1504722630' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:03:00.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:00 smithi008 ceph-mon[36830]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:03:00.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:00 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/1482000827' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:03:00.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:00 smithi008 ceph-mon[36830]: pgmap v269: 97 pgs: 97 active+clean; 601 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 8.2 KiB/s wr, 25 op/s 2023-12-17T12:03:00.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:00 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/1504722630' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:03:00.498 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.497+0000 7f0d6ddff700 1 -- 172.21.15.8:0/86649072 --> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0d68074f20 con 0x7f0d500a1590 2023-12-17T12:03:00.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.508+0000 7f0d64ff9700 1 -- 172.21.15.8:0/86649072 <== mgr.14154 v2:172.21.15.8:6800/268548699 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+334885 (secure 0 0 0) 0x7f0d68074f20 con 0x7f0d500a1590 2023-12-17T12:03:00.513 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:03:00.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.512+0000 7f0d6ddff700 1 -- 172.21.15.8:0/86649072 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f0d500a1590 msgr2=0x7f0d500a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:00.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.512+0000 7f0d6ddff700 1 --2- 172.21.15.8:0/86649072 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f0d500a1590 0x7f0d500a3a50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0d681024f0 tx=0x7f0d5800b410 comp rx=0 tx=0).stop 2023-12-17T12:03:00.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.512+0000 7f0d6ddff700 1 -- 172.21.15.8:0/86649072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d68103030 msgr2=0x7f0d68103d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:00.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.512+0000 7f0d6ddff700 1 --2- 172.21.15.8:0/86649072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d68103030 0x7f0d68103d60 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0d6000ef30 tx=0x7f0d6000c3a0 comp rx=0 tx=0).stop 2023-12-17T12:03:00.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.512+0000 7f0d6ddff700 1 -- 172.21.15.8:0/86649072 shutdown_connections 2023-12-17T12:03:00.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.512+0000 7f0d6ddff700 1 --2- 172.21.15.8:0/86649072 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f0d500a1590 0x7f0d500a3a50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:00.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.512+0000 7f0d6ddff700 1 --2- 172.21.15.8:0/86649072 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0d68103030 0x7f0d68103d60 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:00.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.512+0000 7f0d6ddff700 1 --2- 172.21.15.8:0/86649072 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0d681014a0 0x7f0d681071d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:00.516 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.512+0000 7f0d6ddff700 1 --2- 172.21.15.8:0/86649072 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0d68102690 0x7f0d68107710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:00.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.512+0000 7f0d6ddff700 1 -- 172.21.15.8:0/86649072 >> 172.21.15.8:0/86649072 conn(0x7f0d680fca10 msgr2=0x7f0d68073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:00.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.512+0000 7f0d6ddff700 1 -- 172.21.15.8:0/86649072 shutdown_connections 2023-12-17T12:03:00.517 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:00.512+0000 7f0d6ddff700 1 -- 172.21.15.8:0/86649072 wait complete. 2023-12-17T12:03:00.517 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-12-17T12:03:00.533 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":269,"stamp":"2023-12-17T12:02:59.441031+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":614928,"num_objects":86,"num_object_clones":0,"num_object_copies":258,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":165,"num_read_kb":142,"num_write":362,"num_write_kb":3010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":55,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":292,"ondisk_log_size":292,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":282,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335044,"kb_used_data":10840,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606780,"statfs":{"total":1151940427776,"available":1151597342720,"internally_reserved":0,"allocated":11100160,"data_stored":6968835,"data_compressed":108432,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":19138,"internal_metadata":331855166},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":24560,"num_objects":84,"num_object_clones":0,"num_object_copies":252,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":39,"num_read_kb":33,"num_write":181,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":55,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.783769"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.939655+0000","last_change":"2023-12-17T12:02:50.685108+0000","last_active":"2023-12-17T12:02:51.939655+0000","last_peered":"2023-12-17T12:02:51.939655+0000","last_clean":"2023-12-17T12:02:51.939655+0000","last_became_active":"2023-12-17T12:02:50.684394+0000","last_became_peered":"2023-12-17T12:02:50.684394+0000","last_unstale":"2023-12-17T12:02:51.939655+0000","last_undegraded":"2023-12-17T12:02:51.939655+0000","last_fullsized":"2023-12-17T12:02:51.939655+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:42:03.271558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.941125+0000","last_change":"2023-12-17T12:02:50.676657+0000","last_active":"2023-12-17T12:02:51.941125+0000","last_peered":"2023-12-17T12:02:51.941125+0000","last_clean":"2023-12-17T12:02:51.941125+0000","last_became_active":"2023-12-17T12:02:50.676310+0000","last_became_peered":"2023-12-17T12:02:50.676310+0000","last_unstale":"2023-12-17T12:02:51.941125+0000","last_undegraded":"2023-12-17T12:02:51.941125+0000","last_fullsized":"2023-12-17T12:02:51.941125+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:58:16.704219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.940923+0000","last_change":"2023-12-17T12:02:50.691978+0000","last_active":"2023-12-17T12:02:51.940923+0000","last_peered":"2023-12-17T12:02:51.940923+0000","last_clean":"2023-12-17T12:02:51.940923+0000","last_became_active":"2023-12-17T12:02:50.691639+0000","last_became_peered":"2023-12-17T12:02:50.691639+0000","last_unstale":"2023-12-17T12:02:51.940923+0000","last_undegraded":"2023-12-17T12:02:51.940923+0000","last_fullsized":"2023-12-17T12:02:51.940923+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:55:24.002885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.939301+0000","last_change":"2023-12-17T12:02:50.687062+0000","last_active":"2023-12-17T12:02:51.939301+0000","last_peered":"2023-12-17T12:02:51.939301+0000","last_clean":"2023-12-17T12:02:51.939301+0000","last_became_active":"2023-12-17T12:02:50.685906+0000","last_became_peered":"2023-12-17T12:02:50.685906+0000","last_unstale":"2023-12-17T12:02:51.939301+0000","last_undegraded":"2023-12-17T12:02:51.939301+0000","last_fullsized":"2023-12-17T12:02:51.939301+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:15:22.367700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.669679+0000","last_change":"2023-12-17T12:02:50.681528+0000","last_active":"2023-12-17T12:02:51.669679+0000","last_peered":"2023-12-17T12:02:51.669679+0000","last_clean":"2023-12-17T12:02:51.669679+0000","last_became_active":"2023-12-17T12:02:50.681206+0000","last_became_peered":"2023-12-17T12:02:50.681206+0000","last_unstale":"2023-12-17T12:02:51.669679+0000","last_undegraded":"2023-12-17T12:02:51.669679+0000","last_fullsized":"2023-12-17T12:02:51.669679+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:46:48.146735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.939349+0000","last_change":"2023-12-17T12:02:50.678512+0000","last_active":"2023-12-17T12:02:51.939349+0000","last_peered":"2023-12-17T12:02:51.939349+0000","last_clean":"2023-12-17T12:02:51.939349+0000","last_became_active":"2023-12-17T12:02:50.678157+0000","last_became_peered":"2023-12-17T12:02:50.678157+0000","last_unstale":"2023-12-17T12:02:51.939349+0000","last_undegraded":"2023-12-17T12:02:51.939349+0000","last_fullsized":"2023-12-17T12:02:51.939349+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:03:39.313077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.813223+0000","last_change":"2023-12-17T12:02:50.677804+0000","last_active":"2023-12-17T12:02:51.813223+0000","last_peered":"2023-12-17T12:02:51.813223+0000","last_clean":"2023-12-17T12:02:51.813223+0000","last_became_active":"2023-12-17T12:02:50.677453+0000","last_became_peered":"2023-12-17T12:02:50.677453+0000","last_unstale":"2023-12-17T12:02:51.813223+0000","last_undegraded":"2023-12-17T12:02:51.813223+0000","last_fullsized":"2023-12-17T12:02:51.813223+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:16:09.552128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.939321+0000","last_change":"2023-12-17T12:02:50.687583+0000","last_active":"2023-12-17T12:02:51.939321+0000","last_peered":"2023-12-17T12:02:51.939321+0000","last_clean":"2023-12-17T12:02:51.939321+0000","last_became_active":"2023-12-17T12:02:50.687232+0000","last_became_peered":"2023-12-17T12:02:50.687232+0000","last_unstale":"2023-12-17T12:02:51.939321+0000","last_undegraded":"2023-12-17T12:02:51.939321+0000","last_fullsized":"2023-12-17T12:02:51.939321+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:48:22.795244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.668726+0000","last_change":"2023-12-17T12:02:50.683443+0000","last_active":"2023-12-17T12:02:51.668726+0000","last_peered":"2023-12-17T12:02:51.668726+0000","last_clean":"2023-12-17T12:02:51.668726+0000","last_became_active":"2023-12-17T12:02:50.683092+0000","last_became_peered":"2023-12-17T12:02:50.683092+0000","last_unstale":"2023-12-17T12:02:51.668726+0000","last_undegraded":"2023-12-17T12:02:51.668726+0000","last_fullsized":"2023-12-17T12:02:51.668726+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:56:24.455890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.939764+0000","last_change":"2023-12-17T12:02:50.689885+0000","last_active":"2023-12-17T12:02:51.939764+0000","last_peered":"2023-12-17T12:02:51.939764+0000","last_clean":"2023-12-17T12:02:51.939764+0000","last_became_active":"2023-12-17T12:02:50.689312+0000","last_became_peered":"2023-12-17T12:02:50.689312+0000","last_unstale":"2023-12-17T12:02:51.939764+0000","last_undegraded":"2023-12-17T12:02:51.939764+0000","last_fullsized":"2023-12-17T12:02:51.939764+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:23:35.348565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.813498+0000","last_change":"2023-12-17T12:02:50.684120+0000","last_active":"2023-12-17T12:02:51.813498+0000","last_peered":"2023-12-17T12:02:51.813498+0000","last_clean":"2023-12-17T12:02:51.813498+0000","last_became_active":"2023-12-17T12:02:50.683811+0000","last_became_peered":"2023-12-17T12:02:50.683811+0000","last_unstale":"2023-12-17T12:02:51.813498+0000","last_undegraded":"2023-12-17T12:02:51.813498+0000","last_fullsized":"2023-12-17T12:02:51.813498+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:58:14.651264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.939215+0000","last_change":"2023-12-17T12:02:50.678350+0000","last_active":"2023-12-17T12:02:51.939215+0000","last_peered":"2023-12-17T12:02:51.939215+0000","last_clean":"2023-12-17T12:02:51.939215+0000","last_became_active":"2023-12-17T12:02:50.677640+0000","last_became_peered":"2023-12-17T12:02:50.677640+0000","last_unstale":"2023-12-17T12:02:51.939215+0000","last_undegraded":"2023-12-17T12:02:51.939215+0000","last_fullsized":"2023-12-17T12:02:51.939215+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:01:54.303216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.940127+0000","last_change":"2023-12-17T12:02:50.686173+0000","last_active":"2023-12-17T12:02:51.940127+0000","last_peered":"2023-12-17T12:02:51.940127+0000","last_clean":"2023-12-17T12:02:51.940127+0000","last_became_active":"2023-12-17T12:02:50.685839+0000","last_became_peered":"2023-12-17T12:02:50.685839+0000","last_unstale":"2023-12-17T12:02:51.940127+0000","last_undegraded":"2023-12-17T12:02:51.940127+0000","last_fullsized":"2023-12-17T12:02:51.940127+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:11:09.034032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.938592+0000","last_change":"2023-12-17T12:02:50.686975+0000","last_active":"2023-12-17T12:02:51.938592+0000","last_peered":"2023-12-17T12:02:51.938592+0000","last_clean":"2023-12-17T12:02:51.938592+0000","last_became_active":"2023-12-17T12:02:50.684301+0000","last_became_peered":"2023-12-17T12:02:50.684301+0000","last_unstale":"2023-12-17T12:02:51.938592+0000","last_undegraded":"2023-12-17T12:02:51.938592+0000","last_fullsized":"2023-12-17T12:02:51.938592+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:43:43.676085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.938523+0000","last_change":"2023-12-17T12:02:50.683486+0000","last_active":"2023-12-17T12:02:51.938523+0000","last_peered":"2023-12-17T12:02:51.938523+0000","last_clean":"2023-12-17T12:02:51.938523+0000","last_became_active":"2023-12-17T12:02:50.683143+0000","last_became_peered":"2023-12-17T12:02:50.683143+0000","last_unstale":"2023-12-17T12:02:51.938523+0000","last_undegraded":"2023-12-17T12:02:51.938523+0000","last_fullsized":"2023-12-17T12:02:51.938523+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:25:02.498460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.667976+0000","last_change":"2023-12-17T12:02:50.691615+0000","last_active":"2023-12-17T12:02:51.667976+0000","last_peered":"2023-12-17T12:02:51.667976+0000","last_clean":"2023-12-17T12:02:51.667976+0000","last_became_active":"2023-12-17T12:02:50.690942+0000","last_became_peered":"2023-12-17T12:02:50.690942+0000","last_unstale":"2023-12-17T12:02:51.667976+0000","last_undegraded":"2023-12-17T12:02:51.667976+0000","last_fullsized":"2023-12-17T12:02:51.667976+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:29:03.412722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.939680+0000","last_change":"2023-12-17T12:02:50.685709+0000","last_active":"2023-12-17T12:02:51.939680+0000","last_peered":"2023-12-17T12:02:51.939680+0000","last_clean":"2023-12-17T12:02:51.939680+0000","last_became_active":"2023-12-17T12:02:50.685111+0000","last_became_peered":"2023-12-17T12:02:50.685111+0000","last_unstale":"2023-12-17T12:02:51.939680+0000","last_undegraded":"2023-12-17T12:02:51.939680+0000","last_fullsized":"2023-12-17T12:02:51.939680+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:26:56.486285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.939283+0000","last_change":"2023-12-17T12:02:50.683639+0000","last_active":"2023-12-17T12:02:51.939283+0000","last_peered":"2023-12-17T12:02:51.939283+0000","last_clean":"2023-12-17T12:02:51.939283+0000","last_became_active":"2023-12-17T12:02:50.683267+0000","last_became_peered":"2023-12-17T12:02:50.683267+0000","last_unstale":"2023-12-17T12:02:51.939283+0000","last_undegraded":"2023-12-17T12:02:51.939283+0000","last_fullsized":"2023-12-17T12:02:51.939283+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:09:01.026688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.671313+0000","last_change":"2023-12-17T12:02:50.690116+0000","last_active":"2023-12-17T12:02:51.671313+0000","last_peered":"2023-12-17T12:02:51.671313+0000","last_clean":"2023-12-17T12:02:51.671313+0000","last_became_active":"2023-12-17T12:02:50.688731+0000","last_became_peered":"2023-12-17T12:02:50.688731+0000","last_unstale":"2023-12-17T12:02:51.671313+0000","last_undegraded":"2023-12-17T12:02:51.671313+0000","last_fullsized":"2023-12-17T12:02:51.671313+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:21:37.730460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'9","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:54.996773+0000","last_change":"2023-12-17T12:02:49.662068+0000","last_active":"2023-12-17T12:02:54.996773+0000","last_peered":"2023-12-17T12:02:54.996773+0000","last_clean":"2023-12-17T12:02:54.996773+0000","last_became_active":"2023-12-17T12:02:49.661755+0000","last_became_peered":"2023-12-17T12:02:49.661755+0000","last_unstale":"2023-12-17T12:02:54.996773+0000","last_undegraded":"2023-12-17T12:02:54.996773+0000","last_fullsized":"2023-12-17T12:02:54.996773+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:51:16.128618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.940109+0000","last_change":"2023-12-17T12:02:50.687855+0000","last_active":"2023-12-17T12:02:51.940109+0000","last_peered":"2023-12-17T12:02:51.940109+0000","last_clean":"2023-12-17T12:02:51.940109+0000","last_became_active":"2023-12-17T12:02:50.687567+0000","last_became_peered":"2023-12-17T12:02:50.687567+0000","last_unstale":"2023-12-17T12:02:51.940109+0000","last_undegraded":"2023-12-17T12:02:51.940109+0000","last_fullsized":"2023-12-17T12:02:51.940109+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:49:51.627898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"82'1","reported_seq":14,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-17T12:02:50.990596+0000","last_change":"2023-12-17T12:02:49.673995+0000","last_active":"2023-12-17T12:02:50.990596+0000","last_peered":"2023-12-17T12:02:50.990596+0000","last_clean":"2023-12-17T12:02:50.990596+0000","last_became_active":"2023-12-17T12:02:49.673509+0000","last_became_peered":"2023-12-17T12:02:49.673509+0000","last_unstale":"2023-12-17T12:02:50.990596+0000","last_undegraded":"2023-12-17T12:02:50.990596+0000","last_fullsized":"2023-12-17T12:02:50.990596+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:53:19.695998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.941209+0000","last_change":"2023-12-17T12:02:50.687537+0000","last_active":"2023-12-17T12:02:51.941209+0000","last_peered":"2023-12-17T12:02:51.941209+0000","last_clean":"2023-12-17T12:02:51.941209+0000","last_became_active":"2023-12-17T12:02:50.687203+0000","last_became_peered":"2023-12-17T12:02:50.687203+0000","last_unstale":"2023-12-17T12:02:51.941209+0000","last_undegraded":"2023-12-17T12:02:51.941209+0000","last_fullsized":"2023-12-17T12:02:51.941209+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:08:27.551628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'11","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:57.038095+0000","last_change":"2023-12-17T12:02:49.666605+0000","last_active":"2023-12-17T12:02:57.038095+0000","last_peered":"2023-12-17T12:02:57.038095+0000","last_clean":"2023-12-17T12:02:57.038095+0000","last_became_active":"2023-12-17T12:02:49.666203+0000","last_became_peered":"2023-12-17T12:02:49.666203+0000","last_unstale":"2023-12-17T12:02:57.038095+0000","last_undegraded":"2023-12-17T12:02:57.038095+0000","last_fullsized":"2023-12-17T12:02:57.038095+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:06:19.429798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":15,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.668177+0000","last_change":"2023-12-17T12:02:50.683718+0000","last_active":"2023-12-17T12:02:51.668177+0000","last_peered":"2023-12-17T12:02:51.668177+0000","last_clean":"2023-12-17T12:02:51.668177+0000","last_became_active":"2023-12-17T12:02:50.683417+0000","last_became_peered":"2023-12-17T12:02:50.683417+0000","last_unstale":"2023-12-17T12:02:51.668177+0000","last_undegraded":"2023-12-17T12:02:51.668177+0000","last_fullsized":"2023-12-17T12:02:51.668177+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:10:10.662913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:57.036195+0000","last_change":"2023-12-17T12:02:49.667711+0000","last_active":"2023-12-17T12:02:57.036195+0000","last_peered":"2023-12-17T12:02:57.036195+0000","last_clean":"2023-12-17T12:02:57.036195+0000","last_became_active":"2023-12-17T12:02:49.667358+0000","last_became_peered":"2023-12-17T12:02:49.667358+0000","last_unstale":"2023-12-17T12:02:57.036195+0000","last_undegraded":"2023-12-17T12:02:57.036195+0000","last_fullsized":"2023-12-17T12:02:57.036195+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:54:38.336318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.939200+0000","last_change":"2023-12-17T12:02:50.684036+0000","last_active":"2023-12-17T12:02:51.939200+0000","last_peered":"2023-12-17T12:02:51.939200+0000","last_clean":"2023-12-17T12:02:51.939200+0000","last_became_active":"2023-12-17T12:02:50.683580+0000","last_became_peered":"2023-12-17T12:02:50.683580+0000","last_unstale":"2023-12-17T12:02:51.939200+0000","last_undegraded":"2023-12-17T12:02:51.939200+0000","last_fullsized":"2023-12-17T12:02:51.939200+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:08:40.380574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'5","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:54.984155+0000","last_change":"2023-12-17T12:02:49.664481+0000","last_active":"2023-12-17T12:02:54.984155+0000","last_peered":"2023-12-17T12:02:54.984155+0000","last_clean":"2023-12-17T12:02:54.984155+0000","last_became_active":"2023-12-17T12:02:49.659106+0000","last_became_peered":"2023-12-17T12:02:49.659106+0000","last_unstale":"2023-12-17T12:02:54.984155+0000","last_undegraded":"2023-12-17T12:02:54.984155+0000","last_fullsized":"2023-12-17T12:02:54.984155+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:41:05.093724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.669500+0000","last_change":"2023-12-17T12:02:50.677862+0000","last_active":"2023-12-17T12:02:51.669500+0000","last_peered":"2023-12-17T12:02:51.669500+0000","last_clean":"2023-12-17T12:02:51.669500+0000","last_became_active":"2023-12-17T12:02:50.677511+0000","last_became_peered":"2023-12-17T12:02:50.677511+0000","last_unstale":"2023-12-17T12:02:51.669500+0000","last_undegraded":"2023-12-17T12:02:51.669500+0000","last_fullsized":"2023-12-17T12:02:51.669500+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:16:05.792201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:56.021944+0000","last_change":"2023-12-17T12:02:49.654735+0000","last_active":"2023-12-17T12:02:56.021944+0000","last_peered":"2023-12-17T12:02:56.021944+0000","last_clean":"2023-12-17T12:02:56.021944+0000","last_became_active":"2023-12-17T12:02:49.654192+0000","last_became_peered":"2023-12-17T12:02:49.654192+0000","last_unstale":"2023-12-17T12:02:56.021944+0000","last_undegraded":"2023-12-17T12:02:56.021944+0000","last_fullsized":"2023-12-17T12:02:56.021944+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:37:04.500685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.938750+0000","last_change":"2023-12-17T12:02:50.676395+0000","last_active":"2023-12-17T12:02:51.938750+0000","last_peered":"2023-12-17T12:02:51.938750+0000","last_clean":"2023-12-17T12:02:51.938750+0000","last_became_active":"2023-12-17T12:02:50.675969+0000","last_became_peered":"2023-12-17T12:02:50.675969+0000","last_unstale":"2023-12-17T12:02:51.938750+0000","last_undegraded":"2023-12-17T12:02:51.938750+0000","last_fullsized":"2023-12-17T12:02:51.938750+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:36:27.541564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:54.998329+0000","last_change":"2023-12-17T12:02:49.660990+0000","last_active":"2023-12-17T12:02:54.998329+0000","last_peered":"2023-12-17T12:02:54.998329+0000","last_clean":"2023-12-17T12:02:54.998329+0000","last_became_active":"2023-12-17T12:02:49.660623+0000","last_became_peered":"2023-12-17T12:02:49.660623+0000","last_unstale":"2023-12-17T12:02:54.998329+0000","last_undegraded":"2023-12-17T12:02:54.998329+0000","last_fullsized":"2023-12-17T12:02:54.998329+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:59:58.462681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.939183+0000","last_change":"2023-12-17T12:02:50.677481+0000","last_active":"2023-12-17T12:02:51.939183+0000","last_peered":"2023-12-17T12:02:51.939183+0000","last_clean":"2023-12-17T12:02:51.939183+0000","last_became_active":"2023-12-17T12:02:50.677101+0000","last_became_peered":"2023-12-17T12:02:50.677101+0000","last_unstale":"2023-12-17T12:02:51.939183+0000","last_undegraded":"2023-12-17T12:02:51.939183+0000","last_fullsized":"2023-12-17T12:02:51.939183+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:47:24.777071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.938296+0000","last_change":"2023-12-17T12:02:49.662973+0000","last_active":"2023-12-17T12:02:51.938296+0000","last_peered":"2023-12-17T12:02:51.938296+0000","last_clean":"2023-12-17T12:02:51.938296+0000","last_became_active":"2023-12-17T12:02:49.662653+0000","last_became_peered":"2023-12-17T12:02:49.662653+0000","last_unstale":"2023-12-17T12:02:51.938296+0000","last_undegraded":"2023-12-17T12:02:51.938296+0000","last_fullsized":"2023-12-17T12:02:51.938296+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:01:34.858207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.938759+0000","last_change":"2023-12-17T12:02:50.684823+0000","last_active":"2023-12-17T12:02:51.938759+0000","last_peered":"2023-12-17T12:02:51.938759+0000","last_clean":"2023-12-17T12:02:51.938759+0000","last_became_active":"2023-12-17T12:02:50.684437+0000","last_became_peered":"2023-12-17T12:02:50.684437+0000","last_unstale":"2023-12-17T12:02:51.938759+0000","last_undegraded":"2023-12-17T12:02:51.938759+0000","last_fullsized":"2023-12-17T12:02:51.938759+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:16:15.230812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":20,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:56.021735+0000","last_change":"2023-12-17T12:02:49.656001+0000","last_active":"2023-12-17T12:02:56.021735+0000","last_peered":"2023-12-17T12:02:56.021735+0000","last_clean":"2023-12-17T12:02:56.021735+0000","last_became_active":"2023-12-17T12:02:49.655292+0000","last_became_peered":"2023-12-17T12:02:49.655292+0000","last_unstale":"2023-12-17T12:02:56.021735+0000","last_undegraded":"2023-12-17T12:02:56.021735+0000","last_fullsized":"2023-12-17T12:02:56.021735+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:41:34.836929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.668670+0000","last_change":"2023-12-17T12:02:50.692734+0000","last_active":"2023-12-17T12:02:51.668670+0000","last_peered":"2023-12-17T12:02:51.668670+0000","last_clean":"2023-12-17T12:02:51.668670+0000","last_became_active":"2023-12-17T12:02:50.691567+0000","last_became_peered":"2023-12-17T12:02:50.691567+0000","last_unstale":"2023-12-17T12:02:51.668670+0000","last_undegraded":"2023-12-17T12:02:51.668670+0000","last_fullsized":"2023-12-17T12:02:51.668670+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:23:39.685352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:54.014453+0000","last_change":"2023-12-17T12:02:49.664634+0000","last_active":"2023-12-17T12:02:54.014453+0000","last_peered":"2023-12-17T12:02:54.014453+0000","last_clean":"2023-12-17T12:02:54.014453+0000","last_became_active":"2023-12-17T12:02:49.664260+0000","last_became_peered":"2023-12-17T12:02:49.664260+0000","last_unstale":"2023-12-17T12:02:54.014453+0000","last_undegraded":"2023-12-17T12:02:54.014453+0000","last_fullsized":"2023-12-17T12:02:54.014453+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:55:06.887646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.941299+0000","last_change":"2023-12-17T12:02:50.679341+0000","last_active":"2023-12-17T12:02:51.941299+0000","last_peered":"2023-12-17T12:02:51.941299+0000","last_clean":"2023-12-17T12:02:51.941299+0000","last_became_active":"2023-12-17T12:02:50.677115+0000","last_became_peered":"2023-12-17T12:02:50.677115+0000","last_unstale":"2023-12-17T12:02:51.941299+0000","last_undegraded":"2023-12-17T12:02:51.941299+0000","last_fullsized":"2023-12-17T12:02:51.941299+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:59:09.665514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:54.014406+0000","last_change":"2023-12-17T12:02:49.653748+0000","last_active":"2023-12-17T12:02:54.014406+0000","last_peered":"2023-12-17T12:02:54.014406+0000","last_clean":"2023-12-17T12:02:54.014406+0000","last_became_active":"2023-12-17T12:02:49.652647+0000","last_became_peered":"2023-12-17T12:02:49.652647+0000","last_unstale":"2023-12-17T12:02:54.014406+0000","last_undegraded":"2023-12-17T12:02:54.014406+0000","last_fullsized":"2023-12-17T12:02:54.014406+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:13:40.817124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.668473+0000","last_change":"2023-12-17T12:02:50.686787+0000","last_active":"2023-12-17T12:02:51.668473+0000","last_peered":"2023-12-17T12:02:51.668473+0000","last_clean":"2023-12-17T12:02:51.668473+0000","last_became_active":"2023-12-17T12:02:50.685133+0000","last_became_peered":"2023-12-17T12:02:50.685133+0000","last_unstale":"2023-12-17T12:02:51.668473+0000","last_undegraded":"2023-12-17T12:02:51.668473+0000","last_fullsized":"2023-12-17T12:02:51.668473+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:35:17.972258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'16","reported_seq":37,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:57.059889+0000","last_change":"2023-12-17T12:02:49.662054+0000","last_active":"2023-12-17T12:02:57.059889+0000","last_peered":"2023-12-17T12:02:57.059889+0000","last_clean":"2023-12-17T12:02:57.059889+0000","last_became_active":"2023-12-17T12:02:49.661675+0000","last_became_peered":"2023-12-17T12:02:49.661675+0000","last_unstale":"2023-12-17T12:02:57.059889+0000","last_undegraded":"2023-12-17T12:02:57.059889+0000","last_fullsized":"2023-12-17T12:02:57.059889+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:44:32.547926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18976,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":18,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.670339+0000","last_change":"2023-12-17T12:02:50.678514+0000","last_active":"2023-12-17T12:02:51.670339+0000","last_peered":"2023-12-17T12:02:51.670339+0000","last_clean":"2023-12-17T12:02:51.670339+0000","last_became_active":"2023-12-17T12:02:50.677739+0000","last_became_peered":"2023-12-17T12:02:50.677739+0000","last_unstale":"2023-12-17T12:02:51.670339+0000","last_undegraded":"2023-12-17T12:02:51.670339+0000","last_fullsized":"2023-12-17T12:02:51.670339+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:42:36.269803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:57.032411+0000","last_change":"2023-12-17T12:02:49.655037+0000","last_active":"2023-12-17T12:02:57.032411+0000","last_peered":"2023-12-17T12:02:57.032411+0000","last_clean":"2023-12-17T12:02:57.032411+0000","last_became_active":"2023-12-17T12:02:49.654263+0000","last_became_peered":"2023-12-17T12:02:49.654263+0000","last_unstale":"2023-12-17T12:02:57.032411+0000","last_undegraded":"2023-12-17T12:02:57.032411+0000","last_fullsized":"2023-12-17T12:02:57.032411+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:42:16.512434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.940093+0000","last_change":"2023-12-17T12:02:50.682099+0000","last_active":"2023-12-17T12:02:51.940093+0000","last_peered":"2023-12-17T12:02:51.940093+0000","last_clean":"2023-12-17T12:02:51.940093+0000","last_became_active":"2023-12-17T12:02:50.681124+0000","last_became_peered":"2023-12-17T12:02:50.681124+0000","last_unstale":"2023-12-17T12:02:51.940093+0000","last_undegraded":"2023-12-17T12:02:51.940093+0000","last_fullsized":"2023-12-17T12:02:51.940093+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:03:25.163070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'3","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:54.014413+0000","last_change":"2023-12-17T12:02:49.660993+0000","last_active":"2023-12-17T12:02:54.014413+0000","last_peered":"2023-12-17T12:02:54.014413+0000","last_clean":"2023-12-17T12:02:54.014413+0000","last_became_active":"2023-12-17T12:02:49.658165+0000","last_became_peered":"2023-12-17T12:02:49.658165+0000","last_unstale":"2023-12-17T12:02:54.014413+0000","last_undegraded":"2023-12-17T12:02:54.014413+0000","last_fullsized":"2023-12-17T12:02:54.014413+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:22:41.721994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.813550+0000","last_change":"2023-12-17T12:02:50.679349+0000","last_active":"2023-12-17T12:02:51.813550+0000","last_peered":"2023-12-17T12:02:51.813550+0000","last_clean":"2023-12-17T12:02:51.813550+0000","last_became_active":"2023-12-17T12:02:50.678932+0000","last_became_peered":"2023-12-17T12:02:50.678932+0000","last_unstale":"2023-12-17T12:02:51.813550+0000","last_undegraded":"2023-12-17T12:02:51.813550+0000","last_fullsized":"2023-12-17T12:02:51.813550+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:05:41.517038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'6","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:58.050598+0000","last_change":"2023-12-17T12:02:49.656800+0000","last_active":"2023-12-17T12:02:58.050598+0000","last_peered":"2023-12-17T12:02:58.050598+0000","last_clean":"2023-12-17T12:02:58.050598+0000","last_became_active":"2023-12-17T12:02:49.656440+0000","last_became_peered":"2023-12-17T12:02:49.656440+0000","last_unstale":"2023-12-17T12:02:58.050598+0000","last_undegraded":"2023-12-17T12:02:58.050598+0000","last_fullsized":"2023-12-17T12:02:58.050598+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:04:17.951090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":977,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.813165+0000","last_change":"2023-12-17T12:02:50.684650+0000","last_active":"2023-12-17T12:02:51.813165+0000","last_peered":"2023-12-17T12:02:51.813165+0000","last_clean":"2023-12-17T12:02:51.813165+0000","last_became_active":"2023-12-17T12:02:50.684209+0000","last_became_peered":"2023-12-17T12:02:50.684209+0000","last_unstale":"2023-12-17T12:02:51.813165+0000","last_undegraded":"2023-12-17T12:02:51.813165+0000","last_fullsized":"2023-12-17T12:02:51.813165+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:51:15.756837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:57.035776+0000","last_change":"2023-12-17T12:02:49.673270+0000","last_active":"2023-12-17T12:02:57.035776+0000","last_peered":"2023-12-17T12:02:57.035776+0000","last_clean":"2023-12-17T12:02:57.035776+0000","last_became_active":"2023-12-17T12:02:49.672935+0000","last_became_peered":"2023-12-17T12:02:49.672935+0000","last_unstale":"2023-12-17T12:02:57.035776+0000","last_undegraded":"2023-12-17T12:02:57.035776+0000","last_fullsized":"2023-12-17T12:02:57.035776+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:41:00.777171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.938498+0000","last_change":"2023-12-17T12:02:50.683449+0000","last_active":"2023-12-17T12:02:51.938498+0000","last_peered":"2023-12-17T12:02:51.938498+0000","last_clean":"2023-12-17T12:02:51.938498+0000","last_became_active":"2023-12-17T12:02:50.683138+0000","last_became_peered":"2023-12-17T12:02:50.683138+0000","last_unstale":"2023-12-17T12:02:51.938498+0000","last_undegraded":"2023-12-17T12:02:51.938498+0000","last_fullsized":"2023-12-17T12:02:51.938498+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:39:08.145766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:54.980589+0000","last_change":"2023-12-17T12:02:49.667849+0000","last_active":"2023-12-17T12:02:54.980589+0000","last_peered":"2023-12-17T12:02:54.980589+0000","last_clean":"2023-12-17T12:02:54.980589+0000","last_became_active":"2023-12-17T12:02:49.667565+0000","last_became_peered":"2023-12-17T12:02:49.667565+0000","last_unstale":"2023-12-17T12:02:54.980589+0000","last_undegraded":"2023-12-17T12:02:54.980589+0000","last_fullsized":"2023-12-17T12:02:54.980589+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:39:56.248614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.939401+0000","last_change":"2023-12-17T12:02:50.669342+0000","last_active":"2023-12-17T12:02:51.939401+0000","last_peered":"2023-12-17T12:02:51.939401+0000","last_clean":"2023-12-17T12:02:51.939401+0000","last_became_active":"2023-12-17T12:02:50.668007+0000","last_became_peered":"2023-12-17T12:02:50.668007+0000","last_unstale":"2023-12-17T12:02:51.939401+0000","last_undegraded":"2023-12-17T12:02:51.939401+0000","last_fullsized":"2023-12-17T12:02:51.939401+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:54:56.753474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-17T12:02:50.669944+0000","last_change":"2023-12-17T12:02:49.656914+0000","last_active":"2023-12-17T12:02:50.669944+0000","last_peered":"2023-12-17T12:02:50.669944+0000","last_clean":"2023-12-17T12:02:50.669944+0000","last_became_active":"2023-12-17T12:02:49.656531+0000","last_became_peered":"2023-12-17T12:02:49.656531+0000","last_unstale":"2023-12-17T12:02:50.669944+0000","last_undegraded":"2023-12-17T12:02:50.669944+0000","last_fullsized":"2023-12-17T12:02:50.669944+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:45:14.558037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'1","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:52.348724+0000","last_change":"2023-12-17T12:02:50.677659+0000","last_active":"2023-12-17T12:02:52.348724+0000","last_peered":"2023-12-17T12:02:52.348724+0000","last_clean":"2023-12-17T12:02:52.348724+0000","last_became_active":"2023-12-17T12:02:50.677311+0000","last_became_peered":"2023-12-17T12:02:50.677311+0000","last_unstale":"2023-12-17T12:02:52.348724+0000","last_undegraded":"2023-12-17T12:02:52.348724+0000","last_fullsized":"2023-12-17T12:02:52.348724+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:20:23.134613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-17T12:02:50.674617+0000","last_change":"2023-12-17T12:02:49.665031+0000","last_active":"2023-12-17T12:02:50.674617+0000","last_peered":"2023-12-17T12:02:50.674617+0000","last_clean":"2023-12-17T12:02:50.674617+0000","last_became_active":"2023-12-17T12:02:49.663004+0000","last_became_peered":"2023-12-17T12:02:49.663004+0000","last_unstale":"2023-12-17T12:02:50.674617+0000","last_undegraded":"2023-12-17T12:02:50.674617+0000","last_fullsized":"2023-12-17T12:02:50.674617+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:19:44.410346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.939345+0000","last_change":"2023-12-17T12:02:50.685113+0000","last_active":"2023-12-17T12:02:51.939345+0000","last_peered":"2023-12-17T12:02:51.939345+0000","last_clean":"2023-12-17T12:02:51.939345+0000","last_became_active":"2023-12-17T12:02:50.684804+0000","last_became_peered":"2023-12-17T12:02:50.684804+0000","last_unstale":"2023-12-17T12:02:51.939345+0000","last_undegraded":"2023-12-17T12:02:51.939345+0000","last_fullsized":"2023-12-17T12:02:51.939345+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:54:32.686360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.938696+0000","last_change":"2023-12-17T12:02:50.688514+0000","last_active":"2023-12-17T12:02:51.938696+0000","last_peered":"2023-12-17T12:02:51.938696+0000","last_clean":"2023-12-17T12:02:51.938696+0000","last_became_active":"2023-12-17T12:02:50.687800+0000","last_became_peered":"2023-12-17T12:02:50.687800+0000","last_unstale":"2023-12-17T12:02:51.938696+0000","last_undegraded":"2023-12-17T12:02:51.938696+0000","last_fullsized":"2023-12-17T12:02:51.938696+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:41:45.981241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:54.999221+0000","last_change":"2023-12-17T12:02:49.669423+0000","last_active":"2023-12-17T12:02:54.999221+0000","last_peered":"2023-12-17T12:02:54.999221+0000","last_clean":"2023-12-17T12:02:54.999221+0000","last_became_active":"2023-12-17T12:02:49.668652+0000","last_became_peered":"2023-12-17T12:02:49.668652+0000","last_unstale":"2023-12-17T12:02:54.999221+0000","last_undegraded":"2023-12-17T12:02:54.999221+0000","last_fullsized":"2023-12-17T12:02:54.999221+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:32:02.981652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.939451+0000","last_change":"2023-12-17T12:02:50.685913+0000","last_active":"2023-12-17T12:02:51.939451+0000","last_peered":"2023-12-17T12:02:51.939451+0000","last_clean":"2023-12-17T12:02:51.939451+0000","last_became_active":"2023-12-17T12:02:50.684652+0000","last_became_peered":"2023-12-17T12:02:50.684652+0000","last_unstale":"2023-12-17T12:02:51.939451+0000","last_undegraded":"2023-12-17T12:02:51.939451+0000","last_fullsized":"2023-12-17T12:02:51.939451+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:07:11.077987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":22,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:58.048059+0000","last_change":"2023-12-17T12:02:49.653594+0000","last_active":"2023-12-17T12:02:58.048059+0000","last_peered":"2023-12-17T12:02:58.048059+0000","last_clean":"2023-12-17T12:02:58.048059+0000","last_became_active":"2023-12-17T12:02:49.653183+0000","last_became_peered":"2023-12-17T12:02:49.653183+0000","last_unstale":"2023-12-17T12:02:58.048059+0000","last_undegraded":"2023-12-17T12:02:58.048059+0000","last_fullsized":"2023-12-17T12:02:58.048059+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:17:38.111876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":310,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-17T12:02:50.671310+0000","last_change":"2023-12-17T12:01:45.376881+0000","last_active":"2023-12-17T12:02:50.671310+0000","last_peered":"2023-12-17T12:02:50.671310+0000","last_clean":"2023-12-17T12:02:50.671310+0000","last_became_active":"2023-12-17T12:01:45.376453+0000","last_became_peered":"2023-12-17T12:01:45.376453+0000","last_unstale":"2023-12-17T12:02:50.671310+0000","last_undegraded":"2023-12-17T12:02:50.671310+0000","last_fullsized":"2023-12-17T12:02:50.671310+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:58:44.022902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:58:44.022902+0000","last_clean_scrub_stamp":"2023-12-17T11:58:44.022902+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:31:55.352161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.939022+0000","last_change":"2023-12-17T12:02:50.683902+0000","last_active":"2023-12-17T12:02:51.939022+0000","last_peered":"2023-12-17T12:02:51.939022+0000","last_clean":"2023-12-17T12:02:51.939022+0000","last_became_active":"2023-12-17T12:02:50.682977+0000","last_became_peered":"2023-12-17T12:02:50.682977+0000","last_unstale":"2023-12-17T12:02:51.939022+0000","last_undegraded":"2023-12-17T12:02:51.939022+0000","last_fullsized":"2023-12-17T12:02:51.939022+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:40:51.002822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'1","reported_seq":14,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.813588+0000","last_change":"2023-12-17T12:02:49.659631+0000","last_active":"2023-12-17T12:02:51.813588+0000","last_peered":"2023-12-17T12:02:51.813588+0000","last_clean":"2023-12-17T12:02:51.813588+0000","last_became_active":"2023-12-17T12:02:49.658336+0000","last_became_peered":"2023-12-17T12:02:49.658336+0000","last_unstale":"2023-12-17T12:02:51.813588+0000","last_undegraded":"2023-12-17T12:02:51.813588+0000","last_fullsized":"2023-12-17T12:02:51.813588+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:05:27.210484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:56.023607+0000","last_change":"2023-12-17T12:02:49.675201+0000","last_active":"2023-12-17T12:02:56.023607+0000","last_peered":"2023-12-17T12:02:56.023607+0000","last_clean":"2023-12-17T12:02:56.023607+0000","last_became_active":"2023-12-17T12:02:49.674759+0000","last_became_peered":"2023-12-17T12:02:49.674759+0000","last_unstale":"2023-12-17T12:02:56.023607+0000","last_undegraded":"2023-12-17T12:02:56.023607+0000","last_fullsized":"2023-12-17T12:02:56.023607+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:20:04.166073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.940033+0000","last_change":"2023-12-17T12:02:50.687776+0000","last_active":"2023-12-17T12:02:51.940033+0000","last_peered":"2023-12-17T12:02:51.940033+0000","last_clean":"2023-12-17T12:02:51.940033+0000","last_became_active":"2023-12-17T12:02:50.687428+0000","last_became_peered":"2023-12-17T12:02:50.687428+0000","last_unstale":"2023-12-17T12:02:51.940033+0000","last_undegraded":"2023-12-17T12:02:51.940033+0000","last_fullsized":"2023-12-17T12:02:51.940033+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:59:33.970025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'3","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:54.995710+0000","last_change":"2023-12-17T12:02:49.655786+0000","last_active":"2023-12-17T12:02:54.995710+0000","last_peered":"2023-12-17T12:02:54.995710+0000","last_clean":"2023-12-17T12:02:54.995710+0000","last_became_active":"2023-12-17T12:02:49.655141+0000","last_became_peered":"2023-12-17T12:02:49.655141+0000","last_unstale":"2023-12-17T12:02:54.995710+0000","last_undegraded":"2023-12-17T12:02:54.995710+0000","last_fullsized":"2023-12-17T12:02:54.995710+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:53:08.992755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.940436+0000","last_change":"2023-12-17T12:02:50.677999+0000","last_active":"2023-12-17T12:02:51.940436+0000","last_peered":"2023-12-17T12:02:51.940436+0000","last_clean":"2023-12-17T12:02:51.940436+0000","last_became_active":"2023-12-17T12:02:50.677631+0000","last_became_peered":"2023-12-17T12:02:50.677631+0000","last_unstale":"2023-12-17T12:02:51.940436+0000","last_undegraded":"2023-12-17T12:02:51.940436+0000","last_fullsized":"2023-12-17T12:02:51.940436+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:07:16.006293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:57.031950+0000","last_change":"2023-12-17T12:02:49.654073+0000","last_active":"2023-12-17T12:02:57.031950+0000","last_peered":"2023-12-17T12:02:57.031950+0000","last_clean":"2023-12-17T12:02:57.031950+0000","last_became_active":"2023-12-17T12:02:49.653064+0000","last_became_peered":"2023-12-17T12:02:49.653064+0000","last_unstale":"2023-12-17T12:02:57.031950+0000","last_undegraded":"2023-12-17T12:02:57.031950+0000","last_fullsized":"2023-12-17T12:02:57.031950+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:48:53.075054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.941150+0000","last_change":"2023-12-17T12:02:50.675577+0000","last_active":"2023-12-17T12:02:51.941150+0000","last_peered":"2023-12-17T12:02:51.941150+0000","last_clean":"2023-12-17T12:02:51.941150+0000","last_became_active":"2023-12-17T12:02:50.675142+0000","last_became_peered":"2023-12-17T12:02:50.675142+0000","last_unstale":"2023-12-17T12:02:51.941150+0000","last_undegraded":"2023-12-17T12:02:51.941150+0000","last_fullsized":"2023-12-17T12:02:51.941150+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:38:38.865207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:54.013652+0000","last_change":"2023-12-17T12:02:49.666092+0000","last_active":"2023-12-17T12:02:54.013652+0000","last_peered":"2023-12-17T12:02:54.013652+0000","last_clean":"2023-12-17T12:02:54.013652+0000","last_became_active":"2023-12-17T12:02:49.665672+0000","last_became_peered":"2023-12-17T12:02:49.665672+0000","last_unstale":"2023-12-17T12:02:54.013652+0000","last_undegraded":"2023-12-17T12:02:54.013652+0000","last_fullsized":"2023-12-17T12:02:54.013652+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:34:00.978073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.669516+0000","last_change":"2023-12-17T12:02:50.677089+0000","last_active":"2023-12-17T12:02:51.669516+0000","last_peered":"2023-12-17T12:02:51.669516+0000","last_clean":"2023-12-17T12:02:51.669516+0000","last_became_active":"2023-12-17T12:02:50.676405+0000","last_became_peered":"2023-12-17T12:02:50.676405+0000","last_unstale":"2023-12-17T12:02:51.669516+0000","last_undegraded":"2023-12-17T12:02:51.669516+0000","last_fullsized":"2023-12-17T12:02:51.669516+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:32:55.011141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'3","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:54.014327+0000","last_change":"2023-12-17T12:02:49.659949+0000","last_active":"2023-12-17T12:02:54.014327+0000","last_peered":"2023-12-17T12:02:54.014327+0000","last_clean":"2023-12-17T12:02:54.014327+0000","last_became_active":"2023-12-17T12:02:49.659552+0000","last_became_peered":"2023-12-17T12:02:49.659552+0000","last_unstale":"2023-12-17T12:02:54.014327+0000","last_undegraded":"2023-12-17T12:02:54.014327+0000","last_fullsized":"2023-12-17T12:02:54.014327+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:39:26.912670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.938747+0000","last_change":"2023-12-17T12:02:50.680666+0000","last_active":"2023-12-17T12:02:51.938747+0000","last_peered":"2023-12-17T12:02:51.938747+0000","last_clean":"2023-12-17T12:02:51.938747+0000","last_became_active":"2023-12-17T12:02:50.680288+0000","last_became_peered":"2023-12-17T12:02:50.680288+0000","last_unstale":"2023-12-17T12:02:51.938747+0000","last_undegraded":"2023-12-17T12:02:51.938747+0000","last_fullsized":"2023-12-17T12:02:51.938747+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:52:36.966423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:56.324690+0000","last_change":"2023-12-17T12:02:49.655780+0000","last_active":"2023-12-17T12:02:56.324690+0000","last_peered":"2023-12-17T12:02:56.324690+0000","last_clean":"2023-12-17T12:02:56.324690+0000","last_became_active":"2023-12-17T12:02:49.655455+0000","last_became_peered":"2023-12-17T12:02:49.655455+0000","last_unstale":"2023-12-17T12:02:56.324690+0000","last_undegraded":"2023-12-17T12:02:56.324690+0000","last_fullsized":"2023-12-17T12:02:56.324690+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:14:42.145280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.939427+0000","last_change":"2023-12-17T12:02:50.682874+0000","last_active":"2023-12-17T12:02:51.939427+0000","last_peered":"2023-12-17T12:02:51.939427+0000","last_clean":"2023-12-17T12:02:51.939427+0000","last_became_active":"2023-12-17T12:02:50.682521+0000","last_became_peered":"2023-12-17T12:02:50.682521+0000","last_unstale":"2023-12-17T12:02:51.939427+0000","last_undegraded":"2023-12-17T12:02:51.939427+0000","last_fullsized":"2023-12-17T12:02:51.939427+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:51:21.609286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:54.013325+0000","last_change":"2023-12-17T12:02:49.666401+0000","last_active":"2023-12-17T12:02:54.013325+0000","last_peered":"2023-12-17T12:02:54.013325+0000","last_clean":"2023-12-17T12:02:54.013325+0000","last_became_active":"2023-12-17T12:02:49.663964+0000","last_became_peered":"2023-12-17T12:02:49.663964+0000","last_unstale":"2023-12-17T12:02:54.013325+0000","last_undegraded":"2023-12-17T12:02:54.013325+0000","last_fullsized":"2023-12-17T12:02:54.013325+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:07:45.806809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.813517+0000","last_change":"2023-12-17T12:02:50.689647+0000","last_active":"2023-12-17T12:02:51.813517+0000","last_peered":"2023-12-17T12:02:51.813517+0000","last_clean":"2023-12-17T12:02:51.813517+0000","last_became_active":"2023-12-17T12:02:50.686507+0000","last_became_peered":"2023-12-17T12:02:50.686507+0000","last_unstale":"2023-12-17T12:02:51.813517+0000","last_undegraded":"2023-12-17T12:02:51.813517+0000","last_fullsized":"2023-12-17T12:02:51.813517+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:44:33.359008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'5","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:58.052362+0000","last_change":"2023-12-17T12:02:49.661156+0000","last_active":"2023-12-17T12:02:58.052362+0000","last_peered":"2023-12-17T12:02:58.052362+0000","last_clean":"2023-12-17T12:02:58.052362+0000","last_became_active":"2023-12-17T12:02:49.660277+0000","last_became_peered":"2023-12-17T12:02:49.660277+0000","last_unstale":"2023-12-17T12:02:58.052362+0000","last_undegraded":"2023-12-17T12:02:58.052362+0000","last_fullsized":"2023-12-17T12:02:58.052362+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:58:57.108942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.813675+0000","last_change":"2023-12-17T12:02:50.684018+0000","last_active":"2023-12-17T12:02:51.813675+0000","last_peered":"2023-12-17T12:02:51.813675+0000","last_clean":"2023-12-17T12:02:51.813675+0000","last_became_active":"2023-12-17T12:02:50.683381+0000","last_became_peered":"2023-12-17T12:02:50.683381+0000","last_unstale":"2023-12-17T12:02:51.813675+0000","last_undegraded":"2023-12-17T12:02:51.813675+0000","last_fullsized":"2023-12-17T12:02:51.813675+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:13:45.847989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"82'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.939144+0000","last_change":"2023-12-17T12:02:49.651097+0000","last_active":"2023-12-17T12:02:51.939144+0000","last_peered":"2023-12-17T12:02:51.939144+0000","last_clean":"2023-12-17T12:02:51.939144+0000","last_became_active":"2023-12-17T12:02:49.650677+0000","last_became_peered":"2023-12-17T12:02:49.650677+0000","last_unstale":"2023-12-17T12:02:51.939144+0000","last_undegraded":"2023-12-17T12:02:51.939144+0000","last_fullsized":"2023-12-17T12:02:51.939144+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:43:51.383835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.813387+0000","last_change":"2023-12-17T12:02:50.680988+0000","last_active":"2023-12-17T12:02:51.813387+0000","last_peered":"2023-12-17T12:02:51.813387+0000","last_clean":"2023-12-17T12:02:51.813387+0000","last_became_active":"2023-12-17T12:02:50.680254+0000","last_became_peered":"2023-12-17T12:02:50.680254+0000","last_unstale":"2023-12-17T12:02:51.813387+0000","last_undegraded":"2023-12-17T12:02:51.813387+0000","last_fullsized":"2023-12-17T12:02:51.813387+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:18:12.341302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:57.030038+0000","last_change":"2023-12-17T12:02:49.670420+0000","last_active":"2023-12-17T12:02:57.030038+0000","last_peered":"2023-12-17T12:02:57.030038+0000","last_clean":"2023-12-17T12:02:57.030038+0000","last_became_active":"2023-12-17T12:02:49.668729+0000","last_became_peered":"2023-12-17T12:02:49.668729+0000","last_unstale":"2023-12-17T12:02:57.030038+0000","last_undegraded":"2023-12-17T12:02:57.030038+0000","last_fullsized":"2023-12-17T12:02:57.030038+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:07:14.206167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.813705+0000","last_change":"2023-12-17T12:02:50.681966+0000","last_active":"2023-12-17T12:02:51.813705+0000","last_peered":"2023-12-17T12:02:51.813705+0000","last_clean":"2023-12-17T12:02:51.813705+0000","last_became_active":"2023-12-17T12:02:50.681628+0000","last_became_peered":"2023-12-17T12:02:50.681628+0000","last_unstale":"2023-12-17T12:02:51.813705+0000","last_undegraded":"2023-12-17T12:02:51.813705+0000","last_fullsized":"2023-12-17T12:02:51.813705+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:11:59.882145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.938967+0000","last_change":"2023-12-17T12:02:50.686865+0000","last_active":"2023-12-17T12:02:51.938967+0000","last_peered":"2023-12-17T12:02:51.938967+0000","last_clean":"2023-12-17T12:02:51.938967+0000","last_became_active":"2023-12-17T12:02:50.684800+0000","last_became_peered":"2023-12-17T12:02:50.684800+0000","last_unstale":"2023-12-17T12:02:51.938967+0000","last_undegraded":"2023-12-17T12:02:51.938967+0000","last_fullsized":"2023-12-17T12:02:51.938967+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:14:27.121624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.671099+0000","last_change":"2023-12-17T12:02:50.682010+0000","last_active":"2023-12-17T12:02:51.671099+0000","last_peered":"2023-12-17T12:02:51.671099+0000","last_clean":"2023-12-17T12:02:51.671099+0000","last_became_active":"2023-12-17T12:02:50.681698+0000","last_became_peered":"2023-12-17T12:02:50.681698+0000","last_unstale":"2023-12-17T12:02:51.671099+0000","last_undegraded":"2023-12-17T12:02:51.671099+0000","last_fullsized":"2023-12-17T12:02:51.671099+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:30:58.762792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.670936+0000","last_change":"2023-12-17T12:02:50.690916+0000","last_active":"2023-12-17T12:02:51.670936+0000","last_peered":"2023-12-17T12:02:51.670936+0000","last_clean":"2023-12-17T12:02:51.670936+0000","last_became_active":"2023-12-17T12:02:50.690551+0000","last_became_peered":"2023-12-17T12:02:50.690551+0000","last_unstale":"2023-12-17T12:02:51.670936+0000","last_undegraded":"2023-12-17T12:02:51.670936+0000","last_fullsized":"2023-12-17T12:02:51.670936+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:08:42.166489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.940562+0000","last_change":"2023-12-17T12:02:50.680813+0000","last_active":"2023-12-17T12:02:51.940562+0000","last_peered":"2023-12-17T12:02:51.940562+0000","last_clean":"2023-12-17T12:02:51.940562+0000","last_became_active":"2023-12-17T12:02:50.680501+0000","last_became_peered":"2023-12-17T12:02:50.680501+0000","last_unstale":"2023-12-17T12:02:51.940562+0000","last_undegraded":"2023-12-17T12:02:51.940562+0000","last_fullsized":"2023-12-17T12:02:51.940562+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:11:50.421163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.940130+0000","last_change":"2023-12-17T12:02:50.678160+0000","last_active":"2023-12-17T12:02:51.940130+0000","last_peered":"2023-12-17T12:02:51.940130+0000","last_clean":"2023-12-17T12:02:51.940130+0000","last_became_active":"2023-12-17T12:02:50.677801+0000","last_became_peered":"2023-12-17T12:02:50.677801+0000","last_unstale":"2023-12-17T12:02:51.940130+0000","last_undegraded":"2023-12-17T12:02:51.940130+0000","last_fullsized":"2023-12-17T12:02:51.940130+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:23:50.851920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.939191+0000","last_change":"2023-12-17T12:02:50.671312+0000","last_active":"2023-12-17T12:02:51.939191+0000","last_peered":"2023-12-17T12:02:51.939191+0000","last_clean":"2023-12-17T12:02:51.939191+0000","last_became_active":"2023-12-17T12:02:50.670331+0000","last_became_peered":"2023-12-17T12:02:50.670331+0000","last_unstale":"2023-12-17T12:02:51.939191+0000","last_undegraded":"2023-12-17T12:02:51.939191+0000","last_fullsized":"2023-12-17T12:02:51.939191+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:53:35.185205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.671487+0000","last_change":"2023-12-17T12:02:50.686991+0000","last_active":"2023-12-17T12:02:51.671487+0000","last_peered":"2023-12-17T12:02:51.671487+0000","last_clean":"2023-12-17T12:02:51.671487+0000","last_became_active":"2023-12-17T12:02:50.686669+0000","last_became_peered":"2023-12-17T12:02:50.686669+0000","last_unstale":"2023-12-17T12:02:51.671487+0000","last_undegraded":"2023-12-17T12:02:51.671487+0000","last_fullsized":"2023-12-17T12:02:51.671487+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:16:20.440745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.940257+0000","last_change":"2023-12-17T12:02:50.692248+0000","last_active":"2023-12-17T12:02:51.940257+0000","last_peered":"2023-12-17T12:02:51.940257+0000","last_clean":"2023-12-17T12:02:51.940257+0000","last_became_active":"2023-12-17T12:02:50.691902+0000","last_became_peered":"2023-12-17T12:02:50.691902+0000","last_unstale":"2023-12-17T12:02:51.940257+0000","last_undegraded":"2023-12-17T12:02:51.940257+0000","last_fullsized":"2023-12-17T12:02:51.940257+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:00:43.992500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.938220+0000","last_change":"2023-12-17T12:02:50.677912+0000","last_active":"2023-12-17T12:02:51.938220+0000","last_peered":"2023-12-17T12:02:51.938220+0000","last_clean":"2023-12-17T12:02:51.938220+0000","last_became_active":"2023-12-17T12:02:50.676818+0000","last_became_peered":"2023-12-17T12:02:50.676818+0000","last_unstale":"2023-12-17T12:02:51.938220+0000","last_undegraded":"2023-12-17T12:02:51.938220+0000","last_fullsized":"2023-12-17T12:02:51.938220+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:16:53.103771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.939553+0000","last_change":"2023-12-17T12:02:50.684966+0000","last_active":"2023-12-17T12:02:51.939553+0000","last_peered":"2023-12-17T12:02:51.939553+0000","last_clean":"2023-12-17T12:02:51.939553+0000","last_became_active":"2023-12-17T12:02:50.684622+0000","last_became_peered":"2023-12-17T12:02:50.684622+0000","last_unstale":"2023-12-17T12:02:51.939553+0000","last_undegraded":"2023-12-17T12:02:51.939553+0000","last_fullsized":"2023-12-17T12:02:51.939553+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:58:41.810005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.668255+0000","last_change":"2023-12-17T12:02:50.683939+0000","last_active":"2023-12-17T12:02:51.668255+0000","last_peered":"2023-12-17T12:02:51.668255+0000","last_clean":"2023-12-17T12:02:51.668255+0000","last_became_active":"2023-12-17T12:02:50.682306+0000","last_became_peered":"2023-12-17T12:02:50.682306+0000","last_unstale":"2023-12-17T12:02:51.668255+0000","last_undegraded":"2023-12-17T12:02:51.668255+0000","last_fullsized":"2023-12-17T12:02:51.668255+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:02:24.342403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.940178+0000","last_change":"2023-12-17T12:02:50.684219+0000","last_active":"2023-12-17T12:02:51.940178+0000","last_peered":"2023-12-17T12:02:51.940178+0000","last_clean":"2023-12-17T12:02:51.940178+0000","last_became_active":"2023-12-17T12:02:50.681446+0000","last_became_peered":"2023-12-17T12:02:50.681446+0000","last_unstale":"2023-12-17T12:02:51.940178+0000","last_undegraded":"2023-12-17T12:02:51.940178+0000","last_fullsized":"2023-12-17T12:02:51.940178+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:14:09.223818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":83,"state":"active+clean","last_fresh":"2023-12-17T12:02:51.938981+0000","last_change":"2023-12-17T12:02:50.669333+0000","last_active":"2023-12-17T12:02:51.938981+0000","last_peered":"2023-12-17T12:02:51.938981+0000","last_clean":"2023-12-17T12:02:51.938981+0000","last_became_active":"2023-12-17T12:02:50.668958+0000","last_became_peered":"2023-12-17T12:02:50.668958+0000","last_unstale":"2023-12-17T12:02:51.938981+0000","last_undegraded":"2023-12-17T12:02:51.938981+0000","last_fullsized":"2023-12-17T12:02:51.938981+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:34:37.234282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":248082,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":24437,"num_objects":83,"num_object_clones":0,"num_object_copies":249,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":0,"num_read":39,"num_read_kb":33,"num_write":180,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":55,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":323584,"data_stored":69637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":154,"ondisk_log_size":154,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449100,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":868,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":888832,"data_stored":427559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]}]},{"osd":10,"up_from":70,"seq":300647710738,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28004,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717148,"statfs":{"total":95995035648,"available":95966359552,"internally_reserved":0,"allocated":1011712,"data_stored":1038820,"data_compressed":36144,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73699999999999999}]},{"osd":1,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.57899999999999996}]},{"osd":2,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.76500000000000001}]},{"osd":3,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.88600000000000001}]},{"osd":4,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.79400000000000004}]},{"osd":5,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.70599999999999996}]},{"osd":6,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":0.78200000000000003}]},{"osd":7,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.748}]},{"osd":8,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":0.84699999999999998}]},{"osd":9,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.98199999999999998},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":0.81200000000000006}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]}]},{"osd":9,"up_from":65,"seq":279172874260,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":905216,"data_stored":428343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 12:02:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":1.069,"5min":1.069,"15min":1.069},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.36699999999999999}]},{"osd":1,"last update":"Sun Dec 17 12:02:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.499}]},{"osd":2,"last update":"Sun Dec 17 12:02:21 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.61299999999999999}]},{"osd":3,"last update":"Sun Dec 17 12:02:21 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.442}]},{"osd":4,"last update":"Sun Dec 17 12:02:21 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.8120000000000001,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.56899999999999995}]},{"osd":5,"last update":"Sun Dec 17 12:02:21 2023","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.341,"5min":1.341,"15min":1.341},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.75900000000000001}]},{"osd":6,"last update":"Sun Dec 17 12:02:21 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.99199999999999999,"15min":0.99199999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.444,"5min":1.444,"15min":1.444},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.67700000000000005}]},{"osd":7,"last update":"Sun Dec 17 12:02:21 2023","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.2170000000000001,"5min":1.2170000000000001,"15min":1.2170000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.875,"5min":0.875,"15min":0.875},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.80200000000000005}]},{"osd":8,"last update":"Sun Dec 17 12:02:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"min":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.98199999999999998,"5min":0.98199999999999998,"15min":0.98199999999999998},"min":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.747}]},{"osd":10,"last update":"Sun Dec 17 12:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.84399999999999997}]}]},{"osd":8,"up_from":58,"seq":249108103194,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":917504,"data_stored":428728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 12:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.747},{"interface":"front","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.76800000000000002}]},{"osd":1,"last update":"Sun Dec 17 12:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.044,"5min":1.044,"15min":1.044},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.61299999999999999}]},{"osd":2,"last update":"Sun Dec 17 12:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.52400000000000002}]},{"osd":3,"last update":"Sun Dec 17 12:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.91500000000000004}]},{"osd":4,"last update":"Sun Dec 17 12:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.754,"15min":0.754},"min":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.0629999999999999,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.84999999999999998}]},{"osd":5,"last update":"Sun Dec 17 12:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.746,"15min":0.746},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.70899999999999996}]},{"osd":6,"last update":"Sun Dec 17 12:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.28,"5min":1.28,"15min":1.28},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.006}]},{"osd":7,"last update":"Sun Dec 17 12:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.93000000000000005}]},{"osd":9,"last update":"Sun Dec 17 12:02:25 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.96999999999999997}]},{"osd":10,"last update":"Sun Dec 17 12:02:43 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.873},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":1.2}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]}]},{"osd":7,"up_from":50,"seq":214748364830,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":1019131,"data_compressed":36144,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.627,"15min":0.61899999999999999},"min":{"1min":0.47999999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.61499999999999999,"15min":0.60799999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91500000000000004,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.67500000000000004}]},{"osd":1,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.48399999999999999,"15min":0.47599999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.38300000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83399999999999996,"5min":1.056,"15min":1.056},"last":0.32600000000000001}]},{"osd":2,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":0.80100000000000005,"15min":0.76200000000000001},"min":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":5.8949999999999996,"5min":5.8949999999999996,"15min":5.8949999999999996},"last":0.66100000000000003},{"interface":"front","average":{"1min":1.024,"5min":0.77900000000000003,"15min":0.73799999999999999},"min":{"1min":0.52100000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":5.9210000000000003,"5min":5.9210000000000003,"15min":5.9210000000000003},"last":0.76600000000000001}]},{"osd":3,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.66600000000000004,"15min":0.66200000000000003},"min":{"1min":0.53400000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.84699999999999998,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.70499999999999996,"15min":0.70099999999999996},"min":{"1min":0.46700000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.54000000000000004}]},{"osd":4,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.437,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.96899999999999997,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.63500000000000001,"15min":0.626},"min":{"1min":0.45900000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.61199999999999999}]},{"osd":5,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80500000000000005,"15min":0.80400000000000005},"min":{"1min":0.63700000000000001,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98499999999999999,"5min":1.022,"15min":1.022},"last":0.55400000000000005}]},{"osd":6,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.79900000000000004,"15min":0.79300000000000004},"min":{"1min":0.60399999999999998,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.036,"5min":1.125,"15min":1.125},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.79300000000000004,"15min":0.78300000000000003},"min":{"1min":0.66800000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.79100000000000004}]},{"osd":8,"last update":"Sun Dec 17 12:02:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.84399999999999997,"15min":0.84399999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.71899999999999997}]},{"osd":9,"last update":"Sun Dec 17 12:02:23 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.129,"5min":1.129,"15min":1.129},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.69999999999999996}]},{"osd":10,"last update":"Sun Dec 17 12:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.751},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.84299999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89100000000000001}]}]},{"osd":6,"up_from":45,"seq":193273528355,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":892928,"data_stored":427398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 12:02:15 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.48699999999999999,"15min":0.48399999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.626}]},{"osd":1,"last update":"Sun Dec 17 12:02:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.66700000000000004,"15min":0.66600000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.68600000000000005,"15min":0.68799999999999994},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.47599999999999998}]},{"osd":2,"last update":"Sun Dec 17 12:02:15 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.70899999999999996,"15min":0.70699999999999996},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.95699999999999996,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.68899999999999995,"15min":0.68500000000000005},"min":{"1min":0.51600000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.67900000000000005}]},{"osd":3,"last update":"Sun Dec 17 12:02:15 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.63200000000000001,"15min":0.63100000000000001},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69099999999999995,"15min":0.68999999999999995},"min":{"1min":0.54500000000000004,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.054,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.52600000000000002}]},{"osd":4,"last update":"Sun Dec 17 12:02:15 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.78300000000000003,"15min":0.78200000000000003},"min":{"1min":0.56599999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.81200000000000006,"15min":0.81599999999999995},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.125,"5min":1.125,"15min":1.125},"last":0.60199999999999998}]},{"osd":5,"last update":"Sun Dec 17 12:02:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.84399999999999997,"15min":0.84499999999999997},"min":{"1min":0.59799999999999998,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.2190000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.86599999999999999,"15min":0.85999999999999999},"min":{"1min":0.63300000000000001,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.3520000000000001,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.69499999999999995}]},{"osd":7,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1639999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.89000000000000001,"15min":0.89800000000000002},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.0960000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.83899999999999997}]},{"osd":8,"last update":"Sun Dec 17 12:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.92600000000000005,"5min":0.92600000000000005,"15min":0.92600000000000005},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.79300000000000004}]},{"osd":9,"last update":"Sun Dec 17 12:02:21 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.95799999999999996,"5min":0.95799999999999996,"15min":0.95799999999999996},"min":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.86499999999999999}]},{"osd":10,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.66000000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574905,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27900,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717252,"statfs":{"total":95995035648,"available":95966466048,"internally_reserved":0,"allocated":905216,"data_stored":429753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 12:02:28 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.67000000000000004,"15min":0.64300000000000002},"min":{"1min":0.377,"5min":0.312,"15min":0.312},"max":{"1min":1.3100000000000001,"5min":4.7089999999999996,"15min":4.7089999999999996},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.629,"15min":0.60799999999999998},"min":{"1min":0.47399999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.81799999999999995}]},{"osd":2,"last update":"Sun Dec 17 12:02:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.68000000000000005,"15min":0.60299999999999998},"min":{"1min":0.53800000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.139,"5min":3.8809999999999998,"15min":3.8809999999999998},"last":0.878},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.69499999999999995,"15min":0.60399999999999998},"min":{"1min":0.59299999999999997,"5min":0.312,"15min":0.312},"max":{"1min":1.0369999999999999,"5min":4.7270000000000003,"15min":4.7270000000000003},"last":0.89500000000000002}]},{"osd":3,"last update":"Sun Dec 17 12:02:10 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.63800000000000001,"15min":0.60399999999999998},"min":{"1min":0.36099999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":1.1499999999999999,"5min":3.9510000000000001,"15min":3.9510000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.67800000000000005,"15min":0.63500000000000001},"min":{"1min":0.42899999999999999,"5min":0.374,"15min":0.374},"max":{"1min":1.175,"5min":3.8639999999999999,"15min":3.8639999999999999},"last":0.51500000000000001}]},{"osd":4,"last update":"Sun Dec 17 12:02:34 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.51600000000000001,"15min":0.48399999999999999},"min":{"1min":0.35399999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.50900000000000001,"15min":0.47599999999999998},"min":{"1min":0.39500000000000002,"5min":0.307,"15min":0.307},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":0.60699999999999998}]},{"osd":5,"last update":"Sun Dec 17 12:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.71699999999999997,"15min":0.70099999999999996},"min":{"1min":0.52000000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1060000000000001,"5min":1.196,"15min":1.196},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.85799999999999998,"15min":0.872},"min":{"1min":0.64000000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.157,"5min":4.7619999999999996,"15min":4.7619999999999996},"last":0.86199999999999999}]},{"osd":6,"last update":"Sun Dec 17 12:02:16 2023","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.79800000000000004,"15min":0.80900000000000005},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.075,"5min":3.895,"15min":3.895},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.879,"15min":0.89000000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.2729999999999999,"5min":3.9260000000000002,"15min":3.9260000000000002},"last":0.83899999999999997}]},{"osd":7,"last update":"Sun Dec 17 12:02:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.76400000000000001,"15min":0.75},"min":{"1min":0.48399999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.70499999999999996,"15min":0.69999999999999996},"min":{"1min":0.503,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.95099999999999996,"5min":1.175,"15min":1.175},"last":0.80100000000000005}]},{"osd":8,"last update":"Sun Dec 17 12:01:58 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.2470000000000001,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.3300000000000001,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":1.01}]},{"osd":9,"last update":"Sun Dec 17 12:02:20 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.105,"5min":1.105,"15min":1.105},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.98999999999999999}]},{"osd":10,"last update":"Sun Dec 17 12:02:45 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":1.0529999999999999},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.94599999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]}]},{"osd":0,"up_from":8,"seq":34359738430,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":897024,"data_stored":427980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 17 12:02:23 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.61299999999999999,"15min":0.56699999999999995},"min":{"1min":0.54200000000000004,"5min":0.375,"15min":0.375},"max":{"1min":1.284,"5min":1.284,"15min":1.284},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.59999999999999998,"15min":0.57599999999999996},"min":{"1min":0.59699999999999998,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.57199999999999995}]},{"osd":2,"last update":"Sun Dec 17 12:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.65700000000000003,"15min":0.621},"min":{"1min":0.52400000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.74099999999999999,"15min":0.65300000000000002},"min":{"1min":0.49099999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.998,"5min":6.9859999999999998,"15min":6.9859999999999998},"last":0.81599999999999995}]},{"osd":3,"last update":"Sun Dec 17 12:01:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46100000000000002,"15min":0.45900000000000002},"min":{"1min":0.34000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72899999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.47399999999999998,"15min":0.46800000000000003},"min":{"1min":0.374,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.67300000000000004,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.45400000000000001}]},{"osd":4,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.67800000000000005,"15min":0.63},"min":{"1min":0.56200000000000006,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.747,"5min":0.65800000000000003,"15min":0.629},"min":{"1min":0.45900000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.66900000000000004}]},{"osd":5,"last update":"Sun Dec 17 12:01:56 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.71599999999999997,"15min":0.70599999999999996},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":1.0609999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.72099999999999997,"15min":0.70999999999999996},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.87}]},{"osd":6,"last update":"Sun Dec 17 12:02:15 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.65300000000000002,"15min":0.625},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.624},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.68600000000000005,"15min":0.66600000000000004},"min":{"1min":0.46500000000000002,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.236,"5min":1.236,"15min":1.236},"last":1.022}]},{"osd":7,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.77500000000000002,"15min":0.77200000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.81899999999999995,"15min":0.80800000000000005},"min":{"1min":0.69399999999999995,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.78600000000000003}]},{"osd":8,"last update":"Sun Dec 17 12:01:59 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.997},{"interface":"front","average":{"1min":0.93100000000000005,"5min":0.93100000000000005,"15min":0.93100000000000005},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.486,"5min":1.486,"15min":1.486},"last":0.93500000000000005}]},{"osd":9,"last update":"Sun Dec 17 12:02:21 2023","interfaces":[{"interface":"back","average":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.92100000000000004},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.97899999999999998}]},{"osd":10,"last update":"Sun Dec 17 12:02:46 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.071},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.84699999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0429999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411382,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":465931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 12:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.63800000000000001,"15min":0.60399999999999998},"min":{"1min":0.38400000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.60999999999999999,"15min":0.59499999999999997},"min":{"1min":0.442,"5min":0.377,"15min":0.377},"max":{"1min":0.84199999999999997,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.81899999999999995}]},{"osd":1,"last update":"Sun Dec 17 12:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.63100000000000001,"15min":0.61799999999999999},"min":{"1min":0.50600000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82399999999999995,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.498},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.63700000000000001,"15min":0.60699999999999998},"min":{"1min":0.48899999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.81799999999999995,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.92000000000000004}]},{"osd":3,"last update":"Sun Dec 17 12:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.67400000000000004,"15min":0.65300000000000002},"min":{"1min":0.45200000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65500000000000003,"15min":0.65100000000000002},"min":{"1min":0.5,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.53300000000000003}]},{"osd":4,"last update":"Sun Dec 17 12:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64300000000000002,"15min":0.63200000000000001},"min":{"1min":0.46000000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.76700000000000002,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.68200000000000005,"15min":0.64600000000000002},"min":{"1min":0.52600000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95999999999999996,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.877}]},{"osd":5,"last update":"Sun Dec 17 12:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.56000000000000005,"15min":0.53400000000000003},"min":{"1min":0.36099999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.625,"15min":0.60899999999999999},"min":{"1min":0.41799999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.97499999999999998,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.95499999999999996}]},{"osd":6,"last update":"Sun Dec 17 12:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.79600000000000004,"15min":0.78800000000000003},"min":{"1min":0.63700000000000001,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.80200000000000005,"5min":0.74399999999999999,"15min":0.73399999999999999},"min":{"1min":0.60599999999999998,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.89900000000000002}]},{"osd":7,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.75600000000000001,"15min":0.76200000000000001},"min":{"1min":0.53700000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.86499999999999999,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.62},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.72599999999999998,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.0549999999999999,"5min":1.212,"15min":1.212},"last":0.54200000000000004}]},{"osd":8,"last update":"Sun Dec 17 12:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.55800000000000005}]},{"osd":9,"last update":"Sun Dec 17 12:02:23 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.099,"5min":1.099,"15min":1.099},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.97599999999999998}]},{"osd":10,"last update":"Sun Dec 17 12:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":1.0449999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":1.022}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]}]},{"osd":3,"up_from":25,"seq":107374182448,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":876,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":897024,"data_stored":427472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 12:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.43099999999999999,"15min":0.41299999999999998},"min":{"1min":0.32600000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.5},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.45200000000000001,"15min":0.432},"min":{"1min":0.32800000000000001,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.58999999999999997}]},{"osd":1,"last update":"Sun Dec 17 12:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.65200000000000002,"15min":0.61599999999999999},"min":{"1min":0.54600000000000004,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.66000000000000003,"15min":0.63200000000000001},"min":{"1min":0.498,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.873}]},{"osd":2,"last update":"Sun Dec 17 12:02:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.61799999999999999,"15min":0.61499999999999999},"min":{"1min":0.436,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.625},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.65900000000000003,"15min":0.63700000000000001},"min":{"1min":0.46899999999999997,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.27,"5min":1.27,"15min":1.27},"last":0.91600000000000004}]},{"osd":4,"last update":"Sun Dec 17 12:02:29 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.68100000000000005,"15min":0.65500000000000003},"min":{"1min":0.64400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.70399999999999996,"15min":0.67000000000000004},"min":{"1min":0.57899999999999996,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.85199999999999998}]},{"osd":5,"last update":"Sun Dec 17 12:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.70999999999999996,"15min":0.69399999999999995},"min":{"1min":0.56899999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.69699999999999995,"15min":0.68500000000000005},"min":{"1min":0.499,"5min":0.441,"15min":0.441},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.754}]},{"osd":6,"last update":"Sun Dec 17 12:02:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.58899999999999997,"15min":0.57499999999999996},"min":{"1min":0.40000000000000002,"5min":0.379,"15min":0.379},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.69899999999999995,"15min":0.67300000000000004},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.68300000000000005}]},{"osd":7,"last update":"Sun Dec 17 12:02:45 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.66100000000000003,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0209999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.91500000000000004,"15min":0.90600000000000003},"min":{"1min":0.70499999999999996,"5min":0.622,"15min":0.622},"max":{"1min":1.345,"5min":1.395,"15min":1.395},"last":1.0189999999999999}]},{"osd":8,"last update":"Sun Dec 17 12:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.92800000000000005}]},{"osd":9,"last update":"Sun Dec 17 12:02:20 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.456,"5min":1.456,"15min":1.456},"last":1.073}]},{"osd":10,"last update":"Sun Dec 17 12:02:45 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.96399999999999997},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.94999999999999996}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]}]},{"osd":4,"up_from":33,"seq":141733920812,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717248,"statfs":{"total":95995035648,"available":95966461952,"internally_reserved":0,"allocated":909312,"data_stored":428648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 12:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.57199999999999995,"15min":0.54300000000000004},"min":{"1min":0.48999999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.96899999999999997,"15min":1.103},"min":{"1min":0.46899999999999997,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.294,"5min":13.124000000000001,"15min":13.124000000000001},"last":0.52400000000000002}]},{"osd":1,"last update":"Sun Dec 17 12:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.47999999999999998,"15min":0.442},"min":{"1min":0.33500000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.47999999999999998,"15min":0.45000000000000001},"min":{"1min":0.34200000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.72999999999999998,"5min":0.75,"15min":0.75},"last":0.55100000000000005}]},{"osd":2,"last update":"Sun Dec 17 12:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.67700000000000005,"15min":0.64500000000000002},"min":{"1min":0.57099999999999995,"5min":0.435,"15min":0.435},"max":{"1min":1.05,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.68500000000000005,"15min":0.66000000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":1.1160000000000001}]},{"osd":3,"last update":"Sun Dec 17 12:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.63700000000000001,"15min":0.59099999999999997},"min":{"1min":0.52600000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.65400000000000003,"15min":0.60399999999999998},"min":{"1min":0.57799999999999996,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.1120000000000001,"5min":1.121,"15min":1.121},"last":0.96499999999999997}]},{"osd":5,"last update":"Sun Dec 17 12:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.69199999999999995,"15min":0.64800000000000002},"min":{"1min":0.54900000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1970000000000001,"5min":1.21,"15min":1.21},"last":1.022},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72699999999999998,"15min":0.69899999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0509999999999999,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.91600000000000004}]},{"osd":6,"last update":"Sun Dec 17 12:02:17 2023","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.77400000000000002,"15min":0.76200000000000001},"min":{"1min":0.56799999999999995,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.78800000000000003,"15min":0.78300000000000003},"min":{"1min":0.57099999999999995,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.754}]},{"osd":7,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.752,"15min":0.746},"min":{"1min":0.52400000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.77500000000000002,"15min":0.76500000000000001},"min":{"1min":0.48399999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.68700000000000006}]},{"osd":8,"last update":"Sun Dec 17 12:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":1.0760000000000001},{"interface":"front","average":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":1.137}]},{"osd":9,"last update":"Sun Dec 17 12:02:24 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":1.087}]},{"osd":10,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.78200000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0589999999999999}]}]},{"osd":5,"up_from":38,"seq":163208757287,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":1019072,"data_compressed":36144,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 12:01:52 2023","interfaces":[{"interface":"back","average":{"1min":0.99199999999999999,"5min":0.64300000000000002,"15min":0.58499999999999996},"min":{"1min":0.39600000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":7.077,"5min":7.077,"15min":7.077},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.59799999999999998,"15min":0.58999999999999997},"min":{"1min":0.44700000000000001,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.879,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.47499999999999998}]},{"osd":1,"last update":"Sun Dec 17 12:01:52 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.63700000000000001,"15min":0.625},"min":{"1min":0.47899999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.78500000000000003},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.64300000000000002,"15min":0.629},"min":{"1min":0.504,"5min":0.441,"15min":0.441},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.67900000000000005}]},{"osd":2,"last update":"Sun Dec 17 12:01:52 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.48499999999999999,"15min":0.48299999999999998},"min":{"1min":0.371,"5min":0.307,"15min":0.307},"max":{"1min":0.66900000000000004,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53800000000000003,"15min":0.54300000000000004},"min":{"1min":0.39300000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73399999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.42399999999999999}]},{"osd":3,"last update":"Sun Dec 17 12:01:52 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.64800000000000002,"15min":0.64000000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.77700000000000002,"5min":0.66300000000000003,"15min":0.64400000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.548,"5min":1.548,"15min":1.548},"last":0.71499999999999997}]},{"osd":4,"last update":"Sun Dec 17 12:01:52 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.71899999999999997,"15min":0.70599999999999996},"min":{"1min":0.61199999999999999,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.73399999999999999,"15min":0.72999999999999998},"min":{"1min":0.48999999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.96099999999999997,"5min":1.345,"15min":1.345},"last":0.70299999999999996}]},{"osd":6,"last update":"Sun Dec 17 12:02:18 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.70199999999999996,"15min":0.69199999999999995},"min":{"1min":0.50700000000000001,"5min":0.504,"15min":0.504},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.74399999999999999,"15min":0.72999999999999998},"min":{"1min":0.60099999999999998,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.876}]},{"osd":7,"last update":"Sun Dec 17 12:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76100000000000001,"15min":0.75900000000000001},"min":{"1min":0.49199999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.629},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.90100000000000002,"15min":0.91500000000000004},"min":{"1min":0.54500000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.034,"5min":3.4620000000000002,"15min":3.4620000000000002},"last":0.93899999999999995}]},{"osd":8,"last update":"Sun Dec 17 12:02:00 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.052,"5min":1.052,"15min":1.052},"last":0.85099999999999998}]},{"osd":9,"last update":"Sun Dec 17 12:02:20 2023","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.1200000000000001},"last":0.98299999999999998}]},{"osd":10,"last update":"Sun Dec 17 12:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":1.022}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34502,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34502,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34502,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36144,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36144,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36144,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36144,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":38645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":21101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-17T12:03:00.539 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-17T12:03:00.539 INFO:tasks.cephadm:Setting up client nodes... 2023-12-17T12:03:00.540 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-12-17T12:03:00.995 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:03:01.293 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:01 smithi008 ceph-mon[36830]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-17T12:03:01.293 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:01 smithi008 ceph-mon[36830]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-17T12:03:01.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:01 smithi100 ceph-mon[41266]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-17T12:03:01.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:01 smithi100 ceph-mon[41266]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-17T12:03:01.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:01 smithi186 ceph-mon[41182]: from='client.14826 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-17T12:03:01.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:01 smithi186 ceph-mon[41182]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-17T12:03:02.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.215+0000 7f65eaf15700 1 -- 172.21.15.8:0/2538298024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65e41027e0 msgr2=0x7f65e4102c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:02.218 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.215+0000 7f65eaf15700 1 --2- 172.21.15.8:0/2538298024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65e41027e0 0x7f65e4102c40 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f65d00099c0 tx=0x7f65d0009cd0 comp rx=0 tx=0).stop 2023-12-17T12:03:02.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.216+0000 7f65eaf15700 1 -- 172.21.15.8:0/2538298024 shutdown_connections 2023-12-17T12:03:02.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.216+0000 7f65eaf15700 1 --2- 172.21.15.8:0/2538298024 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65e4103180 0x7f65e4109a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:02.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.216+0000 7f65eaf15700 1 --2- 172.21.15.8:0/2538298024 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65e41015e0 0x7f65e4101a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:02.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.216+0000 7f65eaf15700 1 --2- 172.21.15.8:0/2538298024 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65e41027e0 0x7f65e4102c40 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:02.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.216+0000 7f65eaf15700 1 -- 172.21.15.8:0/2538298024 >> 172.21.15.8:0/2538298024 conn(0x7f65e40fcb80 msgr2=0x7f65e40fefc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:02.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.216+0000 7f65eaf15700 1 -- 172.21.15.8:0/2538298024 shutdown_connections 2023-12-17T12:03:02.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.216+0000 7f65eaf15700 1 -- 172.21.15.8:0/2538298024 wait complete. 2023-12-17T12:03:02.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.217+0000 7f65eaf15700 1 Processor -- start 2023-12-17T12:03:02.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.217+0000 7f65eaf15700 1 -- start start 2023-12-17T12:03:02.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.217+0000 7f65eaf15700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65e41015e0 0x7f65e4197450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:02.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.217+0000 7f65eaf15700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65e41027e0 0x7f65e4197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:02.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.217+0000 7f65eaf15700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65e4103180 0x7f65e419e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:02.222 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.217+0000 7f65eaf15700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e419ef90 con 0x7f65e4103180 2023-12-17T12:03:02.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.217+0000 7f65eaf15700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e419f0d0 con 0x7f65e41027e0 2023-12-17T12:03:02.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.217+0000 7f65eaf15700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65e419f260 con 0x7f65e41015e0 2023-12-17T12:03:02.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.218+0000 7f65e94b2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65e4103180 0x7f65e419e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:02.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.218+0000 7f65e8cb1700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65e41015e0 0x7f65e4197450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:02.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.218+0000 7f65e94b2700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65e4103180 0x7f65e419e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51792/0 (socket says 172.21.15.8:51792) 2023-12-17T12:03:02.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.218+0000 7f65e8cb1700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65e41015e0 0x7f65e4197450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:60120/0 (socket says 172.21.15.8:60120) 2023-12-17T12:03:02.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.218+0000 7f65e94b2700 1 -- 172.21.15.8:0/3641021944 learned_addr learned my addr 172.21.15.8:0/3641021944 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:02.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.218+0000 7f65e3fff700 1 --2- 172.21.15.8:0/3641021944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65e41027e0 0x7f65e4197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:02.223 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.218+0000 7f65e94b2700 1 -- 172.21.15.8:0/3641021944 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65e41015e0 msgr2=0x7f65e4197450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:02.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.218+0000 7f65e94b2700 1 --2- 172.21.15.8:0/3641021944 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65e41015e0 0x7f65e4197450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:02.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.218+0000 7f65e94b2700 1 -- 172.21.15.8:0/3641021944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65e41027e0 msgr2=0x7f65e4197990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:02.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.218+0000 7f65e94b2700 1 --2- 172.21.15.8:0/3641021944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65e41027e0 0x7f65e4197990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:02.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.218+0000 7f65e94b2700 1 -- 172.21.15.8:0/3641021944 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65d00095f0 con 0x7f65e4103180 2023-12-17T12:03:02.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.218+0000 7f65e3fff700 1 --2- 172.21.15.8:0/3641021944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65e41027e0 0x7f65e4197990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T12:03:02.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.218+0000 7f65e94b2700 1 --2- 172.21.15.8:0/3641021944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65e4103180 0x7f65e419e9c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f65dc00ef60 tx=0x7f65dc00ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:02.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.218+0000 7f65e1ffb700 1 -- 172.21.15.8:0/3641021944 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65dc018070 con 0x7f65e4103180 2023-12-17T12:03:02.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.219+0000 7f65e1ffb700 1 -- 172.21.15.8:0/3641021944 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f65dc00f040 con 0x7f65e4103180 2023-12-17T12:03:02.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.219+0000 7f65eaf15700 1 -- 172.21.15.8:0/3641021944 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65e419f4e0 con 0x7f65e4103180 2023-12-17T12:03:02.224 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.219+0000 7f65e1ffb700 1 -- 172.21.15.8:0/3641021944 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65dc00cd10 con 0x7f65e4103180 2023-12-17T12:03:02.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.219+0000 7f65eaf15700 1 -- 172.21.15.8:0/3641021944 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65e419f990 con 0x7f65e4103180 2023-12-17T12:03:02.225 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.220+0000 7f65eaf15700 1 -- 172.21.15.8:0/3641021944 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65e4108bb0 con 0x7f65e4103180 2023-12-17T12:03:02.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.222+0000 7f65e1ffb700 1 -- 172.21.15.8:0/3641021944 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f65dc004ad0 con 0x7f65e4103180 2023-12-17T12:03:02.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.223+0000 7f65e1ffb700 1 --2- 172.21.15.8:0/3641021944 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f65d40a1510 0x7f65d40a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:02.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.223+0000 7f65e1ffb700 1 -- 172.21.15.8:0/3641021944 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f65dc0cc900 con 0x7f65e4103180 2023-12-17T12:03:02.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.223+0000 7f65e8cb1700 1 --2- 172.21.15.8:0/3641021944 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f65d40a1510 0x7f65d40a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:02.226 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.224+0000 7f65e8cb1700 1 --2- 172.21.15.8:0/3641021944 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f65d40a1510 0x7f65d40a39d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f65e4102640 tx=0x7f65d8009260 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:02.228 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.227+0000 7f65e1ffb700 1 -- 172.21.15.8:0/3641021944 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f65dc095f40 con 0x7f65e4103180 2023-12-17T12:03:02.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:02 smithi008 ceph-mon[36830]: pgmap v270: 97 pgs: 97 active+clean; 602 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8.5 KiB/s wr, 26 op/s 2023-12-17T12:03:02.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:02 smithi100 ceph-mon[41266]: pgmap v270: 97 pgs: 97 active+clean; 602 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8.5 KiB/s wr, 26 op/s 2023-12-17T12:03:02.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:02 smithi186 ceph-mon[41182]: pgmap v270: 97 pgs: 97 active+clean; 602 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 8.5 KiB/s wr, 26 op/s 2023-12-17T12:03:02.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.521+0000 7f65eaf15700 1 -- 172.21.15.8:0/3641021944 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f65e410cf90 con 0x7f65e4103180 2023-12-17T12:03:02.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.524+0000 7f65e1ffb700 1 -- 172.21.15.8:0/3641021944 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) v1 ==== 170+0+59 (secure 0 0 0) 0x7f65dc099560 con 0x7f65e4103180 2023-12-17T12:03:02.526 INFO:teuthology.orchestra.run.smithi008.stdout:[client.0] 2023-12-17T12:03:02.526 INFO:teuthology.orchestra.run.smithi008.stdout: key = AQB2435loCUbHxAACw+ebY1I7w+EAmltKTCyvA== 2023-12-17T12:03:02.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.526+0000 7f65eaf15700 1 -- 172.21.15.8:0/3641021944 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f65d40a1510 msgr2=0x7f65d40a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:02.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.526+0000 7f65eaf15700 1 --2- 172.21.15.8:0/3641021944 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f65d40a1510 0x7f65d40a39d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f65e4102640 tx=0x7f65d8009260 comp rx=0 tx=0).stop 2023-12-17T12:03:02.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.526+0000 7f65eaf15700 1 -- 172.21.15.8:0/3641021944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65e4103180 msgr2=0x7f65e419e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:02.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.526+0000 7f65eaf15700 1 --2- 172.21.15.8:0/3641021944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65e4103180 0x7f65e419e9c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f65dc00ef60 tx=0x7f65dc00ef90 comp rx=0 tx=0).stop 2023-12-17T12:03:02.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.526+0000 7f65eaf15700 1 -- 172.21.15.8:0/3641021944 shutdown_connections 2023-12-17T12:03:02.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.526+0000 7f65eaf15700 1 --2- 172.21.15.8:0/3641021944 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f65d40a1510 0x7f65d40a39d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:02.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.526+0000 7f65eaf15700 1 --2- 172.21.15.8:0/3641021944 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f65e4103180 0x7f65e419e9c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:02.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.526+0000 7f65eaf15700 1 --2- 172.21.15.8:0/3641021944 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65e41015e0 0x7f65e4197450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:02.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.526+0000 7f65eaf15700 1 --2- 172.21.15.8:0/3641021944 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f65e41027e0 0x7f65e4197990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:02.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.526+0000 7f65eaf15700 1 -- 172.21.15.8:0/3641021944 >> 172.21.15.8:0/3641021944 conn(0x7f65e40fcb80 msgr2=0x7f65e4105cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:02.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.526+0000 7f65eaf15700 1 -- 172.21.15.8:0/3641021944 shutdown_connections 2023-12-17T12:03:02.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:02.527+0000 7f65eaf15700 1 -- 172.21.15.8:0/3641021944 wait complete. 2023-12-17T12:03:03.018 DEBUG:teuthology.orchestra.run.smithi008:> set -ex 2023-12-17T12:03:03.018 DEBUG:teuthology.orchestra.run.smithi008:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-12-17T12:03:03.018 DEBUG:teuthology.orchestra.run.smithi008:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-17T12:03:03.083 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:03 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/3641021944' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-17T12:03:03.083 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:03 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/3641021944' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-17T12:03:03.121 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-17T12:03:03.121 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-12-17T12:03:03.122 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph mgr dump --format=json 2023-12-17T12:03:03.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:03 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/3641021944' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-17T12:03:03.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:03 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/3641021944' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-17T12:03:03.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:03 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/3641021944' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-12-17T12:03:03.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:03 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/3641021944' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-12-17T12:03:03.583 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:03:04.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:04 smithi100 ceph-mon[41266]: pgmap v271: 97 pgs: 97 active+clean; 624 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 9.2 KiB/s wr, 26 op/s 2023-12-17T12:03:04.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:04 smithi186 ceph-mon[41182]: pgmap v271: 97 pgs: 97 active+clean; 624 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 9.2 KiB/s wr, 26 op/s 2023-12-17T12:03:04.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:04 smithi008 ceph-mon[36830]: pgmap v271: 97 pgs: 97 active+clean; 624 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 9.2 KiB/s wr, 26 op/s 2023-12-17T12:03:04.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.814+0000 7f197851c700 1 -- 172.21.15.8:0/2468540727 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1970068f70 msgr2=0x7f19700693f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:04.816 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.814+0000 7f197851c700 1 --2- 172.21.15.8:0/2468540727 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1970068f70 0x7f19700693f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f19600099c0 tx=0x7f1960009cd0 comp rx=0 tx=0).stop 2023-12-17T12:03:04.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.814+0000 7f197851c700 1 -- 172.21.15.8:0/2468540727 shutdown_connections 2023-12-17T12:03:04.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.814+0000 7f197851c700 1 --2- 172.21.15.8:0/2468540727 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1970069930 0x7f197010e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:04.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.814+0000 7f197851c700 1 --2- 172.21.15.8:0/2468540727 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1970107620 0x7f1970107a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:04.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.814+0000 7f197851c700 1 --2- 172.21.15.8:0/2468540727 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1970068f70 0x7f19700693f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:04.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.814+0000 7f197851c700 1 -- 172.21.15.8:0/2468540727 >> 172.21.15.8:0/2468540727 conn(0x7f1970076570 msgr2=0x7f1970076980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:04.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.814+0000 7f197851c700 1 -- 172.21.15.8:0/2468540727 shutdown_connections 2023-12-17T12:03:04.817 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.814+0000 7f197851c700 1 -- 172.21.15.8:0/2468540727 wait complete. 2023-12-17T12:03:04.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.815+0000 7f197851c700 1 Processor -- start 2023-12-17T12:03:04.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.815+0000 7f197851c700 1 -- start start 2023-12-17T12:03:04.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.816+0000 7f197851c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1970068f70 0x7f197019d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:04.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.816+0000 7f197851c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1970069930 0x7f197019dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:04.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.816+0000 7f197851c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1970107620 0x7f1970197850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:04.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.816+0000 7f197851c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1970197ec0 con 0x7f1970069930 2023-12-17T12:03:04.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.816+0000 7f197851c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1970198030 con 0x7f1970068f70 2023-12-17T12:03:04.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.816+0000 7f197851c700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19701981f0 con 0x7f1970107620 2023-12-17T12:03:04.820 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.816+0000 7f1975ab7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1970069930 0x7f197019dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:04.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.816+0000 7f1975ab7700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1970069930 0x7f197019dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51816/0 (socket says 172.21.15.8:51816) 2023-12-17T12:03:04.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.816+0000 7f1975ab7700 1 -- 172.21.15.8:0/235322531 learned_addr learned my addr 172.21.15.8:0/235322531 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:04.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.816+0000 7f1976ab9700 1 --2- 172.21.15.8:0/235322531 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1970107620 0x7f1970197850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:04.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.816+0000 7f19762b8700 1 --2- 172.21.15.8:0/235322531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1970068f70 0x7f197019d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:04.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.817+0000 7f1975ab7700 1 -- 172.21.15.8:0/235322531 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1970107620 msgr2=0x7f1970197850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:04.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.817+0000 7f1975ab7700 1 --2- 172.21.15.8:0/235322531 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1970107620 0x7f1970197850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:04.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.817+0000 7f1975ab7700 1 -- 172.21.15.8:0/235322531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1970068f70 msgr2=0x7f197019d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:04.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.817+0000 7f1975ab7700 1 --2- 172.21.15.8:0/235322531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1970068f70 0x7f197019d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:04.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.817+0000 7f1975ab7700 1 -- 172.21.15.8:0/235322531 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19600095f0 con 0x7f1970069930 2023-12-17T12:03:04.821 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.817+0000 7f19762b8700 1 --2- 172.21.15.8:0/235322531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1970068f70 0x7f197019d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T12:03:04.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.817+0000 7f1975ab7700 1 --2- 172.21.15.8:0/235322531 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1970069930 0x7f197019dc50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1960005720 tx=0x7f1960005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:04.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.817+0000 7f19677fe700 1 -- 172.21.15.8:0/235322531 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f196001d070 con 0x7f1970069930 2023-12-17T12:03:04.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.817+0000 7f19677fe700 1 -- 172.21.15.8:0/235322531 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f196000fc00 con 0x7f1970069930 2023-12-17T12:03:04.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.817+0000 7f197851c700 1 -- 172.21.15.8:0/235322531 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1970198470 con 0x7f1970069930 2023-12-17T12:03:04.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.817+0000 7f19677fe700 1 -- 172.21.15.8:0/235322531 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1960022bd0 con 0x7f1970069930 2023-12-17T12:03:04.822 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.817+0000 7f197851c700 1 -- 172.21.15.8:0/235322531 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19701a4700 con 0x7f1970069930 2023-12-17T12:03:04.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.819+0000 7f197851c700 1 -- 172.21.15.8:0/235322531 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1970109a00 con 0x7f1970069930 2023-12-17T12:03:04.823 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.820+0000 7f19677fe700 1 -- 172.21.15.8:0/235322531 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f196000f770 con 0x7f1970069930 2023-12-17T12:03:04.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.822+0000 7f19677fe700 1 --2- 172.21.15.8:0/235322531 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f195c0a1590 0x7f195c0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:04.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.822+0000 7f19677fe700 1 -- 172.21.15.8:0/235322531 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f19600ce250 con 0x7f1970069930 2023-12-17T12:03:04.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.822+0000 7f19762b8700 1 --2- 172.21.15.8:0/235322531 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f195c0a1590 0x7f195c0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:04.824 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.823+0000 7f19762b8700 1 --2- 172.21.15.8:0/235322531 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f195c0a1590 0x7f195c0a3a50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f196c00bc10 tx=0x7f196c00b5f0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:04.827 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:04.826+0000 7f19677fe700 1 -- 172.21.15.8:0/235322531 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f1960097990 con 0x7f1970069930 2023-12-17T12:03:05.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:05.096+0000 7f197851c700 1 -- 172.21.15.8:0/235322531 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f1970102cc0 con 0x7f1970069930 2023-12-17T12:03:05.104 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:05.102+0000 7f19677fe700 1 -- 172.21.15.8:0/235322531 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+260398 (secure 0 0 0) 0x7f196009afb0 con 0x7f1970069930 2023-12-17T12:03:05.111 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:03:05.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:05.106+0000 7f197851c700 1 -- 172.21.15.8:0/235322531 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f195c0a1590 msgr2=0x7f195c0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:05.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:05.106+0000 7f197851c700 1 --2- 172.21.15.8:0/235322531 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f195c0a1590 0x7f195c0a3a50 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f196c00bc10 tx=0x7f196c00b5f0 comp rx=0 tx=0).stop 2023-12-17T12:03:05.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:05.106+0000 7f197851c700 1 -- 172.21.15.8:0/235322531 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1970069930 msgr2=0x7f197019dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:05.113 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:05.106+0000 7f197851c700 1 --2- 172.21.15.8:0/235322531 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1970069930 0x7f197019dc50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f1960005720 tx=0x7f1960005750 comp rx=0 tx=0).stop 2023-12-17T12:03:05.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:05.106+0000 7f197851c700 1 -- 172.21.15.8:0/235322531 shutdown_connections 2023-12-17T12:03:05.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:05.106+0000 7f197851c700 1 --2- 172.21.15.8:0/235322531 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f195c0a1590 0x7f195c0a3a50 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:05.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:05.106+0000 7f197851c700 1 --2- 172.21.15.8:0/235322531 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1970107620 0x7f1970197850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:05.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:05.106+0000 7f197851c700 1 --2- 172.21.15.8:0/235322531 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1970068f70 0x7f197019d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:05.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:05.106+0000 7f197851c700 1 --2- 172.21.15.8:0/235322531 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1970069930 0x7f197019dc50 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:05.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:05.106+0000 7f197851c700 1 -- 172.21.15.8:0/235322531 >> 172.21.15.8:0/235322531 conn(0x7f1970076570 msgr2=0x7f19700ff670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:05.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:05.107+0000 7f197851c700 1 -- 172.21.15.8:0/235322531 shutdown_connections 2023-12-17T12:03:05.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:05.107+0000 7f197851c700 1 -- 172.21.15.8:0/235322531 wait complete. 2023-12-17T12:03:05.501 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":17,"active_gid":14154,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6800","nonce":268548699},{"type":"v1","addr":"172.21.15.8:6801","nonce":268548699}]},"active_addr":"172.21.15.8:6801/268548699","active_change":"2023-12-17T11:56:27.362474+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24106,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24107,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.8:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.8:0","nonce":570156207}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.8:0","nonce":3089804012}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.8:0","nonce":2354503894}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.8:0","nonce":1122715560}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.8:0","nonce":2278509691}]}]} 2023-12-17T12:03:05.506 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-12-17T12:03:05.507 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-12-17T12:03:05.507 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph osd dump --format=json 2023-12-17T12:03:05.933 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:03:06.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:05 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/235322531' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-17T12:03:06.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:05 smithi008 ceph-mon[36830]: pgmap v272: 97 pgs: 97 active+clean; 624 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 8.7 KiB/s wr, 25 op/s 2023-12-17T12:03:06.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:05 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/235322531' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-17T12:03:06.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:05 smithi100 ceph-mon[41266]: pgmap v272: 97 pgs: 97 active+clean; 624 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 8.7 KiB/s wr, 25 op/s 2023-12-17T12:03:06.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:05 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/235322531' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-12-17T12:03:06.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:05 smithi186 ceph-mon[41182]: pgmap v272: 97 pgs: 97 active+clean; 624 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 8.7 KiB/s wr, 25 op/s 2023-12-17T12:03:07.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.240+0000 7f79f2250700 1 -- 172.21.15.8:0/2228547690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79ec101680 msgr2=0x7f79ec101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:07.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.240+0000 7f79f2250700 1 --2- 172.21.15.8:0/2228547690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79ec101680 0x7f79ec101b00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f79e0009990 tx=0x7f79e0009ca0 comp rx=0 tx=0).stop 2023-12-17T12:03:07.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.240+0000 7f79f2250700 1 -- 172.21.15.8:0/2228547690 shutdown_connections 2023-12-17T12:03:07.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.240+0000 7f79f2250700 1 --2- 172.21.15.8:0/2228547690 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79ec102040 0x7f79ec10e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:07.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.240+0000 7f79f2250700 1 --2- 172.21.15.8:0/2228547690 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79ec1076f0 0x7f79ec107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:07.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.240+0000 7f79f2250700 1 --2- 172.21.15.8:0/2228547690 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79ec101680 0x7f79ec101b00 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:07.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.240+0000 7f79f2250700 1 -- 172.21.15.8:0/2228547690 >> 172.21.15.8:0/2228547690 conn(0x7f79ec0787c0 msgr2=0x7f79ec078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:07.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.240+0000 7f79f2250700 1 -- 172.21.15.8:0/2228547690 shutdown_connections 2023-12-17T12:03:07.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.240+0000 7f79f2250700 1 -- 172.21.15.8:0/2228547690 wait complete. 2023-12-17T12:03:07.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.241+0000 7f79f2250700 1 Processor -- start 2023-12-17T12:03:07.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.241+0000 7f79f2250700 1 -- start start 2023-12-17T12:03:07.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.242+0000 7f79f2250700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79ec101680 0x7f79ec19f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:07.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.242+0000 7f79f2250700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79ec102040 0x7f79ec19fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:07.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.242+0000 7f79f2250700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79ec1076f0 0x7f79ec199a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:07.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.242+0000 7f79f2250700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec19a060 con 0x7f79ec1076f0 2023-12-17T12:03:07.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.242+0000 7f79f2250700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec19a1d0 con 0x7f79ec101680 2023-12-17T12:03:07.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.242+0000 7f79f2250700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec19a390 con 0x7f79ec102040 2023-12-17T12:03:07.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.242+0000 7f79ebfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79ec1076f0 0x7f79ec199a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:07.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.242+0000 7f79ebfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79ec1076f0 0x7f79ec199a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51838/0 (socket says 172.21.15.8:51838) 2023-12-17T12:03:07.244 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.242+0000 7f79ebfff700 1 -- 172.21.15.8:0/38200492 learned_addr learned my addr 172.21.15.8:0/38200492 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:07.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.242+0000 7f79eaffd700 1 --2- 172.21.15.8:0/38200492 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79ec102040 0x7f79ec19fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:07.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.242+0000 7f79eb7fe700 1 --2- 172.21.15.8:0/38200492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79ec101680 0x7f79ec19f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:07.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.243+0000 7f79ebfff700 1 -- 172.21.15.8:0/38200492 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79ec102040 msgr2=0x7f79ec19fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:07.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.243+0000 7f79ebfff700 1 --2- 172.21.15.8:0/38200492 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79ec102040 0x7f79ec19fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:07.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.243+0000 7f79ebfff700 1 -- 172.21.15.8:0/38200492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79ec101680 msgr2=0x7f79ec19f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:07.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.243+0000 7f79ebfff700 1 --2- 172.21.15.8:0/38200492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79ec101680 0x7f79ec19f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:07.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.243+0000 7f79ebfff700 1 -- 172.21.15.8:0/38200492 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e00095f0 con 0x7f79ec1076f0 2023-12-17T12:03:07.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.243+0000 7f79eb7fe700 1 --2- 172.21.15.8:0/38200492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79ec101680 0x7f79ec19f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T12:03:07.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.243+0000 7f79ebfff700 1 --2- 172.21.15.8:0/38200492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79ec1076f0 0x7f79ec199a00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f79e400efc0 tx=0x7f79e400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:07.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.243+0000 7f79e8ff9700 1 -- 172.21.15.8:0/38200492 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e4018070 con 0x7f79ec1076f0 2023-12-17T12:03:07.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.243+0000 7f79e8ff9700 1 -- 172.21.15.8:0/38200492 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f79e400f040 con 0x7f79ec1076f0 2023-12-17T12:03:07.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.243+0000 7f79e8ff9700 1 -- 172.21.15.8:0/38200492 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e400cce0 con 0x7f79ec1076f0 2023-12-17T12:03:07.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.243+0000 7f79f2250700 1 -- 172.21.15.8:0/38200492 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79ec19a610 con 0x7f79ec1076f0 2023-12-17T12:03:07.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.243+0000 7f79f2250700 1 -- 172.21.15.8:0/38200492 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79ec1a68b0 con 0x7f79ec1076f0 2023-12-17T12:03:07.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.244+0000 7f79f2250700 1 -- 172.21.15.8:0/38200492 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79ec104940 con 0x7f79ec1076f0 2023-12-17T12:03:07.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.246+0000 7f79e8ff9700 1 -- 172.21.15.8:0/38200492 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f79e4004ad0 con 0x7f79ec1076f0 2023-12-17T12:03:07.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.248+0000 7f79e8ff9700 1 --2- 172.21.15.8:0/38200492 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f79d40a1510 0x7f79d40a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:07.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.248+0000 7f79e8ff9700 1 -- 172.21.15.8:0/38200492 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f79e40cc810 con 0x7f79ec1076f0 2023-12-17T12:03:07.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.248+0000 7f79eb7fe700 1 --2- 172.21.15.8:0/38200492 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f79d40a1510 0x7f79d40a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:07.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.249+0000 7f79eb7fe700 1 --2- 172.21.15.8:0/38200492 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f79d40a1510 0x7f79d40a39d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f79dc009b50 tx=0x7f79dc009550 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:07.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.252+0000 7f79e8ff9700 1 -- 172.21.15.8:0/38200492 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f79e4095f50 con 0x7f79ec1076f0 2023-12-17T12:03:07.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.466+0000 7f79f2250700 1 -- 172.21.15.8:0/38200492 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f79ec102d10 con 0x7f79ec1076f0 2023-12-17T12:03:07.469 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.467+0000 7f79e8ff9700 1 -- 172.21.15.8:0/38200492 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22046 (secure 0 0 0) 0x7f79e4099570 con 0x7f79ec1076f0 2023-12-17T12:03:07.469 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:03:07.470 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":83,"fsid":"f43f508a-9cd2-11ee-95a5-87774f69a715","created":"2023-12-17T11:55:30.666634+0000","modified":"2023-12-17T12:02:51.656934+0000","last_up_change":"2023-12-17T12:02:04.656573+0000","last_in_change":"2023-12-17T12:01:45.526832+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:58:43.972745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-17T12:02:48.278153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-17T12:02:49.637968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1f8acaf-a47b-4b74-a78d-e0b6be49a10e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6803","nonce":297519189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6805","nonce":297519189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6809","nonce":297519189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6807","nonce":297519189}]},"public_addr":"172.21.15.8:6803/297519189","cluster_addr":"172.21.15.8:6805/297519189","heartbeat_back_addr":"172.21.15.8:6809/297519189","heartbeat_front_addr":"172.21.15.8:6807/297519189","state":["exists","up"]},{"osd":1,"uuid":"d7138889-77de-43ba-b36b-7628f6f66bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6801","nonce":2496516573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6803","nonce":2496516573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6807","nonce":2496516573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6805","nonce":2496516573}]},"public_addr":"172.21.15.100:6801/2496516573","cluster_addr":"172.21.15.100:6803/2496516573","heartbeat_back_addr":"172.21.15.100:6807/2496516573","heartbeat_front_addr":"172.21.15.100:6805/2496516573","state":["exists","up"]},{"osd":2,"uuid":"ff452a6b-a11e-47be-9eaf-ec1001b51447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6801","nonce":2454925270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6803","nonce":2454925270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6807","nonce":2454925270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6805","nonce":2454925270}]},"public_addr":"172.21.15.186:6801/2454925270","cluster_addr":"172.21.15.186:6803/2454925270","heartbeat_back_addr":"172.21.15.186:6807/2454925270","heartbeat_front_addr":"172.21.15.186:6805/2454925270","state":["exists","up"]},{"osd":3,"uuid":"d19ab765-df7b-48c7-9012-8a3ac7d81aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6811","nonce":1141622701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6813","nonce":1141622701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6817","nonce":1141622701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6815","nonce":1141622701}]},"public_addr":"172.21.15.8:6811/1141622701","cluster_addr":"172.21.15.8:6813/1141622701","heartbeat_back_addr":"172.21.15.8:6817/1141622701","heartbeat_front_addr":"172.21.15.8:6815/1141622701","state":["exists","up"]},{"osd":4,"uuid":"8ecc3a01-f19a-40a7-93a2-8870116afe6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6809","nonce":1902152516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6811","nonce":1902152516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6815","nonce":1902152516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6813","nonce":1902152516}]},"public_addr":"172.21.15.100:6809/1902152516","cluster_addr":"172.21.15.100:6811/1902152516","heartbeat_back_addr":"172.21.15.100:6815/1902152516","heartbeat_front_addr":"172.21.15.100:6813/1902152516","state":["exists","up"]},{"osd":5,"uuid":"ac057cc9-2a27-4216-a7ae-fc60d9796eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6809","nonce":648349934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6811","nonce":648349934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6815","nonce":648349934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6813","nonce":648349934}]},"public_addr":"172.21.15.186:6809/648349934","cluster_addr":"172.21.15.186:6811/648349934","heartbeat_back_addr":"172.21.15.186:6815/648349934","heartbeat_front_addr":"172.21.15.186:6813/648349934","state":["exists","up"]},{"osd":6,"uuid":"bb5325e0-fe12-4bbc-96a9-86c228106a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6819","nonce":3266909294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6821","nonce":3266909294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6825","nonce":3266909294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6823","nonce":3266909294}]},"public_addr":"172.21.15.8:6819/3266909294","cluster_addr":"172.21.15.8:6821/3266909294","heartbeat_back_addr":"172.21.15.8:6825/3266909294","heartbeat_front_addr":"172.21.15.8:6823/3266909294","state":["exists","up"]},{"osd":7,"uuid":"48939d99-29dd-436b-b9f1-fdfe1ee26315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6817","nonce":1631494583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6819","nonce":1631494583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6823","nonce":1631494583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6821","nonce":1631494583}]},"public_addr":"172.21.15.100:6817/1631494583","cluster_addr":"172.21.15.100:6819/1631494583","heartbeat_back_addr":"172.21.15.100:6823/1631494583","heartbeat_front_addr":"172.21.15.100:6821/1631494583","state":["exists","up"]},{"osd":8,"uuid":"e3414f7f-7665-406f-89ec-79cbb3d3e274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6817","nonce":3569004799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6819","nonce":3569004799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6823","nonce":3569004799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6821","nonce":3569004799}]},"public_addr":"172.21.15.186:6817/3569004799","cluster_addr":"172.21.15.186:6819/3569004799","heartbeat_back_addr":"172.21.15.186:6823/3569004799","heartbeat_front_addr":"172.21.15.186:6821/3569004799","state":["exists","up"]},{"osd":9,"uuid":"b04f519d-6e44-4158-b6e1-aa4d64be3404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6827","nonce":3980647643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6829","nonce":3980647643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6833","nonce":3980647643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6831","nonce":3980647643}]},"public_addr":"172.21.15.8:6827/3980647643","cluster_addr":"172.21.15.8:6829/3980647643","heartbeat_back_addr":"172.21.15.8:6833/3980647643","heartbeat_front_addr":"172.21.15.8:6831/3980647643","state":["exists","up"]},{"osd":10,"uuid":"779fde04-620b-4b44-bd35-39be1470eec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6825","nonce":34112410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6827","nonce":34112410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6831","nonce":34112410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6829","nonce":34112410}]},"public_addr":"172.21.15.100:6825/34112410","cluster_addr":"172.21.15.100:6827/34112410","heartbeat_back_addr":"172.21.15.100:6831/34112410","heartbeat_front_addr":"172.21.15.100:6829/34112410","state":["exists","up"]},{"osd":11,"uuid":"6bbcb42f-aa99-44e4-9c3f-d818423eb5b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6825","nonce":3779371472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6827","nonce":3779371472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6831","nonce":3779371472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6829","nonce":3779371472}]},"public_addr":"172.21.15.186:6825/3779371472","cluster_addr":"172.21.15.186:6827/3779371472","heartbeat_back_addr":"172.21.15.186:6831/3779371472","heartbeat_front_addr":"172.21.15.186:6829/3779371472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:57:56.955667+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:58:18.433916+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:58:40.589590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:59:03.635858+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:59:25.544564+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:59:48.171593+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:00:10.876885+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:00:32.920759+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:00:55.273330+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:01:18.131720+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:01:40.259620+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:02:02.776536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/4074020814":"2023-12-18T11:56:27.362306+0000","172.21.15.8:6801/222068650":"2023-12-18T11:56:27.362306+0000","172.21.15.8:6801/4187398661":"2023-12-18T11:56:00.731492+0000","172.21.15.8:6800/222068650":"2023-12-18T11:56:27.362306+0000","172.21.15.8:6800/4187398661":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/2964092603":"2023-12-18T11:56:27.362306+0000","172.21.15.8:0/35186087":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/1429868241":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/174719729":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/2106317618":"2023-12-18T11:56:27.362306+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T12:03:07.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.469+0000 7f79f2250700 1 -- 172.21.15.8:0/38200492 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f79d40a1510 msgr2=0x7f79d40a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:07.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.469+0000 7f79f2250700 1 --2- 172.21.15.8:0/38200492 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f79d40a1510 0x7f79d40a39d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f79dc009b50 tx=0x7f79dc009550 comp rx=0 tx=0).stop 2023-12-17T12:03:07.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.470+0000 7f79f2250700 1 -- 172.21.15.8:0/38200492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79ec1076f0 msgr2=0x7f79ec199a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:07.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.470+0000 7f79f2250700 1 --2- 172.21.15.8:0/38200492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79ec1076f0 0x7f79ec199a00 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f79e400efc0 tx=0x7f79e400c3a0 comp rx=0 tx=0).stop 2023-12-17T12:03:07.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.470+0000 7f79f2250700 1 -- 172.21.15.8:0/38200492 shutdown_connections 2023-12-17T12:03:07.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.470+0000 7f79f2250700 1 --2- 172.21.15.8:0/38200492 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f79d40a1510 0x7f79d40a39d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:07.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.470+0000 7f79f2250700 1 --2- 172.21.15.8:0/38200492 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79ec1076f0 0x7f79ec199a00 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:07.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.470+0000 7f79f2250700 1 --2- 172.21.15.8:0/38200492 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79ec101680 0x7f79ec19f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:07.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.470+0000 7f79f2250700 1 --2- 172.21.15.8:0/38200492 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79ec102040 0x7f79ec19fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:07.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.470+0000 7f79f2250700 1 -- 172.21.15.8:0/38200492 >> 172.21.15.8:0/38200492 conn(0x7f79ec0787c0 msgr2=0x7f79ec10cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:07.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.470+0000 7f79f2250700 1 -- 172.21.15.8:0/38200492 shutdown_connections 2023-12-17T12:03:07.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:07.470+0000 7f79f2250700 1 -- 172.21.15.8:0/38200492 wait complete. 2023-12-17T12:03:07.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:07 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/38200492' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:03:07.902 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-12-17T12:03:07.903 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph osd dump --format=json 2023-12-17T12:03:07.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:07 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/38200492' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:03:07.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:07 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/38200492' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:03:08.327 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:03:08.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:08 smithi008 ceph-mon[36830]: pgmap v273: 97 pgs: 97 active+clean; 632 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 KiB/s wr, 24 op/s 2023-12-17T12:03:08.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:08 smithi100 ceph-mon[41266]: pgmap v273: 97 pgs: 97 active+clean; 632 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 KiB/s wr, 24 op/s 2023-12-17T12:03:08.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:08 smithi186 ceph-mon[41182]: pgmap v273: 97 pgs: 97 active+clean; 632 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 KiB/s wr, 24 op/s 2023-12-17T12:03:09.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.489+0000 7f5dee32d700 1 -- 172.21.15.8:0/2284729477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5de81076f0 msgr2=0x7f5de8107ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:09.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.489+0000 7f5dee32d700 1 --2- 172.21.15.8:0/2284729477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5de81076f0 0x7f5de8107ad0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8009990 tx=0x7f5dd8009ca0 comp rx=0 tx=0).stop 2023-12-17T12:03:09.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.489+0000 7f5dee32d700 1 -- 172.21.15.8:0/2284729477 shutdown_connections 2023-12-17T12:03:09.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.489+0000 7f5dee32d700 1 --2- 172.21.15.8:0/2284729477 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5de8102040 0x7f5de810e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:09.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.489+0000 7f5dee32d700 1 --2- 172.21.15.8:0/2284729477 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5de81076f0 0x7f5de8107ad0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:09.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.489+0000 7f5dee32d700 1 --2- 172.21.15.8:0/2284729477 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5de8101680 0x7f5de8101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:09.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.489+0000 7f5dee32d700 1 -- 172.21.15.8:0/2284729477 >> 172.21.15.8:0/2284729477 conn(0x7f5de80787c0 msgr2=0x7f5de8078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:09.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.489+0000 7f5dee32d700 1 -- 172.21.15.8:0/2284729477 shutdown_connections 2023-12-17T12:03:09.491 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.489+0000 7f5dee32d700 1 -- 172.21.15.8:0/2284729477 wait complete. 2023-12-17T12:03:09.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.491+0000 7f5dee32d700 1 Processor -- start 2023-12-17T12:03:09.492 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.491+0000 7f5dee32d700 1 -- start start 2023-12-17T12:03:09.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.491+0000 7f5dee32d700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5de8101680 0x7f5de819f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:09.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.492+0000 7f5dee32d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5de8102040 0x7f5de819fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:09.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.492+0000 7f5dee32d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5de81076f0 0x7f5de81998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:09.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.492+0000 7f5dee32d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de8199f50 con 0x7f5de8102040 2023-12-17T12:03:09.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.492+0000 7f5dee32d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de819a0c0 con 0x7f5de81076f0 2023-12-17T12:03:09.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.492+0000 7f5dee32d700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de819a280 con 0x7f5de8101680 2023-12-17T12:03:09.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.492+0000 7f5de77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5de8102040 0x7f5de819fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:09.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.492+0000 7f5de77fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5de8102040 0x7f5de819fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:51854/0 (socket says 172.21.15.8:51854) 2023-12-17T12:03:09.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.492+0000 7f5de77fe700 1 -- 172.21.15.8:0/2235576729 learned_addr learned my addr 172.21.15.8:0/2235576729 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:09.494 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.492+0000 7f5de7fff700 1 --2- 172.21.15.8:0/2235576729 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5de8101680 0x7f5de819f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:09.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.492+0000 7f5dec8ca700 1 --2- 172.21.15.8:0/2235576729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5de81076f0 0x7f5de81998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:09.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.492+0000 7f5de77fe700 1 -- 172.21.15.8:0/2235576729 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5de8101680 msgr2=0x7f5de819f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:09.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.492+0000 7f5de77fe700 1 --2- 172.21.15.8:0/2235576729 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5de8101680 0x7f5de819f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:09.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.492+0000 7f5de77fe700 1 -- 172.21.15.8:0/2235576729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5de81076f0 msgr2=0x7f5de81998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:09.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.492+0000 7f5de77fe700 1 --2- 172.21.15.8:0/2235576729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5de81076f0 0x7f5de81998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:09.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.492+0000 7f5de77fe700 1 -- 172.21.15.8:0/2235576729 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd80095f0 con 0x7f5de8102040 2023-12-17T12:03:09.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.492+0000 7f5dec8ca700 1 --2- 172.21.15.8:0/2235576729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5de81076f0 0x7f5de81998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T12:03:09.495 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.493+0000 7f5de77fe700 1 --2- 172.21.15.8:0/2235576729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5de8102040 0x7f5de819fcf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc00d950 tx=0x7f5ddc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:09.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.493+0000 7f5de57fa700 1 -- 172.21.15.8:0/2235576729 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc009940 con 0x7f5de8102040 2023-12-17T12:03:09.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.493+0000 7f5dee32d700 1 -- 172.21.15.8:0/2235576729 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5de819a560 con 0x7f5de8102040 2023-12-17T12:03:09.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.493+0000 7f5de57fa700 1 -- 172.21.15.8:0/2235576729 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5ddc010460 con 0x7f5de8102040 2023-12-17T12:03:09.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.493+0000 7f5de57fa700 1 -- 172.21.15.8:0/2235576729 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ddc00f620 con 0x7f5de8102040 2023-12-17T12:03:09.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.493+0000 7f5dee32d700 1 -- 172.21.15.8:0/2235576729 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5de81a67a0 con 0x7f5de8102040 2023-12-17T12:03:09.496 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.494+0000 7f5dee32d700 1 -- 172.21.15.8:0/2235576729 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5de8104940 con 0x7f5de8102040 2023-12-17T12:03:09.497 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.496+0000 7f5de57fa700 1 -- 172.21.15.8:0/2235576729 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f5ddc0105d0 con 0x7f5de8102040 2023-12-17T12:03:09.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.497+0000 7f5de57fa700 1 --2- 172.21.15.8:0/2235576729 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f5dd00a1510 0x7f5dd00a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:09.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.498+0000 7f5de57fa700 1 -- 172.21.15.8:0/2235576729 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5ddc0ccc40 con 0x7f5de8102040 2023-12-17T12:03:09.499 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.498+0000 7f5de7fff700 1 --2- 172.21.15.8:0/2235576729 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f5dd00a1510 0x7f5dd00a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:09.500 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.498+0000 7f5de7fff700 1 --2- 172.21.15.8:0/2235576729 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f5dd00a1510 0x7f5dd00a39d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5dd800b5c0 tx=0x7f5dd8005fb0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:09.503 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.502+0000 7f5de57fa700 1 -- 172.21.15.8:0/2235576729 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f5ddc0961f0 con 0x7f5de8102040 2023-12-17T12:03:09.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.716+0000 7f5dee32d700 1 -- 172.21.15.8:0/2235576729 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5de8102d10 con 0x7f5de8102040 2023-12-17T12:03:09.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.717+0000 7f5de57fa700 1 -- 172.21.15.8:0/2235576729 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+22046 (secure 0 0 0) 0x7f5ddc016090 con 0x7f5de8102040 2023-12-17T12:03:09.720 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:03:09.720 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":83,"fsid":"f43f508a-9cd2-11ee-95a5-87774f69a715","created":"2023-12-17T11:55:30.666634+0000","modified":"2023-12-17T12:02:51.656934+0000","last_up_change":"2023-12-17T12:02:04.656573+0000","last_in_change":"2023-12-17T12:01:45.526832+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:58:43.972745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-17T12:02:48.278153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-17T12:02:49.637968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1f8acaf-a47b-4b74-a78d-e0b6be49a10e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6803","nonce":297519189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6805","nonce":297519189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6809","nonce":297519189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6807","nonce":297519189}]},"public_addr":"172.21.15.8:6803/297519189","cluster_addr":"172.21.15.8:6805/297519189","heartbeat_back_addr":"172.21.15.8:6809/297519189","heartbeat_front_addr":"172.21.15.8:6807/297519189","state":["exists","up"]},{"osd":1,"uuid":"d7138889-77de-43ba-b36b-7628f6f66bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6801","nonce":2496516573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6803","nonce":2496516573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6807","nonce":2496516573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6805","nonce":2496516573}]},"public_addr":"172.21.15.100:6801/2496516573","cluster_addr":"172.21.15.100:6803/2496516573","heartbeat_back_addr":"172.21.15.100:6807/2496516573","heartbeat_front_addr":"172.21.15.100:6805/2496516573","state":["exists","up"]},{"osd":2,"uuid":"ff452a6b-a11e-47be-9eaf-ec1001b51447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6801","nonce":2454925270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6803","nonce":2454925270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6807","nonce":2454925270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6805","nonce":2454925270}]},"public_addr":"172.21.15.186:6801/2454925270","cluster_addr":"172.21.15.186:6803/2454925270","heartbeat_back_addr":"172.21.15.186:6807/2454925270","heartbeat_front_addr":"172.21.15.186:6805/2454925270","state":["exists","up"]},{"osd":3,"uuid":"d19ab765-df7b-48c7-9012-8a3ac7d81aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6811","nonce":1141622701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6813","nonce":1141622701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6817","nonce":1141622701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6815","nonce":1141622701}]},"public_addr":"172.21.15.8:6811/1141622701","cluster_addr":"172.21.15.8:6813/1141622701","heartbeat_back_addr":"172.21.15.8:6817/1141622701","heartbeat_front_addr":"172.21.15.8:6815/1141622701","state":["exists","up"]},{"osd":4,"uuid":"8ecc3a01-f19a-40a7-93a2-8870116afe6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6809","nonce":1902152516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6811","nonce":1902152516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6815","nonce":1902152516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6813","nonce":1902152516}]},"public_addr":"172.21.15.100:6809/1902152516","cluster_addr":"172.21.15.100:6811/1902152516","heartbeat_back_addr":"172.21.15.100:6815/1902152516","heartbeat_front_addr":"172.21.15.100:6813/1902152516","state":["exists","up"]},{"osd":5,"uuid":"ac057cc9-2a27-4216-a7ae-fc60d9796eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6809","nonce":648349934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6811","nonce":648349934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6815","nonce":648349934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6813","nonce":648349934}]},"public_addr":"172.21.15.186:6809/648349934","cluster_addr":"172.21.15.186:6811/648349934","heartbeat_back_addr":"172.21.15.186:6815/648349934","heartbeat_front_addr":"172.21.15.186:6813/648349934","state":["exists","up"]},{"osd":6,"uuid":"bb5325e0-fe12-4bbc-96a9-86c228106a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6819","nonce":3266909294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6821","nonce":3266909294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6825","nonce":3266909294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6823","nonce":3266909294}]},"public_addr":"172.21.15.8:6819/3266909294","cluster_addr":"172.21.15.8:6821/3266909294","heartbeat_back_addr":"172.21.15.8:6825/3266909294","heartbeat_front_addr":"172.21.15.8:6823/3266909294","state":["exists","up"]},{"osd":7,"uuid":"48939d99-29dd-436b-b9f1-fdfe1ee26315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6817","nonce":1631494583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6819","nonce":1631494583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6823","nonce":1631494583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6821","nonce":1631494583}]},"public_addr":"172.21.15.100:6817/1631494583","cluster_addr":"172.21.15.100:6819/1631494583","heartbeat_back_addr":"172.21.15.100:6823/1631494583","heartbeat_front_addr":"172.21.15.100:6821/1631494583","state":["exists","up"]},{"osd":8,"uuid":"e3414f7f-7665-406f-89ec-79cbb3d3e274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6817","nonce":3569004799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6819","nonce":3569004799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6823","nonce":3569004799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6821","nonce":3569004799}]},"public_addr":"172.21.15.186:6817/3569004799","cluster_addr":"172.21.15.186:6819/3569004799","heartbeat_back_addr":"172.21.15.186:6823/3569004799","heartbeat_front_addr":"172.21.15.186:6821/3569004799","state":["exists","up"]},{"osd":9,"uuid":"b04f519d-6e44-4158-b6e1-aa4d64be3404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6827","nonce":3980647643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6829","nonce":3980647643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6833","nonce":3980647643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6831","nonce":3980647643}]},"public_addr":"172.21.15.8:6827/3980647643","cluster_addr":"172.21.15.8:6829/3980647643","heartbeat_back_addr":"172.21.15.8:6833/3980647643","heartbeat_front_addr":"172.21.15.8:6831/3980647643","state":["exists","up"]},{"osd":10,"uuid":"779fde04-620b-4b44-bd35-39be1470eec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6825","nonce":34112410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6827","nonce":34112410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6831","nonce":34112410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6829","nonce":34112410}]},"public_addr":"172.21.15.100:6825/34112410","cluster_addr":"172.21.15.100:6827/34112410","heartbeat_back_addr":"172.21.15.100:6831/34112410","heartbeat_front_addr":"172.21.15.100:6829/34112410","state":["exists","up"]},{"osd":11,"uuid":"6bbcb42f-aa99-44e4-9c3f-d818423eb5b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6825","nonce":3779371472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6827","nonce":3779371472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6831","nonce":3779371472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6829","nonce":3779371472}]},"public_addr":"172.21.15.186:6825/3779371472","cluster_addr":"172.21.15.186:6827/3779371472","heartbeat_back_addr":"172.21.15.186:6831/3779371472","heartbeat_front_addr":"172.21.15.186:6829/3779371472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:57:56.955667+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:58:18.433916+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:58:40.589590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:59:03.635858+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:59:25.544564+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:59:48.171593+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:00:10.876885+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:00:32.920759+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:00:55.273330+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:01:18.131720+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:01:40.259620+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:02:02.776536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/4074020814":"2023-12-18T11:56:27.362306+0000","172.21.15.8:6801/222068650":"2023-12-18T11:56:27.362306+0000","172.21.15.8:6801/4187398661":"2023-12-18T11:56:00.731492+0000","172.21.15.8:6800/222068650":"2023-12-18T11:56:27.362306+0000","172.21.15.8:6800/4187398661":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/2964092603":"2023-12-18T11:56:27.362306+0000","172.21.15.8:0/35186087":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/1429868241":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/174719729":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/2106317618":"2023-12-18T11:56:27.362306+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T12:03:09.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.720+0000 7f5dee32d700 1 -- 172.21.15.8:0/2235576729 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f5dd00a1510 msgr2=0x7f5dd00a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:09.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.720+0000 7f5dee32d700 1 --2- 172.21.15.8:0/2235576729 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f5dd00a1510 0x7f5dd00a39d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f5dd800b5c0 tx=0x7f5dd8005fb0 comp rx=0 tx=0).stop 2023-12-17T12:03:09.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.720+0000 7f5dee32d700 1 -- 172.21.15.8:0/2235576729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5de8102040 msgr2=0x7f5de819fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:09.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.720+0000 7f5dee32d700 1 --2- 172.21.15.8:0/2235576729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5de8102040 0x7f5de819fcf0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5ddc00d950 tx=0x7f5ddc00dc60 comp rx=0 tx=0).stop 2023-12-17T12:03:09.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.720+0000 7f5dee32d700 1 -- 172.21.15.8:0/2235576729 shutdown_connections 2023-12-17T12:03:09.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.720+0000 7f5dee32d700 1 --2- 172.21.15.8:0/2235576729 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f5dd00a1510 0x7f5dd00a39d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:09.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.720+0000 7f5dee32d700 1 --2- 172.21.15.8:0/2235576729 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5de81076f0 0x7f5de81998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:09.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.720+0000 7f5dee32d700 1 --2- 172.21.15.8:0/2235576729 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5de8101680 0x7f5de819f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:09.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.720+0000 7f5dee32d700 1 --2- 172.21.15.8:0/2235576729 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5de8102040 0x7f5de819fcf0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:09.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.720+0000 7f5dee32d700 1 -- 172.21.15.8:0/2235576729 >> 172.21.15.8:0/2235576729 conn(0x7f5de80787c0 msgr2=0x7f5de810cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:09.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.720+0000 7f5dee32d700 1 -- 172.21.15.8:0/2235576729 shutdown_connections 2023-12-17T12:03:09.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:09.720+0000 7f5dee32d700 1 -- 172.21.15.8:0/2235576729 wait complete. 2023-12-17T12:03:10.272 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2023-12-17T12:03:10.272 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2023-12-17T12:03:10.273 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2023-12-17T12:03:10.273 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2023-12-17T12:03:10.274 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2023-12-17T12:03:10.274 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2023-12-17T12:03:10.275 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph tell osd.6 flush_pg_stats 2023-12-17T12:03:10.275 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph tell osd.7 flush_pg_stats 2023-12-17T12:03:10.276 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph tell osd.8 flush_pg_stats 2023-12-17T12:03:10.276 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph tell osd.9 flush_pg_stats 2023-12-17T12:03:10.277 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph tell osd.10 flush_pg_stats 2023-12-17T12:03:10.277 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph tell osd.11 flush_pg_stats 2023-12-17T12:03:10.746 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:10 smithi008 ceph-mon[36830]: pgmap v274: 97 pgs: 97 active+clean; 632 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.1 KiB/s wr, 20 op/s 2023-12-17T12:03:10.747 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:10 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/2235576729' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:03:10.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:10 smithi100 ceph-mon[41266]: pgmap v274: 97 pgs: 97 active+clean; 632 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.1 KiB/s wr, 20 op/s 2023-12-17T12:03:10.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:10 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/2235576729' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:03:10.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:10 smithi186 ceph-mon[41182]: pgmap v274: 97 pgs: 97 active+clean; 632 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 6.1 KiB/s wr, 20 op/s 2023-12-17T12:03:10.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:10 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/2235576729' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:03:12.345 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:03:12.909 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:12 smithi008 ceph-mon[36830]: pgmap v275: 97 pgs: 97 active+clean; 632 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.0 KiB/s wr, 14 op/s 2023-12-17T12:03:12.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:12 smithi100 ceph-mon[41266]: pgmap v275: 97 pgs: 97 active+clean; 632 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.0 KiB/s wr, 14 op/s 2023-12-17T12:03:12.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:12 smithi186 ceph-mon[41182]: pgmap v275: 97 pgs: 97 active+clean; 632 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.0 KiB/s wr, 14 op/s 2023-12-17T12:03:13.162 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:03:13.164 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:03:13.167 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:03:13.167 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:03:13.215 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:03:13.267 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:03:14.270 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:03:14.570 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:03:14.787 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:14 smithi008 ceph-mon[36830]: pgmap v276: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.4 KiB/s wr, 12 op/s 2023-12-17T12:03:14.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:14 smithi100 ceph-mon[41266]: pgmap v276: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.4 KiB/s wr, 12 op/s 2023-12-17T12:03:14.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:14 smithi186 ceph-mon[41182]: pgmap v276: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.4 KiB/s wr, 12 op/s 2023-12-17T12:03:15.934 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:03:15.936 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:03:16.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.461+0000 7f2bb9984700 1 -- 172.21.15.8:0/4048623688 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bb41037a0 msgr2=0x7f2bb4103c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:16.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.461+0000 7f2bb9984700 1 --2- 172.21.15.8:0/4048623688 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bb41037a0 0x7f2bb4103c20 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2ba8009990 tx=0x7f2ba8009ca0 comp rx=0 tx=0).stop 2023-12-17T12:03:16.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.461+0000 7f2bb9984700 1 -- 172.21.15.8:0/4048623688 shutdown_connections 2023-12-17T12:03:16.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.461+0000 7f2bb9984700 1 --2- 172.21.15.8:0/4048623688 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2bb4104160 0x7f2bb4110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:16.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.461+0000 7f2bb9984700 1 --2- 172.21.15.8:0/4048623688 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bb41097a0 0x7f2bb4109b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:16.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.461+0000 7f2bb9984700 1 --2- 172.21.15.8:0/4048623688 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bb41037a0 0x7f2bb4103c20 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:16.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.461+0000 7f2bb9984700 1 -- 172.21.15.8:0/4048623688 >> 172.21.15.8:0/4048623688 conn(0x7f2bb40ff290 msgr2=0x7f2bb41016b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:16.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.461+0000 7f2bb9984700 1 -- 172.21.15.8:0/4048623688 shutdown_connections 2023-12-17T12:03:16.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.461+0000 7f2bb9984700 1 -- 172.21.15.8:0/4048623688 wait complete. 2023-12-17T12:03:16.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.462+0000 7f2bb9984700 1 Processor -- start 2023-12-17T12:03:16.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.462+0000 7f2bb9984700 1 -- start start 2023-12-17T12:03:16.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.463+0000 7f2bb9984700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bb41037a0 0x7f2bb419f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:16.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.463+0000 7f2bb9984700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2bb4104160 0x7f2bb419fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:16.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.463+0000 7f2bb9984700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bb41097a0 0x7f2bb4199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:16.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.463+0000 7f2bb9984700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb4199ff0 con 0x7f2bb41097a0 2023-12-17T12:03:16.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.463+0000 7f2bb9984700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb419a160 con 0x7f2bb41037a0 2023-12-17T12:03:16.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.463+0000 7f2bb9984700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bb419a320 con 0x7f2bb4104160 2023-12-17T12:03:16.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.463+0000 7f2bb37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bb41097a0 0x7f2bb4199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:16.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.463+0000 7f2bb37fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bb41097a0 0x7f2bb4199990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35172/0 (socket says 172.21.15.8:35172) 2023-12-17T12:03:16.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.463+0000 7f2bb37fe700 1 -- 172.21.15.8:0/323024103 learned_addr learned my addr 172.21.15.8:0/323024103 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:16.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.463+0000 7f2bb2ffd700 1 --2- 172.21.15.8:0/323024103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bb41037a0 0x7f2bb419f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:16.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.463+0000 7f2bb27fc700 1 --2- 172.21.15.8:0/323024103 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2bb4104160 0x7f2bb419fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:16.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.464+0000 7f2bb37fe700 1 -- 172.21.15.8:0/323024103 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2bb4104160 msgr2=0x7f2bb419fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:16.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.464+0000 7f2bb37fe700 1 --2- 172.21.15.8:0/323024103 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2bb4104160 0x7f2bb419fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:16.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.464+0000 7f2bb37fe700 1 -- 172.21.15.8:0/323024103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bb41037a0 msgr2=0x7f2bb419f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:16.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.464+0000 7f2bb37fe700 1 --2- 172.21.15.8:0/323024103 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2bb41037a0 0x7f2bb419f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:16.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.464+0000 7f2bb37fe700 1 -- 172.21.15.8:0/323024103 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba80095f0 con 0x7f2bb41097a0 2023-12-17T12:03:16.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.464+0000 7f2bb37fe700 1 --2- 172.21.15.8:0/323024103 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bb41097a0 0x7f2bb4199990 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2bac00b780 tx=0x7f2bac00ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:16.010 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.464+0000 7f2bb8982700 1 -- 172.21.15.8:0/323024103 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac011820 con 0x7f2bb41097a0 2023-12-17T12:03:16.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.464+0000 7f2bb9984700 1 -- 172.21.15.8:0/323024103 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bb419a600 con 0x7f2bb41097a0 2023-12-17T12:03:16.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.464+0000 7f2bb8982700 1 -- 172.21.15.8:0/323024103 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2bac00d040 con 0x7f2bb41097a0 2023-12-17T12:03:16.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.464+0000 7f2bb8982700 1 -- 172.21.15.8:0/323024103 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bac010d70 con 0x7f2bb41097a0 2023-12-17T12:03:16.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.464+0000 7f2bb9984700 1 -- 172.21.15.8:0/323024103 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bb41a6840 con 0x7f2bb41097a0 2023-12-17T12:03:16.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.465+0000 7f2bb9984700 1 -- 172.21.15.8:0/323024103 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2bb4113950 con 0x7f2bb41097a0 2023-12-17T12:03:16.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.467+0000 7f2bb8982700 1 -- 172.21.15.8:0/323024103 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f2bac011980 con 0x7f2bb41097a0 2023-12-17T12:03:16.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.469+0000 7f2bb8982700 1 --2- 172.21.15.8:0/323024103 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f2b9c0a1510 0x7f2b9c0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:16.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.469+0000 7f2bb8982700 1 -- 172.21.15.8:0/323024103 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2bac0ccb80 con 0x7f2bb41097a0 2023-12-17T12:03:16.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.469+0000 7f2bb2ffd700 1 --2- 172.21.15.8:0/323024103 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f2b9c0a1510 0x7f2b9c0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:16.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.469+0000 7f2bb8982700 1 --2- 172.21.15.8:0/323024103 >> [v2:172.21.15.8:6818/3266909294,v1:172.21.15.8:6819/3266909294] conn(0x7f2b9c0aacf0 0x7f2b9c0ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:16.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.469+0000 7f2bb8982700 1 -- 172.21.15.8:0/323024103 --> [v2:172.21.15.8:6818/3266909294,v1:172.21.15.8:6819/3266909294] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2b9c0ad7c0 con 0x7f2b9c0aacf0 2023-12-17T12:03:16.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.469+0000 7f2bb8982700 1 -- 172.21.15.8:0/323024103 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2bac0d12a0 con 0x7f2bb41097a0 2023-12-17T12:03:16.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.469+0000 7f2bb27fc700 1 --2- 172.21.15.8:0/323024103 >> [v2:172.21.15.8:6818/3266909294,v1:172.21.15.8:6819/3266909294] conn(0x7f2b9c0aacf0 0x7f2b9c0ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:16.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.470+0000 7f2bb2ffd700 1 --2- 172.21.15.8:0/323024103 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f2b9c0a1510 0x7f2b9c0a39d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2ba400ac50 tx=0x7f2ba400a380 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:16.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.470+0000 7f2bb27fc700 1 --2- 172.21.15.8:0/323024103 >> [v2:172.21.15.8:6818/3266909294,v1:172.21.15.8:6819/3266909294] conn(0x7f2b9c0aacf0 0x7f2b9c0ad110 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:16.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.471+0000 7f2bb8982700 1 -- 172.21.15.8:0/323024103 <== osd.6 v2:172.21.15.8:6818/3266909294 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f2b9c0ad7c0 con 0x7f2b9c0aacf0 2023-12-17T12:03:16.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.492+0000 7f2bb9984700 1 -- 172.21.15.8:0/323024103 --> [v2:172.21.15.8:6818/3266909294,v1:172.21.15.8:6819/3266909294] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2bb4061c50 con 0x7f2b9c0aacf0 2023-12-17T12:03:16.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.493+0000 7f2bb8982700 1 -- 172.21.15.8:0/323024103 <== osd.6 v2:172.21.15.8:6818/3266909294 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f2bb4061c50 con 0x7f2b9c0aacf0 2023-12-17T12:03:16.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.493+0000 7f2bb9984700 1 -- 172.21.15.8:0/323024103 >> [v2:172.21.15.8:6818/3266909294,v1:172.21.15.8:6819/3266909294] conn(0x7f2b9c0aacf0 msgr2=0x7f2b9c0ad110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:16.012 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.493+0000 7f2bb9984700 1 --2- 172.21.15.8:0/323024103 >> [v2:172.21.15.8:6818/3266909294,v1:172.21.15.8:6819/3266909294] conn(0x7f2b9c0aacf0 0x7f2b9c0ad110 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:16.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.493+0000 7f2bb9984700 1 -- 172.21.15.8:0/323024103 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f2b9c0a1510 msgr2=0x7f2b9c0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:16.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.493+0000 7f2bb9984700 1 --2- 172.21.15.8:0/323024103 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f2b9c0a1510 0x7f2b9c0a39d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f2ba400ac50 tx=0x7f2ba400a380 comp rx=0 tx=0).stop 2023-12-17T12:03:16.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.493+0000 7f2bb9984700 1 -- 172.21.15.8:0/323024103 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bb41097a0 msgr2=0x7f2bb4199990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:16.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.493+0000 7f2bb9984700 1 --2- 172.21.15.8:0/323024103 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2bb41097a0 0x7f2bb4199990 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2bac00b780 tx=0x7f2bac00ba90 comp rx=0 tx=0).stop 2023-12-17T12:03:16.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.493+0000 7f2bb37fe700 1 -- 172.21.15.8:0/323024103 reap_dead start 2023-12-17T12:03:16.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.493+0000 7f2bb9984700 1 -- 172.21.15.8:0/323024103 shutdown_connections 2023-12-17T12:03:16.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.493+0000 7f2bb9984700 1 -- 172.21.15.8:0/323024103 >> 172.21.15.8:0/323024103 conn(0x7f2bb40ff290 msgr2=0x7f2bb40ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:16.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.493+0000 7f2bb9984700 1 -- 172.21.15.8:0/323024103 shutdown_connections 2023-12-17T12:03:16.013 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:15.493+0000 7f2bb9984700 1 -- 172.21.15.8:0/323024103 wait complete. 2023-12-17T12:03:16.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:15 smithi008 ceph-mon[36830]: pgmap v277: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2023-12-17T12:03:16.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.088+0000 7f006ae03700 1 -- 172.21.15.8:0/3925693378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0064107620 msgr2=0x7f0064107a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:16.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.088+0000 7f006ae03700 1 --2- 172.21.15.8:0/3925693378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0064107620 0x7f0064107a00 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f00580099c0 tx=0x7f0058009cd0 comp rx=0 tx=0).stop 2023-12-17T12:03:16.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.089+0000 7f006ae03700 1 -- 172.21.15.8:0/3925693378 shutdown_connections 2023-12-17T12:03:16.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.089+0000 7f006ae03700 1 --2- 172.21.15.8:0/3925693378 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0064069930 0x7f006410e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:16.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.089+0000 7f006ae03700 1 --2- 172.21.15.8:0/3925693378 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0064107620 0x7f0064107a00 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:16.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.089+0000 7f006ae03700 1 --2- 172.21.15.8:0/3925693378 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0064068f70 0x7f00640693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:16.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.089+0000 7f006ae03700 1 -- 172.21.15.8:0/3925693378 >> 172.21.15.8:0/3925693378 conn(0x7f0064076570 msgr2=0x7f0064076980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:16.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.089+0000 7f006ae03700 1 -- 172.21.15.8:0/3925693378 shutdown_connections 2023-12-17T12:03:16.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.089+0000 7f006ae03700 1 -- 172.21.15.8:0/3925693378 wait complete. 2023-12-17T12:03:16.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.090+0000 7f006ae03700 1 Processor -- start 2023-12-17T12:03:16.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.090+0000 7f006ae03700 1 -- start start 2023-12-17T12:03:16.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.091+0000 7f006ae03700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0064068f70 0x7f0064108430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:16.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.091+0000 7f006ae03700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0064069930 0x7f0064108970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:16.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.091+0000 7f006ae03700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0064107620 0x7f0064108eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:16.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.091+0000 7f006ae03700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00641aa120 con 0x7f0064107620 2023-12-17T12:03:16.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.091+0000 7f006ae03700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00641aa260 con 0x7f0064068f70 2023-12-17T12:03:16.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.091+0000 7f006ae03700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00641aa420 con 0x7f0064069930 2023-12-17T12:03:16.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.091+0000 7f00693a0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0064107620 0x7f0064108eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:16.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.091+0000 7f0068b9f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0064068f70 0x7f0064108430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:16.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.091+0000 7f00693a0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0064107620 0x7f0064108eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35198/0 (socket says 172.21.15.8:35198) 2023-12-17T12:03:16.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.091+0000 7f0068b9f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0064068f70 0x7f0064108430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.8:54224/0 (socket says 172.21.15.8:54224) 2023-12-17T12:03:16.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.091+0000 7f00693a0700 1 -- 172.21.15.8:0/3602953123 learned_addr learned my addr 172.21.15.8:0/3602953123 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:16.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.091+0000 7f0063fff700 1 --2- 172.21.15.8:0/3602953123 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0064069930 0x7f0064108970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:16.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.091+0000 7f00693a0700 1 -- 172.21.15.8:0/3602953123 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0064069930 msgr2=0x7f0064108970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:16.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.091+0000 7f00693a0700 1 --2- 172.21.15.8:0/3602953123 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0064069930 0x7f0064108970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:16.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.091+0000 7f00693a0700 1 -- 172.21.15.8:0/3602953123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0064068f70 msgr2=0x7f0064108430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:16.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.091+0000 7f00693a0700 1 --2- 172.21.15.8:0/3602953123 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f0064068f70 0x7f0064108430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:16.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.092+0000 7f00693a0700 1 -- 172.21.15.8:0/3602953123 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00580095f0 con 0x7f0064107620 2023-12-17T12:03:16.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.092+0000 7f00693a0700 1 --2- 172.21.15.8:0/3602953123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0064107620 0x7f0064108eb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f005c007d70 tx=0x7f005c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:16.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.092+0000 7f0061ffb700 1 -- 172.21.15.8:0/3602953123 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c00ac90 con 0x7f0064107620 2023-12-17T12:03:16.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.092+0000 7f006ae03700 1 -- 172.21.15.8:0/3602953123 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00641aa700 con 0x7f0064107620 2023-12-17T12:03:16.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.092+0000 7f0061ffb700 1 -- 172.21.15.8:0/3602953123 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f005c00adf0 con 0x7f0064107620 2023-12-17T12:03:16.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.092+0000 7f0061ffb700 1 -- 172.21.15.8:0/3602953123 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f005c01b600 con 0x7f0064107620 2023-12-17T12:03:16.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.092+0000 7f006ae03700 1 -- 172.21.15.8:0/3602953123 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00641aac00 con 0x7f0064107620 2023-12-17T12:03:16.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.093+0000 7f006ae03700 1 -- 172.21.15.8:0/3602953123 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f00641116a0 con 0x7f0064107620 2023-12-17T12:03:16.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.095+0000 7f0061ffb700 1 -- 172.21.15.8:0/3602953123 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f005c012420 con 0x7f0064107620 2023-12-17T12:03:16.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.097+0000 7f0061ffb700 1 --2- 172.21.15.8:0/3602953123 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f00540a1510 0x7f00540a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:16.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.097+0000 7f0061ffb700 1 -- 172.21.15.8:0/3602953123 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f005c0cd350 con 0x7f0064107620 2023-12-17T12:03:16.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.097+0000 7f0068b9f700 1 --2- 172.21.15.8:0/3602953123 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f00540a1510 0x7f00540a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:16.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.097+0000 7f0061ffb700 1 --2- 172.21.15.8:0/3602953123 >> [v2:172.21.15.186:6816/3569004799,v1:172.21.15.186:6817/3569004799] conn(0x7f00540aacf0 0x7f00540ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:16.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.097+0000 7f0061ffb700 1 -- 172.21.15.8:0/3602953123 --> [v2:172.21.15.186:6816/3569004799,v1:172.21.15.186:6817/3569004799] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f00540ad7c0 con 0x7f00540aacf0 2023-12-17T12:03:16.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.097+0000 7f0061ffb700 1 -- 172.21.15.8:0/3602953123 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f005c0cd6c0 con 0x7f0064107620 2023-12-17T12:03:16.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.098+0000 7f0068b9f700 1 --2- 172.21.15.8:0/3602953123 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f00540a1510 0x7f00540a39d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f005800b580 tx=0x7f0058005bc0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:16.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.104+0000 7f0063fff700 1 --2- 172.21.15.8:0/3602953123 >> [v2:172.21.15.186:6816/3569004799,v1:172.21.15.186:6817/3569004799] conn(0x7f00540aacf0 0x7f00540ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:16.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.105+0000 7f0063fff700 1 --2- 172.21.15.8:0/3602953123 >> [v2:172.21.15.186:6816/3569004799,v1:172.21.15.186:6817/3569004799] conn(0x7f00540aacf0 0x7f00540ad110 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:16.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.106+0000 7f0061ffb700 1 -- 172.21.15.8:0/3602953123 <== osd.8 v2:172.21.15.186:6816/3569004799 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f00540ad7c0 con 0x7f00540aacf0 2023-12-17T12:03:16.329 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.123+0000 7f006ae03700 1 -- 172.21.15.8:0/3602953123 --> [v2:172.21.15.186:6816/3569004799,v1:172.21.15.186:6817/3569004799] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0064102cc0 con 0x7f00540aacf0 2023-12-17T12:03:16.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.124+0000 7f0061ffb700 1 -- 172.21.15.8:0/3602953123 <== osd.8 v2:172.21.15.186:6816/3569004799 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f0064102cc0 con 0x7f00540aacf0 2023-12-17T12:03:16.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.124+0000 7f006ae03700 1 -- 172.21.15.8:0/3602953123 >> [v2:172.21.15.186:6816/3569004799,v1:172.21.15.186:6817/3569004799] conn(0x7f00540aacf0 msgr2=0x7f00540ad110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:16.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.124+0000 7f006ae03700 1 --2- 172.21.15.8:0/3602953123 >> [v2:172.21.15.186:6816/3569004799,v1:172.21.15.186:6817/3569004799] conn(0x7f00540aacf0 0x7f00540ad110 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:16.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.124+0000 7f006ae03700 1 -- 172.21.15.8:0/3602953123 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f00540a1510 msgr2=0x7f00540a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:16.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.124+0000 7f006ae03700 1 --2- 172.21.15.8:0/3602953123 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f00540a1510 0x7f00540a39d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f005800b580 tx=0x7f0058005bc0 comp rx=0 tx=0).stop 2023-12-17T12:03:16.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.124+0000 7f006ae03700 1 -- 172.21.15.8:0/3602953123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0064107620 msgr2=0x7f0064108eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:16.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.124+0000 7f006ae03700 1 --2- 172.21.15.8:0/3602953123 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f0064107620 0x7f0064108eb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f005c007d70 tx=0x7f005c00a340 comp rx=0 tx=0).stop 2023-12-17T12:03:16.330 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.124+0000 7f00693a0700 1 -- 172.21.15.8:0/3602953123 reap_dead start 2023-12-17T12:03:16.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.125+0000 7f006ae03700 1 -- 172.21.15.8:0/3602953123 shutdown_connections 2023-12-17T12:03:16.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.125+0000 7f006ae03700 1 -- 172.21.15.8:0/3602953123 >> 172.21.15.8:0/3602953123 conn(0x7f0064076570 msgr2=0x7f00640ff0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:16.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.125+0000 7f006ae03700 1 -- 172.21.15.8:0/3602953123 shutdown_connections 2023-12-17T12:03:16.331 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:16.125+0000 7f006ae03700 1 -- 172.21.15.8:0/3602953123 wait complete. 2023-12-17T12:03:16.384 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:03:16.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:15 smithi100 ceph-mon[41266]: pgmap v277: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2023-12-17T12:03:16.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:15 smithi186 ceph-mon[41182]: pgmap v277: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2023-12-17T12:03:17.984 INFO:teuthology.orchestra.run.smithi008.stdout:249108103198 2023-12-17T12:03:17.985 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.8 2023-12-17T12:03:18.558 INFO:teuthology.orchestra.run.smithi008.stdout:193273528359 2023-12-17T12:03:18.559 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.6 2023-12-17T12:03:18.768 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:18 smithi008 ceph-mon[36830]: pgmap v278: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-12-17T12:03:18.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:18 smithi100 ceph-mon[41266]: pgmap v278: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-12-17T12:03:18.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.949+0000 7f47462b6700 1 -- 172.21.15.8:0/2935204475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4740101680 msgr2=0x7f4740101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:18.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.949+0000 7f47462b6700 1 --2- 172.21.15.8:0/2935204475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4740101680 0x7f4740101b00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4734009990 tx=0x7f4734009ca0 comp rx=0 tx=0).stop 2023-12-17T12:03:18.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.949+0000 7f47462b6700 1 -- 172.21.15.8:0/2935204475 shutdown_connections 2023-12-17T12:03:18.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.949+0000 7f47462b6700 1 --2- 172.21.15.8:0/2935204475 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4740102040 0x7f474010e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:18.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.949+0000 7f47462b6700 1 --2- 172.21.15.8:0/2935204475 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47401076f0 0x7f4740107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:18.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.949+0000 7f47462b6700 1 --2- 172.21.15.8:0/2935204475 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4740101680 0x7f4740101b00 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:18.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.949+0000 7f47462b6700 1 -- 172.21.15.8:0/2935204475 >> 172.21.15.8:0/2935204475 conn(0x7f47400787c0 msgr2=0x7f4740078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:18.951 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.949+0000 7f47462b6700 1 -- 172.21.15.8:0/2935204475 shutdown_connections 2023-12-17T12:03:18.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.949+0000 7f47462b6700 1 -- 172.21.15.8:0/2935204475 wait complete. 2023-12-17T12:03:18.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.951+0000 7f47462b6700 1 Processor -- start 2023-12-17T12:03:18.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.951+0000 7f47462b6700 1 -- start start 2023-12-17T12:03:18.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.952+0000 7f47462b6700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4740101680 0x7f474019f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:18.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.952+0000 7f47462b6700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4740102040 0x7f474019fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:18.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.952+0000 7f47462b6700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47401076f0 0x7f47401998d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:18.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.952+0000 7f47462b6700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4740199f30 con 0x7f4740102040 2023-12-17T12:03:18.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.952+0000 7f47462b6700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f474019a0a0 con 0x7f4740101680 2023-12-17T12:03:18.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.952+0000 7f47462b6700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f474019a260 con 0x7f47401076f0 2023-12-17T12:03:18.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.952+0000 7f4744853700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47401076f0 0x7f47401998d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:18.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.952+0000 7f473f7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4740102040 0x7f474019fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:18.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.952+0000 7f4744853700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47401076f0 0x7f47401998d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:49686/0 (socket says 172.21.15.8:49686) 2023-12-17T12:03:18.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.952+0000 7f4744853700 1 -- 172.21.15.8:0/2090391694 learned_addr learned my addr 172.21.15.8:0/2090391694 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:18.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.953+0000 7f473ffff700 1 --2- 172.21.15.8:0/2090391694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4740101680 0x7f474019f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:18.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.953+0000 7f4744853700 1 -- 172.21.15.8:0/2090391694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4740101680 msgr2=0x7f474019f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:18.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.953+0000 7f4744853700 1 --2- 172.21.15.8:0/2090391694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4740101680 0x7f474019f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:18.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.953+0000 7f4744853700 1 -- 172.21.15.8:0/2090391694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4740102040 msgr2=0x7f474019fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:18.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.953+0000 7f4744853700 1 --2- 172.21.15.8:0/2090391694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4740102040 0x7f474019fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:18.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.953+0000 7f4744853700 1 -- 172.21.15.8:0/2090391694 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47340095f0 con 0x7f47401076f0 2023-12-17T12:03:18.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.953+0000 7f473ffff700 1 --2- 172.21.15.8:0/2090391694 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4740101680 0x7f474019f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T12:03:18.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.953+0000 7f473f7fe700 1 --2- 172.21.15.8:0/2090391694 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4740102040 0x7f474019fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T12:03:18.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.953+0000 7f4744853700 1 --2- 172.21.15.8:0/2090391694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47401076f0 0x7f47401998d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4738007fc0 tx=0x7f473800cf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:18.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.954+0000 7f473d7fa700 1 -- 172.21.15.8:0/2090391694 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4738015e90 con 0x7f47401076f0 2023-12-17T12:03:18.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.954+0000 7f47462b6700 1 -- 172.21.15.8:0/2090391694 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f474019a540 con 0x7f47401076f0 2023-12-17T12:03:18.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.954+0000 7f47462b6700 1 -- 172.21.15.8:0/2090391694 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47401085b0 con 0x7f47401076f0 2023-12-17T12:03:18.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.954+0000 7f473d7fa700 1 -- 172.21.15.8:0/2090391694 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f473800aad0 con 0x7f47401076f0 2023-12-17T12:03:18.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.954+0000 7f473d7fa700 1 -- 172.21.15.8:0/2090391694 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473801db20 con 0x7f47401076f0 2023-12-17T12:03:18.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.955+0000 7f47462b6700 1 -- 172.21.15.8:0/2090391694 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f472c000fc0 con 0x7f47401076f0 2023-12-17T12:03:18.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.957+0000 7f473d7fa700 1 -- 172.21.15.8:0/2090391694 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f473800ac40 con 0x7f47401076f0 2023-12-17T12:03:18.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.960+0000 7f473d7fa700 1 --2- 172.21.15.8:0/2090391694 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f47280a1590 0x7f47280a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:18.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.960+0000 7f473d7fa700 1 -- 172.21.15.8:0/2090391694 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f47380d5590 con 0x7f47401076f0 2023-12-17T12:03:18.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.960+0000 7f473ffff700 1 --2- 172.21.15.8:0/2090391694 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f47280a1590 0x7f47280a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:18.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.960+0000 7f473d7fa700 1 --2- 172.21.15.8:0/2090391694 >> [v2:172.21.15.100:6800/2496516573,v1:172.21.15.100:6801/2496516573] conn(0x7f47280aac00 0x7f47280ad020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:18.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.960+0000 7f473d7fa700 1 -- 172.21.15.8:0/2090391694 --> [v2:172.21.15.100:6800/2496516573,v1:172.21.15.100:6801/2496516573] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f47280ad6d0 con 0x7f47280aac00 2023-12-17T12:03:18.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.960+0000 7f473d7fa700 1 -- 172.21.15.8:0/2090391694 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47380d5900 con 0x7f47401076f0 2023-12-17T12:03:18.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.961+0000 7f473ffff700 1 --2- 172.21.15.8:0/2090391694 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f47280a1590 0x7f47280a3a50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4730005950 tx=0x7f47300058e0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:18.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.961+0000 7f473f7fe700 1 --2- 172.21.15.8:0/2090391694 >> [v2:172.21.15.100:6800/2496516573,v1:172.21.15.100:6801/2496516573] conn(0x7f47280aac00 0x7f47280ad020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:18.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.962+0000 7f473f7fe700 1 --2- 172.21.15.8:0/2090391694 >> [v2:172.21.15.100:6800/2496516573,v1:172.21.15.100:6801/2496516573] conn(0x7f47280aac00 0x7f47280ad020 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:18.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.963+0000 7f473d7fa700 1 -- 172.21.15.8:0/2090391694 <== osd.1 v2:172.21.15.100:6800/2496516573 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f47280ad6d0 con 0x7f47280aac00 2023-12-17T12:03:18.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:18 smithi186 ceph-mon[41182]: pgmap v278: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2023-12-17T12:03:18.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.981+0000 7f47462b6700 1 -- 172.21.15.8:0/2090391694 --> [v2:172.21.15.100:6800/2496516573,v1:172.21.15.100:6801/2496516573] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f472c002d40 con 0x7f47280aac00 2023-12-17T12:03:18.983 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.982+0000 7f473d7fa700 1 -- 172.21.15.8:0/2090391694 <== osd.1 v2:172.21.15.100:6800/2496516573 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f472c002d40 con 0x7f47280aac00 2023-12-17T12:03:18.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.982+0000 7f47462b6700 1 -- 172.21.15.8:0/2090391694 >> [v2:172.21.15.100:6800/2496516573,v1:172.21.15.100:6801/2496516573] conn(0x7f47280aac00 msgr2=0x7f47280ad020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:18.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.982+0000 7f47462b6700 1 --2- 172.21.15.8:0/2090391694 >> [v2:172.21.15.100:6800/2496516573,v1:172.21.15.100:6801/2496516573] conn(0x7f47280aac00 0x7f47280ad020 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:18.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.982+0000 7f47462b6700 1 -- 172.21.15.8:0/2090391694 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f47280a1590 msgr2=0x7f47280a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:18.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.982+0000 7f47462b6700 1 --2- 172.21.15.8:0/2090391694 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f47280a1590 0x7f47280a3a50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f4730005950 tx=0x7f47300058e0 comp rx=0 tx=0).stop 2023-12-17T12:03:18.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.982+0000 7f47462b6700 1 -- 172.21.15.8:0/2090391694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47401076f0 msgr2=0x7f47401998d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:18.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.982+0000 7f47462b6700 1 --2- 172.21.15.8:0/2090391694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47401076f0 0x7f47401998d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f4738007fc0 tx=0x7f473800cf80 comp rx=0 tx=0).stop 2023-12-17T12:03:18.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.983+0000 7f4744853700 1 -- 172.21.15.8:0/2090391694 reap_dead start 2023-12-17T12:03:18.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.983+0000 7f47462b6700 1 -- 172.21.15.8:0/2090391694 shutdown_connections 2023-12-17T12:03:18.984 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.983+0000 7f47462b6700 1 -- 172.21.15.8:0/2090391694 >> 172.21.15.8:0/2090391694 conn(0x7f47400787c0 msgr2=0x7f474010caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:18.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.983+0000 7f47462b6700 1 -- 172.21.15.8:0/2090391694 shutdown_connections 2023-12-17T12:03:18.985 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:18.983+0000 7f47462b6700 1 -- 172.21.15.8:0/2090391694 wait complete. 2023-12-17T12:03:19.037 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.036+0000 7fad55485700 1 -- 172.21.15.8:0/1011516869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad50106560 msgr2=0x7fad50106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:19.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.036+0000 7fad55485700 1 --2- 172.21.15.8:0/1011516869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad50106560 0x7fad50106940 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fad400099c0 tx=0x7fad40009cd0 comp rx=0 tx=0).stop 2023-12-17T12:03:19.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.036+0000 7fad55485700 1 -- 172.21.15.8:0/1011516869 shutdown_connections 2023-12-17T12:03:19.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.036+0000 7fad55485700 1 --2- 172.21.15.8:0/1011516869 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad50100ef0 0x7fad5010d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:19.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.036+0000 7fad55485700 1 --2- 172.21.15.8:0/1011516869 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad50106560 0x7fad50106940 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:19.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.036+0000 7fad55485700 1 --2- 172.21.15.8:0/1011516869 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad50100530 0x7fad501009b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:19.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.036+0000 7fad55485700 1 -- 172.21.15.8:0/1011516869 >> 172.21.15.8:0/1011516869 conn(0x7fad50076570 msgr2=0x7fad50076980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:19.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.036+0000 7fad55485700 1 -- 172.21.15.8:0/1011516869 shutdown_connections 2023-12-17T12:03:19.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.036+0000 7fad55485700 1 -- 172.21.15.8:0/1011516869 wait complete. 2023-12-17T12:03:19.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.037+0000 7fad55485700 1 Processor -- start 2023-12-17T12:03:19.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.038+0000 7fad55485700 1 -- start start 2023-12-17T12:03:19.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.038+0000 7fad55485700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad50100530 0x7fad5019f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:19.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.038+0000 7fad55485700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad50100ef0 0x7fad5019fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:19.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.038+0000 7fad55485700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad50106560 0x7fad50199930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:19.039 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.038+0000 7fad55485700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad50199f90 con 0x7fad50100ef0 2023-12-17T12:03:19.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.038+0000 7fad55485700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5019a100 con 0x7fad50100530 2023-12-17T12:03:19.040 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.038+0000 7fad55485700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad5019a2c0 con 0x7fad50106560 2023-12-17T12:03:19.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.038+0000 7fad4e7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad50100ef0 0x7fad5019fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:19.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.038+0000 7fad4e7fc700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad50100ef0 0x7fad5019fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35234/0 (socket says 172.21.15.8:35234) 2023-12-17T12:03:19.041 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.038+0000 7fad4e7fc700 1 -- 172.21.15.8:0/2566770337 learned_addr learned my addr 172.21.15.8:0/2566770337 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:19.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.038+0000 7fad4f7fe700 1 --2- 172.21.15.8:0/2566770337 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad50106560 0x7fad50199930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:19.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.039+0000 7fad4effd700 1 --2- 172.21.15.8:0/2566770337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad50100530 0x7fad5019f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:19.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.039+0000 7fad4e7fc700 1 -- 172.21.15.8:0/2566770337 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad50106560 msgr2=0x7fad50199930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:19.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.039+0000 7fad4e7fc700 1 --2- 172.21.15.8:0/2566770337 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad50106560 0x7fad50199930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:19.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.039+0000 7fad4e7fc700 1 -- 172.21.15.8:0/2566770337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad50100530 msgr2=0x7fad5019f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:19.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.039+0000 7fad4e7fc700 1 --2- 172.21.15.8:0/2566770337 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad50100530 0x7fad5019f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:19.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.039+0000 7fad4e7fc700 1 -- 172.21.15.8:0/2566770337 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad400095f0 con 0x7fad50100ef0 2023-12-17T12:03:19.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.039+0000 7fad4e7fc700 1 --2- 172.21.15.8:0/2566770337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad50100ef0 0x7fad5019fd30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fad4400d950 tx=0x7fad4400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:19.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.039+0000 7fad37fff700 1 -- 172.21.15.8:0/2566770337 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4400f890 con 0x7fad50100ef0 2023-12-17T12:03:19.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.039+0000 7fad37fff700 1 -- 172.21.15.8:0/2566770337 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fad4400fe80 con 0x7fad50100ef0 2023-12-17T12:03:19.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.039+0000 7fad55485700 1 -- 172.21.15.8:0/2566770337 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad5019a5a0 con 0x7fad50100ef0 2023-12-17T12:03:19.042 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.039+0000 7fad37fff700 1 -- 172.21.15.8:0/2566770337 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4400e3b0 con 0x7fad50100ef0 2023-12-17T12:03:19.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.040+0000 7fad55485700 1 -- 172.21.15.8:0/2566770337 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad501a67e0 con 0x7fad50100ef0 2023-12-17T12:03:19.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.040+0000 7fad55485700 1 -- 172.21.15.8:0/2566770337 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fad50110590 con 0x7fad50100ef0 2023-12-17T12:03:19.044 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.043+0000 7fad37fff700 1 -- 172.21.15.8:0/2566770337 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7fad44010460 con 0x7fad50100ef0 2023-12-17T12:03:19.045 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.044+0000 7fad37fff700 1 --2- 172.21.15.8:0/2566770337 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fad380a1590 0x7fad380a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:19.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.044+0000 7fad37fff700 1 -- 172.21.15.8:0/2566770337 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fad440ccfe0 con 0x7fad50100ef0 2023-12-17T12:03:19.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.044+0000 7fad4effd700 1 --2- 172.21.15.8:0/2566770337 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fad380a1590 0x7fad380a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:19.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.044+0000 7fad37fff700 1 --2- 172.21.15.8:0/2566770337 >> [v2:172.21.15.186:6800/2454925270,v1:172.21.15.186:6801/2454925270] conn(0x7fad380aad70 0x7fad380ad190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:19.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.044+0000 7fad37fff700 1 -- 172.21.15.8:0/2566770337 --> [v2:172.21.15.186:6800/2454925270,v1:172.21.15.186:6801/2454925270] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fad380ad840 con 0x7fad380aad70 2023-12-17T12:03:19.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.044+0000 7fad37fff700 1 -- 172.21.15.8:0/2566770337 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad440cd350 con 0x7fad50100ef0 2023-12-17T12:03:19.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.045+0000 7fad4effd700 1 --2- 172.21.15.8:0/2566770337 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fad380a1590 0x7fad380a3a50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fad40000c00 tx=0x7fad40009f10 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:19.046 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.045+0000 7fad4f7fe700 1 --2- 172.21.15.8:0/2566770337 >> [v2:172.21.15.186:6800/2454925270,v1:172.21.15.186:6801/2454925270] conn(0x7fad380aad70 0x7fad380ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:19.047 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.046+0000 7fad4f7fe700 1 --2- 172.21.15.8:0/2566770337 >> [v2:172.21.15.186:6800/2454925270,v1:172.21.15.186:6801/2454925270] conn(0x7fad380aad70 0x7fad380ad190 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:19.048 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.047+0000 7fad37fff700 1 -- 172.21.15.8:0/2566770337 <== osd.2 v2:172.21.15.186:6800/2454925270 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fad380ad840 con 0x7fad380aad70 2023-12-17T12:03:19.065 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.064+0000 7fad55485700 1 -- 172.21.15.8:0/2566770337 --> [v2:172.21.15.186:6800/2454925270,v1:172.21.15.186:6801/2454925270] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fad500698c0 con 0x7fad380aad70 2023-12-17T12:03:19.066 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.065+0000 7fad37fff700 1 -- 172.21.15.8:0/2566770337 <== osd.2 v2:172.21.15.186:6800/2454925270 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fad500698c0 con 0x7fad380aad70 2023-12-17T12:03:19.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.065+0000 7fad55485700 1 -- 172.21.15.8:0/2566770337 >> [v2:172.21.15.186:6800/2454925270,v1:172.21.15.186:6801/2454925270] conn(0x7fad380aad70 msgr2=0x7fad380ad190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:19.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.065+0000 7fad55485700 1 --2- 172.21.15.8:0/2566770337 >> [v2:172.21.15.186:6800/2454925270,v1:172.21.15.186:6801/2454925270] conn(0x7fad380aad70 0x7fad380ad190 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:19.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.065+0000 7fad55485700 1 -- 172.21.15.8:0/2566770337 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fad380a1590 msgr2=0x7fad380a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:19.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.065+0000 7fad55485700 1 --2- 172.21.15.8:0/2566770337 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fad380a1590 0x7fad380a3a50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fad40000c00 tx=0x7fad40009f10 comp rx=0 tx=0).stop 2023-12-17T12:03:19.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.065+0000 7fad55485700 1 -- 172.21.15.8:0/2566770337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad50100ef0 msgr2=0x7fad5019fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:19.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.065+0000 7fad55485700 1 --2- 172.21.15.8:0/2566770337 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad50100ef0 0x7fad5019fd30 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fad4400d950 tx=0x7fad4400dc60 comp rx=0 tx=0).stop 2023-12-17T12:03:19.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.065+0000 7fad4f7fe700 1 -- 172.21.15.8:0/2566770337 reap_dead start 2023-12-17T12:03:19.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.065+0000 7fad55485700 1 -- 172.21.15.8:0/2566770337 shutdown_connections 2023-12-17T12:03:19.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.065+0000 7fad55485700 1 -- 172.21.15.8:0/2566770337 >> 172.21.15.8:0/2566770337 conn(0x7fad50076570 msgr2=0x7fad50068f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:19.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.066+0000 7fad55485700 1 -- 172.21.15.8:0/2566770337 shutdown_connections 2023-12-17T12:03:19.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.066+0000 7fad55485700 1 -- 172.21.15.8:0/2566770337 wait complete. 2023-12-17T12:03:19.613 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.611+0000 7f3aa61b1700 1 -- 172.21.15.8:0/1249052930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3aa0104160 msgr2=0x7f3aa0110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:19.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.611+0000 7f3aa61b1700 1 --2- 172.21.15.8:0/1249052930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3aa0104160 0x7f3aa0110670 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3a9800b0a0 tx=0x7f3a9800b3b0 comp rx=0 tx=0).stop 2023-12-17T12:03:19.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.612+0000 7f3aa61b1700 1 -- 172.21.15.8:0/1249052930 shutdown_connections 2023-12-17T12:03:19.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.612+0000 7f3aa61b1700 1 --2- 172.21.15.8:0/1249052930 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3aa0104160 0x7f3aa0110670 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:19.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.612+0000 7f3aa61b1700 1 --2- 172.21.15.8:0/1249052930 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3aa01097a0 0x7f3aa0109b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:19.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.612+0000 7f3aa61b1700 1 --2- 172.21.15.8:0/1249052930 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3aa01037a0 0x7f3aa0103c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:19.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.612+0000 7f3aa61b1700 1 -- 172.21.15.8:0/1249052930 >> 172.21.15.8:0/1249052930 conn(0x7f3aa00ff290 msgr2=0x7f3aa01016b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:19.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.612+0000 7f3aa61b1700 1 -- 172.21.15.8:0/1249052930 shutdown_connections 2023-12-17T12:03:19.614 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.612+0000 7f3aa61b1700 1 -- 172.21.15.8:0/1249052930 wait complete. 2023-12-17T12:03:19.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.613+0000 7f3aa61b1700 1 Processor -- start 2023-12-17T12:03:19.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.613+0000 7f3aa61b1700 1 -- start start 2023-12-17T12:03:19.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.613+0000 7f3aa61b1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3aa01037a0 0x7f3aa019f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:19.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.613+0000 7f3aa61b1700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3aa0104160 0x7f3aa019feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:19.615 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.613+0000 7f3aa61b1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3aa01097a0 0x7f3aa0199a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:19.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.613+0000 7f3aa61b1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa019a1d0 con 0x7f3aa01097a0 2023-12-17T12:03:19.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.613+0000 7f3aa61b1700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa019a340 con 0x7f3aa01037a0 2023-12-17T12:03:19.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.613+0000 7f3aa61b1700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aa019a500 con 0x7f3aa0104160 2023-12-17T12:03:19.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.613+0000 7f3a9ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3aa01097a0 0x7f3aa0199a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:19.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.614+0000 7f3a9ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3aa01097a0 0x7f3aa0199a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35264/0 (socket says 172.21.15.8:35264) 2023-12-17T12:03:19.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.614+0000 7f3a9ffff700 1 -- 172.21.15.8:0/2742810043 learned_addr learned my addr 172.21.15.8:0/2742810043 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:19.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.614+0000 7f3a9f7fe700 1 --2- 172.21.15.8:0/2742810043 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3aa01037a0 0x7f3aa019f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:19.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.614+0000 7f3a9effd700 1 --2- 172.21.15.8:0/2742810043 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3aa0104160 0x7f3aa019feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:19.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.614+0000 7f3a9ffff700 1 -- 172.21.15.8:0/2742810043 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3aa0104160 msgr2=0x7f3aa019feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:19.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.614+0000 7f3a9ffff700 1 --2- 172.21.15.8:0/2742810043 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3aa0104160 0x7f3aa019feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:19.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.614+0000 7f3a9ffff700 1 -- 172.21.15.8:0/2742810043 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3aa01037a0 msgr2=0x7f3aa019f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:19.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.614+0000 7f3a9ffff700 1 --2- 172.21.15.8:0/2742810043 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3aa01037a0 0x7f3aa019f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:19.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.614+0000 7f3a9ffff700 1 -- 172.21.15.8:0/2742810043 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a98009d00 con 0x7f3aa01097a0 2023-12-17T12:03:19.616 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.614+0000 7f3a9effd700 1 --2- 172.21.15.8:0/2742810043 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3aa0104160 0x7f3aa019feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T12:03:19.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.614+0000 7f3a9ffff700 1 --2- 172.21.15.8:0/2742810043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3aa01097a0 0x7f3aa0199a20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3a9800b070 tx=0x7f3a98007cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:19.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.614+0000 7f3a9cff9700 1 -- 172.21.15.8:0/2742810043 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9800e040 con 0x7f3aa01097a0 2023-12-17T12:03:19.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.614+0000 7f3a9cff9700 1 -- 172.21.15.8:0/2742810043 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3a980094c0 con 0x7f3aa01097a0 2023-12-17T12:03:19.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.614+0000 7f3aa61b1700 1 -- 172.21.15.8:0/2742810043 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3aa019a780 con 0x7f3aa01097a0 2023-12-17T12:03:19.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.614+0000 7f3a9cff9700 1 -- 172.21.15.8:0/2742810043 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a98005040 con 0x7f3aa01097a0 2023-12-17T12:03:19.617 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.615+0000 7f3aa61b1700 1 -- 172.21.15.8:0/2742810043 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aa01a68f0 con 0x7f3aa01097a0 2023-12-17T12:03:19.618 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.615+0000 7f3aa61b1700 1 -- 172.21.15.8:0/2742810043 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3aa0113900 con 0x7f3aa01097a0 2023-12-17T12:03:19.619 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.618+0000 7f3a9cff9700 1 -- 172.21.15.8:0/2742810043 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f3a9801d480 con 0x7f3aa01097a0 2023-12-17T12:03:19.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.619+0000 7f3a9cff9700 1 --2- 172.21.15.8:0/2742810043 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f3a880a1590 0x7f3a880a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:19.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.619+0000 7f3a9cff9700 1 -- 172.21.15.8:0/2742810043 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f3a980cdef0 con 0x7f3aa01097a0 2023-12-17T12:03:19.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.619+0000 7f3a9f7fe700 1 --2- 172.21.15.8:0/2742810043 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f3a880a1590 0x7f3a880a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:19.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.619+0000 7f3a9cff9700 1 --2- 172.21.15.8:0/2742810043 >> [v2:172.21.15.100:6816/1631494583,v1:172.21.15.100:6817/1631494583] conn(0x7f3a880aad70 0x7f3a880ad190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:19.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.619+0000 7f3a9cff9700 1 -- 172.21.15.8:0/2742810043 --> [v2:172.21.15.100:6816/1631494583,v1:172.21.15.100:6817/1631494583] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3a880ad840 con 0x7f3a880aad70 2023-12-17T12:03:19.621 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.619+0000 7f3a9cff9700 1 -- 172.21.15.8:0/2742810043 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a980ce390 con 0x7f3aa01097a0 2023-12-17T12:03:19.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.620+0000 7f3a9f7fe700 1 --2- 172.21.15.8:0/2742810043 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f3a880a1590 0x7f3a880a3a50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3a90009be0 tx=0x7f3a90009260 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:19.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.620+0000 7f3a9effd700 1 --2- 172.21.15.8:0/2742810043 >> [v2:172.21.15.100:6816/1631494583,v1:172.21.15.100:6817/1631494583] conn(0x7f3a880aad70 0x7f3a880ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:19.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.621+0000 7f3a9effd700 1 --2- 172.21.15.8:0/2742810043 >> [v2:172.21.15.100:6816/1631494583,v1:172.21.15.100:6817/1631494583] conn(0x7f3a880aad70 0x7f3a880ad190 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:19.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.622+0000 7f3a9cff9700 1 -- 172.21.15.8:0/2742810043 <== osd.7 v2:172.21.15.100:6816/1631494583 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f3a880ad840 con 0x7f3a880aad70 2023-12-17T12:03:19.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.639+0000 7f3aa61b1700 1 -- 172.21.15.8:0/2742810043 --> [v2:172.21.15.100:6816/1631494583,v1:172.21.15.100:6817/1631494583] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3aa0061c50 con 0x7f3a880aad70 2023-12-17T12:03:19.641 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.640+0000 7f3a9cff9700 1 -- 172.21.15.8:0/2742810043 <== osd.7 v2:172.21.15.100:6816/1631494583 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f3aa0061c50 con 0x7f3a880aad70 2023-12-17T12:03:19.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.640+0000 7f3aa61b1700 1 -- 172.21.15.8:0/2742810043 >> [v2:172.21.15.100:6816/1631494583,v1:172.21.15.100:6817/1631494583] conn(0x7f3a880aad70 msgr2=0x7f3a880ad190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:19.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.640+0000 7f3aa61b1700 1 --2- 172.21.15.8:0/2742810043 >> [v2:172.21.15.100:6816/1631494583,v1:172.21.15.100:6817/1631494583] conn(0x7f3a880aad70 0x7f3a880ad190 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:19.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.640+0000 7f3aa61b1700 1 -- 172.21.15.8:0/2742810043 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f3a880a1590 msgr2=0x7f3a880a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:19.642 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.640+0000 7f3aa61b1700 1 --2- 172.21.15.8:0/2742810043 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f3a880a1590 0x7f3a880a3a50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3a90009be0 tx=0x7f3a90009260 comp rx=0 tx=0).stop 2023-12-17T12:03:19.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.640+0000 7f3aa61b1700 1 -- 172.21.15.8:0/2742810043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3aa01097a0 msgr2=0x7f3aa0199a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:19.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.640+0000 7f3aa61b1700 1 --2- 172.21.15.8:0/2742810043 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3aa01097a0 0x7f3aa0199a20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3a9800b070 tx=0x7f3a98007cc0 comp rx=0 tx=0).stop 2023-12-17T12:03:19.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.640+0000 7f3a9ffff700 1 -- 172.21.15.8:0/2742810043 reap_dead start 2023-12-17T12:03:19.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.641+0000 7f3aa61b1700 1 -- 172.21.15.8:0/2742810043 shutdown_connections 2023-12-17T12:03:19.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.641+0000 7f3aa61b1700 1 -- 172.21.15.8:0/2742810043 >> 172.21.15.8:0/2742810043 conn(0x7f3aa00ff290 msgr2=0x7f3aa00ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:19.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.641+0000 7f3aa61b1700 1 -- 172.21.15.8:0/2742810043 shutdown_connections 2023-12-17T12:03:19.643 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:19.641+0000 7f3aa61b1700 1 -- 172.21.15.8:0/2742810043 wait complete. 2023-12-17T12:03:20.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.271+0000 7fdff88b1700 1 -- 172.21.15.8:0/3598019759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdff41076f0 msgr2=0x7fdff4107ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:20.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.271+0000 7fdff88b1700 1 --2- 172.21.15.8:0/3598019759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdff41076f0 0x7fdff4107ad0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fdfe4009990 tx=0x7fdfe4009ca0 comp rx=0 tx=0).stop 2023-12-17T12:03:20.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.271+0000 7fdff88b1700 1 -- 172.21.15.8:0/3598019759 shutdown_connections 2023-12-17T12:03:20.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.271+0000 7fdff88b1700 1 --2- 172.21.15.8:0/3598019759 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdff4102040 0x7fdff410e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:20.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.271+0000 7fdff88b1700 1 --2- 172.21.15.8:0/3598019759 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdff41076f0 0x7fdff4107ad0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:20.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.271+0000 7fdff88b1700 1 --2- 172.21.15.8:0/3598019759 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdff4101680 0x7fdff4101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:20.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.271+0000 7fdff88b1700 1 -- 172.21.15.8:0/3598019759 >> 172.21.15.8:0/3598019759 conn(0x7fdff40787c0 msgr2=0x7fdff4078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:20.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.272+0000 7fdff88b1700 1 -- 172.21.15.8:0/3598019759 shutdown_connections 2023-12-17T12:03:20.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.272+0000 7fdff88b1700 1 -- 172.21.15.8:0/3598019759 wait complete. 2023-12-17T12:03:20.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.273+0000 7fdff88b1700 1 Processor -- start 2023-12-17T12:03:20.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.273+0000 7fdff88b1700 1 -- start start 2023-12-17T12:03:20.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.273+0000 7fdff88b1700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdff4101680 0x7fdff40738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:20.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.273+0000 7fdff88b1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdff4102040 0x7fdff4073e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:20.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.273+0000 7fdff88b1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdff41076f0 0x7fdff4074350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:20.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.273+0000 7fdff88b1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff41a5c80 con 0x7fdff4102040 2023-12-17T12:03:20.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.273+0000 7fdff88b1700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff41a5df0 con 0x7fdff41076f0 2023-12-17T12:03:20.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.273+0000 7fdff88b1700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdff41a5fb0 con 0x7fdff4101680 2023-12-17T12:03:20.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.274+0000 7fdff1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdff4102040 0x7fdff4073e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:20.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.274+0000 7fdff259c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdff4101680 0x7fdff40738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:20.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.274+0000 7fdff2d9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdff41076f0 0x7fdff4074350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:20.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.274+0000 7fdff1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdff4102040 0x7fdff4073e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:35294/0 (socket says 172.21.15.8:35294) 2023-12-17T12:03:20.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.274+0000 7fdff1d9b700 1 -- 172.21.15.8:0/4142949017 learned_addr learned my addr 172.21.15.8:0/4142949017 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:20.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.274+0000 7fdff1d9b700 1 -- 172.21.15.8:0/4142949017 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdff4101680 msgr2=0x7fdff40738d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:20.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.274+0000 7fdff1d9b700 1 --2- 172.21.15.8:0/4142949017 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdff4101680 0x7fdff40738d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:20.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.274+0000 7fdff1d9b700 1 -- 172.21.15.8:0/4142949017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdff41076f0 msgr2=0x7fdff4074350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:20.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.274+0000 7fdff1d9b700 1 --2- 172.21.15.8:0/4142949017 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fdff41076f0 0x7fdff4074350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:20.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.274+0000 7fdff1d9b700 1 -- 172.21.15.8:0/4142949017 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfe40095f0 con 0x7fdff4102040 2023-12-17T12:03:20.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.274+0000 7fdff1d9b700 1 --2- 172.21.15.8:0/4142949017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdff4102040 0x7fdff4073e10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800b530 tx=0x7fdfe800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:20.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.275+0000 7fdfe37fe700 1 -- 172.21.15.8:0/4142949017 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe8011830 con 0x7fdff4102040 2023-12-17T12:03:20.277 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.275+0000 7fdfe37fe700 1 -- 172.21.15.8:0/4142949017 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdfe8011e20 con 0x7fdff4102040 2023-12-17T12:03:20.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.275+0000 7fdff88b1700 1 -- 172.21.15.8:0/4142949017 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdff41a6290 con 0x7fdff4102040 2023-12-17T12:03:20.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.275+0000 7fdfe37fe700 1 -- 172.21.15.8:0/4142949017 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfe8010db0 con 0x7fdff4102040 2023-12-17T12:03:20.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.275+0000 7fdff88b1700 1 -- 172.21.15.8:0/4142949017 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdff41a6790 con 0x7fdff4102040 2023-12-17T12:03:20.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.276+0000 7fdff88b1700 1 -- 172.21.15.8:0/4142949017 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdff4111710 con 0x7fdff4102040 2023-12-17T12:03:20.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.278+0000 7fdfe37fe700 1 -- 172.21.15.8:0/4142949017 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7fdfe8011990 con 0x7fdff4102040 2023-12-17T12:03:20.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.279+0000 7fdfe37fe700 1 --2- 172.21.15.8:0/4142949017 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fdfdc0a1510 0x7fdfdc0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:20.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.279+0000 7fdfe37fe700 1 -- 172.21.15.8:0/4142949017 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fdfe80cc5a0 con 0x7fdff4102040 2023-12-17T12:03:20.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.279+0000 7fdff259c700 1 --2- 172.21.15.8:0/4142949017 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fdfdc0a1510 0x7fdfdc0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:20.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.280+0000 7fdfe37fe700 1 --2- 172.21.15.8:0/4142949017 >> [v2:172.21.15.186:6824/3779371472,v1:172.21.15.186:6825/3779371472] conn(0x7fdfdc0aacf0 0x7fdfdc0ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:20.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.280+0000 7fdfe37fe700 1 -- 172.21.15.8:0/4142949017 --> [v2:172.21.15.186:6824/3779371472,v1:172.21.15.186:6825/3779371472] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdfdc0ad7c0 con 0x7fdfdc0aacf0 2023-12-17T12:03:20.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.280+0000 7fdfe37fe700 1 -- 172.21.15.8:0/4142949017 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdfe80cecb0 con 0x7fdff4102040 2023-12-17T12:03:20.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.280+0000 7fdff259c700 1 --2- 172.21.15.8:0/4142949017 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fdfdc0a1510 0x7fdfdc0a39d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdfe400b5c0 tx=0x7fdfe4005c40 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:20.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.280+0000 7fdff2d9d700 1 --2- 172.21.15.8:0/4142949017 >> [v2:172.21.15.186:6824/3779371472,v1:172.21.15.186:6825/3779371472] conn(0x7fdfdc0aacf0 0x7fdfdc0ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:20.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.281+0000 7fdff2d9d700 1 --2- 172.21.15.8:0/4142949017 >> [v2:172.21.15.186:6824/3779371472,v1:172.21.15.186:6825/3779371472] conn(0x7fdfdc0aacf0 0x7fdfdc0ad110 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:20.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.282+0000 7fdfe37fe700 1 -- 172.21.15.8:0/4142949017 <== osd.11 v2:172.21.15.186:6824/3779371472 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fdfdc0ad7c0 con 0x7fdfdc0aacf0 2023-12-17T12:03:20.303 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.302+0000 7fdff88b1700 1 -- 172.21.15.8:0/4142949017 --> [v2:172.21.15.186:6824/3779371472,v1:172.21.15.186:6825/3779371472] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdff4061cd0 con 0x7fdfdc0aacf0 2023-12-17T12:03:20.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.302+0000 7fdfe37fe700 1 -- 172.21.15.8:0/4142949017 <== osd.11 v2:172.21.15.186:6824/3779371472 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fdff4061cd0 con 0x7fdfdc0aacf0 2023-12-17T12:03:20.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.303+0000 7fdff88b1700 1 -- 172.21.15.8:0/4142949017 >> [v2:172.21.15.186:6824/3779371472,v1:172.21.15.186:6825/3779371472] conn(0x7fdfdc0aacf0 msgr2=0x7fdfdc0ad110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:20.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.303+0000 7fdff88b1700 1 --2- 172.21.15.8:0/4142949017 >> [v2:172.21.15.186:6824/3779371472,v1:172.21.15.186:6825/3779371472] conn(0x7fdfdc0aacf0 0x7fdfdc0ad110 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:20.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.303+0000 7fdff88b1700 1 -- 172.21.15.8:0/4142949017 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fdfdc0a1510 msgr2=0x7fdfdc0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:20.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.303+0000 7fdff88b1700 1 --2- 172.21.15.8:0/4142949017 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fdfdc0a1510 0x7fdfdc0a39d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdfe400b5c0 tx=0x7fdfe4005c40 comp rx=0 tx=0).stop 2023-12-17T12:03:20.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.303+0000 7fdff88b1700 1 -- 172.21.15.8:0/4142949017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdff4102040 msgr2=0x7fdff4073e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:20.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.303+0000 7fdff88b1700 1 --2- 172.21.15.8:0/4142949017 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fdff4102040 0x7fdff4073e10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fdfe800b530 tx=0x7fdfe800b840 comp rx=0 tx=0).stop 2023-12-17T12:03:20.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.303+0000 7fdff2d9d700 1 -- 172.21.15.8:0/4142949017 reap_dead start 2023-12-17T12:03:20.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.303+0000 7fdff88b1700 1 -- 172.21.15.8:0/4142949017 shutdown_connections 2023-12-17T12:03:20.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.303+0000 7fdff88b1700 1 -- 172.21.15.8:0/4142949017 >> 172.21.15.8:0/4142949017 conn(0x7fdff40787c0 msgr2=0x7fdff4100350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:20.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.303+0000 7fdff88b1700 1 -- 172.21.15.8:0/4142949017 shutdown_connections 2023-12-17T12:03:20.305 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:20.303+0000 7fdff88b1700 1 -- 172.21.15.8:0/4142949017 wait complete. 2023-12-17T12:03:20.517 INFO:teuthology.orchestra.run.smithi008.stdout:55834574910 2023-12-17T12:03:20.518 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.1 2023-12-17T12:03:20.587 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:20 smithi008 ceph-mon[36830]: pgmap v279: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 853 B/s wr, 9 op/s 2023-12-17T12:03:20.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:20 smithi100 ceph-mon[41266]: pgmap v279: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 853 B/s wr, 9 op/s 2023-12-17T12:03:20.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:20 smithi186 ceph-mon[41182]: pgmap v279: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 853 B/s wr, 9 op/s 2023-12-17T12:03:21.136 INFO:teuthology.orchestra.run.smithi008.stdout:335007449106 2023-12-17T12:03:21.137 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.11 2023-12-17T12:03:22.139 INFO:teuthology.orchestra.run.smithi008.stdout:77309411387 2023-12-17T12:03:22.140 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.2 2023-12-17T12:03:22.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.213+0000 7f2b20c57700 1 -- 172.21.15.8:0/1873236504 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b1c1076f0 msgr2=0x7f2b1c107ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:22.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.213+0000 7f2b20c57700 1 --2- 172.21.15.8:0/1873236504 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b1c1076f0 0x7f2b1c107ad0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c009990 tx=0x7f2b0c009ca0 comp rx=0 tx=0).stop 2023-12-17T12:03:22.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.213+0000 7f2b20c57700 1 -- 172.21.15.8:0/1873236504 shutdown_connections 2023-12-17T12:03:22.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.213+0000 7f2b20c57700 1 --2- 172.21.15.8:0/1873236504 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b1c102040 0x7f2b1c10e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:22.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.213+0000 7f2b20c57700 1 --2- 172.21.15.8:0/1873236504 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b1c1076f0 0x7f2b1c107ad0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:22.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.213+0000 7f2b20c57700 1 --2- 172.21.15.8:0/1873236504 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b1c101680 0x7f2b1c101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:22.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.213+0000 7f2b20c57700 1 -- 172.21.15.8:0/1873236504 >> 172.21.15.8:0/1873236504 conn(0x7f2b1c0787c0 msgr2=0x7f2b1c078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:22.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.213+0000 7f2b20c57700 1 -- 172.21.15.8:0/1873236504 shutdown_connections 2023-12-17T12:03:22.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.213+0000 7f2b20c57700 1 -- 172.21.15.8:0/1873236504 wait complete. 2023-12-17T12:03:22.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.215+0000 7f2b20c57700 1 Processor -- start 2023-12-17T12:03:22.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.215+0000 7f2b20c57700 1 -- start start 2023-12-17T12:03:22.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.216+0000 7f2b20c57700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b1c101680 0x7f2b1c195720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:22.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.216+0000 7f2b20c57700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b1c102040 0x7f2b1c195c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:22.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.216+0000 7f2b20c57700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b1c1076f0 0x7f2b1c19a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:22.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.216+0000 7f2b20c57700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c19a620 con 0x7f2b1c1076f0 2023-12-17T12:03:22.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.216+0000 7f2b20c57700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c19a790 con 0x7f2b1c102040 2023-12-17T12:03:22.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.216+0000 7f2b20c57700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c19a950 con 0x7f2b1c101680 2023-12-17T12:03:22.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.216+0000 7f2b1a59c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b1c101680 0x7f2b1c195720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:22.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.216+0000 7f2b1a59c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b1c101680 0x7f2b1c195720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:59336/0 (socket says 172.21.15.8:59336) 2023-12-17T12:03:22.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.216+0000 7f2b1a59c700 1 -- 172.21.15.8:0/3904850740 learned_addr learned my addr 172.21.15.8:0/3904850740 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:22.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.216+0000 7f2b1ad9d700 1 --2- 172.21.15.8:0/3904850740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b1c1076f0 0x7f2b1c19a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:22.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.216+0000 7f2b19d9b700 1 --2- 172.21.15.8:0/3904850740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b1c102040 0x7f2b1c195c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:22.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.217+0000 7f2b1a59c700 1 -- 172.21.15.8:0/3904850740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b1c102040 msgr2=0x7f2b1c195c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:22.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.217+0000 7f2b1a59c700 1 --2- 172.21.15.8:0/3904850740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b1c102040 0x7f2b1c195c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:22.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.217+0000 7f2b1a59c700 1 -- 172.21.15.8:0/3904850740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b1c1076f0 msgr2=0x7f2b1c19a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:22.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.217+0000 7f2b1a59c700 1 --2- 172.21.15.8:0/3904850740 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f2b1c1076f0 0x7f2b1c19a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:22.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.217+0000 7f2b1a59c700 1 -- 172.21.15.8:0/3904850740 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b1000f790 con 0x7f2b1c101680 2023-12-17T12:03:22.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.217+0000 7f2b19d9b700 1 --2- 172.21.15.8:0/3904850740 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f2b1c102040 0x7f2b1c195c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T12:03:22.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.217+0000 7f2b1a59c700 1 --2- 172.21.15.8:0/3904850740 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b1c101680 0x7f2b1c195720 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c006010 tx=0x7f2b0c003920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:22.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.218+0000 7f2b0b7fe700 1 -- 172.21.15.8:0/3904850740 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c01d070 con 0x7f2b1c101680 2023-12-17T12:03:22.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.218+0000 7f2b0b7fe700 1 -- 172.21.15.8:0/3904850740 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b0c00bcb0 con 0x7f2b1c101680 2023-12-17T12:03:22.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.218+0000 7f2b0b7fe700 1 -- 172.21.15.8:0/3904850740 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b0c022ca0 con 0x7f2b1c101680 2023-12-17T12:03:22.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.218+0000 7f2b20c57700 1 -- 172.21.15.8:0/3904850740 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b0c0095f0 con 0x7f2b1c101680 2023-12-17T12:03:22.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.218+0000 7f2b20c57700 1 -- 172.21.15.8:0/3904850740 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b1c19ae00 con 0x7f2b1c101680 2023-12-17T12:03:22.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.219+0000 7f2b20c57700 1 -- 172.21.15.8:0/3904850740 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2b1c10f4d0 con 0x7f2b1c101680 2023-12-17T12:03:22.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.221+0000 7f2b0b7fe700 1 -- 172.21.15.8:0/3904850740 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f2b0c022470 con 0x7f2b1c101680 2023-12-17T12:03:22.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.224+0000 7f2b0b7fe700 1 --2- 172.21.15.8:0/3904850740 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f2b040a1590 0x7f2b040a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:22.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.224+0000 7f2b0b7fe700 1 -- 172.21.15.8:0/3904850740 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f2b0c0ced00 con 0x7f2b1c101680 2023-12-17T12:03:22.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.224+0000 7f2b19d9b700 1 --2- 172.21.15.8:0/3904850740 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f2b040a1590 0x7f2b040a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:22.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.224+0000 7f2b0b7fe700 1 --2- 172.21.15.8:0/3904850740 >> [v2:172.21.15.8:6802/297519189,v1:172.21.15.8:6803/297519189] conn(0x7f2b040aad70 0x7f2b040ad190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:22.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.225+0000 7f2b0b7fe700 1 -- 172.21.15.8:0/3904850740 --> [v2:172.21.15.8:6802/297519189,v1:172.21.15.8:6803/297519189] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2b040ad840 con 0x7f2b040aad70 2023-12-17T12:03:22.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.225+0000 7f2b0b7fe700 1 -- 172.21.15.8:0/3904850740 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2b0c0cf070 con 0x7f2b1c101680 2023-12-17T12:03:22.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.225+0000 7f2b1ad9d700 1 --2- 172.21.15.8:0/3904850740 >> [v2:172.21.15.8:6802/297519189,v1:172.21.15.8:6803/297519189] conn(0x7f2b040aad70 0x7f2b040ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:22.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.225+0000 7f2b19d9b700 1 --2- 172.21.15.8:0/3904850740 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f2b040a1590 0x7f2b040a3a50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c196c80 tx=0x7f2b10011040 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:22.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.225+0000 7f2b1ad9d700 1 --2- 172.21.15.8:0/3904850740 >> [v2:172.21.15.8:6802/297519189,v1:172.21.15.8:6803/297519189] conn(0x7f2b040aad70 0x7f2b040ad190 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:22.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.226+0000 7f2b0b7fe700 1 -- 172.21.15.8:0/3904850740 <== osd.0 v2:172.21.15.8:6802/297519189 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f2b040ad840 con 0x7f2b040aad70 2023-12-17T12:03:22.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.253+0000 7f2b20c57700 1 -- 172.21.15.8:0/3904850740 --> [v2:172.21.15.8:6802/297519189,v1:172.21.15.8:6803/297519189] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2b1c102d10 con 0x7f2b040aad70 2023-12-17T12:03:22.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.254+0000 7f2b0b7fe700 1 -- 172.21.15.8:0/3904850740 <== osd.0 v2:172.21.15.8:6802/297519189 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2b1c102d10 con 0x7f2b040aad70 2023-12-17T12:03:22.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.255+0000 7f2b20c57700 1 -- 172.21.15.8:0/3904850740 >> [v2:172.21.15.8:6802/297519189,v1:172.21.15.8:6803/297519189] conn(0x7f2b040aad70 msgr2=0x7f2b040ad190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:22.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.255+0000 7f2b20c57700 1 --2- 172.21.15.8:0/3904850740 >> [v2:172.21.15.8:6802/297519189,v1:172.21.15.8:6803/297519189] conn(0x7f2b040aad70 0x7f2b040ad190 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:22.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.255+0000 7f2b20c57700 1 -- 172.21.15.8:0/3904850740 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f2b040a1590 msgr2=0x7f2b040a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:22.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.255+0000 7f2b20c57700 1 --2- 172.21.15.8:0/3904850740 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f2b040a1590 0x7f2b040a3a50 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c196c80 tx=0x7f2b10011040 comp rx=0 tx=0).stop 2023-12-17T12:03:22.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.255+0000 7f2b20c57700 1 -- 172.21.15.8:0/3904850740 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b1c101680 msgr2=0x7f2b1c195720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:22.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.255+0000 7f2b20c57700 1 --2- 172.21.15.8:0/3904850740 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2b1c101680 0x7f2b1c195720 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2b0c006010 tx=0x7f2b0c003920 comp rx=0 tx=0).stop 2023-12-17T12:03:22.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.256+0000 7f2b1ad9d700 1 -- 172.21.15.8:0/3904850740 reap_dead start 2023-12-17T12:03:22.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.256+0000 7f2b20c57700 1 -- 172.21.15.8:0/3904850740 shutdown_connections 2023-12-17T12:03:22.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.256+0000 7f2b20c57700 1 -- 172.21.15.8:0/3904850740 >> 172.21.15.8:0/3904850740 conn(0x7f2b1c0787c0 msgr2=0x7f2b1c100530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:22.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.257+0000 7f2b20c57700 1 -- 172.21.15.8:0/3904850740 shutdown_connections 2023-12-17T12:03:22.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.257+0000 7f2b20c57700 1 -- 172.21.15.8:0/3904850740 wait complete. 2023-12-17T12:03:22.309 INFO:teuthology.orchestra.run.smithi008.stdout:214748364835 2023-12-17T12:03:22.309 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.7 2023-12-17T12:03:22.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.907+0000 7f4237ce1700 1 -- 172.21.15.8:0/3463760768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4230104130 msgr2=0x7f4230110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:22.504 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.907+0000 7f4237ce1700 1 --2- 172.21.15.8:0/3463760768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4230104130 0x7f4230110640 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f422800b0a0 tx=0x7f422800b3b0 comp rx=0 tx=0).stop 2023-12-17T12:03:22.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.907+0000 7f4237ce1700 1 -- 172.21.15.8:0/3463760768 shutdown_connections 2023-12-17T12:03:22.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.907+0000 7f4237ce1700 1 --2- 172.21.15.8:0/3463760768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4230104130 0x7f4230110640 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:22.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.907+0000 7f4237ce1700 1 --2- 172.21.15.8:0/3463760768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4230109770 0x7f4230109b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:22.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.907+0000 7f4237ce1700 1 --2- 172.21.15.8:0/3463760768 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4230103770 0x7f4230103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:22.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.907+0000 7f4237ce1700 1 -- 172.21.15.8:0/3463760768 >> 172.21.15.8:0/3463760768 conn(0x7f42300ff240 msgr2=0x7f4230101660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:22.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.907+0000 7f4237ce1700 1 -- 172.21.15.8:0/3463760768 shutdown_connections 2023-12-17T12:03:22.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.907+0000 7f4237ce1700 1 -- 172.21.15.8:0/3463760768 wait complete. 2023-12-17T12:03:22.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.908+0000 7f4237ce1700 1 Processor -- start 2023-12-17T12:03:22.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.908+0000 7f4237ce1700 1 -- start start 2023-12-17T12:03:22.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.908+0000 7f4237ce1700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4230103770 0x7f423019f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:22.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.908+0000 7f4237ce1700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4230104130 0x7f423019fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:22.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.909+0000 7f4237ce1700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4230109770 0x7f4230199aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:22.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.909+0000 7f4237ce1700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423019a100 con 0x7f4230104130 2023-12-17T12:03:22.505 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.909+0000 7f4237ce1700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423019a270 con 0x7f4230103770 2023-12-17T12:03:22.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.909+0000 7f4237ce1700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423019a430 con 0x7f4230109770 2023-12-17T12:03:22.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.909+0000 7f423527c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4230104130 0x7f423019fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:22.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.909+0000 7f423527c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4230104130 0x7f423019fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36112/0 (socket says 172.21.15.8:36112) 2023-12-17T12:03:22.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.909+0000 7f423527c700 1 -- 172.21.15.8:0/2289890079 learned_addr learned my addr 172.21.15.8:0/2289890079 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:22.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.909+0000 7f4235a7d700 1 --2- 172.21.15.8:0/2289890079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4230103770 0x7f423019f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:22.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.909+0000 7f423627e700 1 --2- 172.21.15.8:0/2289890079 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4230109770 0x7f4230199aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:22.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.909+0000 7f423527c700 1 -- 172.21.15.8:0/2289890079 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4230109770 msgr2=0x7f4230199aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:22.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.909+0000 7f423527c700 1 --2- 172.21.15.8:0/2289890079 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4230109770 0x7f4230199aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:22.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.909+0000 7f423527c700 1 -- 172.21.15.8:0/2289890079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4230103770 msgr2=0x7f423019f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:22.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.909+0000 7f423527c700 1 --2- 172.21.15.8:0/2289890079 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4230103770 0x7f423019f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:22.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.909+0000 7f423527c700 1 -- 172.21.15.8:0/2289890079 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4228009d00 con 0x7f4230104130 2023-12-17T12:03:22.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.909+0000 7f423527c700 1 --2- 172.21.15.8:0/2289890079 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4230104130 0x7f423019fea0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f422000d950 tx=0x7f422000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:22.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.910+0000 7f4226ffd700 1 -- 172.21.15.8:0/2289890079 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422000f890 con 0x7f4230104130 2023-12-17T12:03:22.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.910+0000 7f4226ffd700 1 -- 172.21.15.8:0/2289890079 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f422000fe80 con 0x7f4230104130 2023-12-17T12:03:22.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.910+0000 7f4226ffd700 1 -- 172.21.15.8:0/2289890079 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422000e3b0 con 0x7f4230104130 2023-12-17T12:03:22.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.910+0000 7f4237ce1700 1 -- 172.21.15.8:0/2289890079 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f423019a710 con 0x7f4230104130 2023-12-17T12:03:22.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.910+0000 7f4237ce1700 1 -- 172.21.15.8:0/2289890079 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42301a6950 con 0x7f4230104130 2023-12-17T12:03:22.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.911+0000 7f4237ce1700 1 -- 172.21.15.8:0/2289890079 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f42301138e0 con 0x7f4230104130 2023-12-17T12:03:22.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.913+0000 7f4226ffd700 1 -- 172.21.15.8:0/2289890079 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f4220010460 con 0x7f4230104130 2023-12-17T12:03:22.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.914+0000 7f4226ffd700 1 --2- 172.21.15.8:0/2289890079 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f421c0a1590 0x7f421c0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:22.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.914+0000 7f4226ffd700 1 -- 172.21.15.8:0/2289890079 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f42200ccb50 con 0x7f4230104130 2023-12-17T12:03:22.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.914+0000 7f4235a7d700 1 --2- 172.21.15.8:0/2289890079 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f421c0a1590 0x7f421c0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:22.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.914+0000 7f4226ffd700 1 --2- 172.21.15.8:0/2289890079 >> [v2:172.21.15.8:6810/1141622701,v1:172.21.15.8:6811/1141622701] conn(0x7f421c0aad70 0x7f421c0ad190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:22.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.914+0000 7f4226ffd700 1 -- 172.21.15.8:0/2289890079 --> [v2:172.21.15.8:6810/1141622701,v1:172.21.15.8:6811/1141622701] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f421c0ad840 con 0x7f421c0aad70 2023-12-17T12:03:22.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.914+0000 7f4226ffd700 1 -- 172.21.15.8:0/2289890079 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42200ccff0 con 0x7f4230104130 2023-12-17T12:03:22.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.915+0000 7f423627e700 1 --2- 172.21.15.8:0/2289890079 >> [v2:172.21.15.8:6810/1141622701,v1:172.21.15.8:6811/1141622701] conn(0x7f421c0aad70 0x7f421c0ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:22.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.915+0000 7f4235a7d700 1 --2- 172.21.15.8:0/2289890079 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f421c0a1590 0x7f421c0a3a50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f422c005950 tx=0x7f422c00b410 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:22.507 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.915+0000 7f423627e700 1 --2- 172.21.15.8:0/2289890079 >> [v2:172.21.15.8:6810/1141622701,v1:172.21.15.8:6811/1141622701] conn(0x7f421c0aad70 0x7f421c0ad190 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:22.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.916+0000 7f4226ffd700 1 -- 172.21.15.8:0/2289890079 <== osd.3 v2:172.21.15.8:6810/1141622701 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f421c0ad840 con 0x7f421c0aad70 2023-12-17T12:03:22.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.934+0000 7f4237ce1700 1 -- 172.21.15.8:0/2289890079 --> [v2:172.21.15.8:6810/1141622701,v1:172.21.15.8:6811/1141622701] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4230061cd0 con 0x7f421c0aad70 2023-12-17T12:03:22.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.934+0000 7f4226ffd700 1 -- 172.21.15.8:0/2289890079 <== osd.3 v2:172.21.15.8:6810/1141622701 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f4230061cd0 con 0x7f421c0aad70 2023-12-17T12:03:22.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.935+0000 7f4237ce1700 1 -- 172.21.15.8:0/2289890079 >> [v2:172.21.15.8:6810/1141622701,v1:172.21.15.8:6811/1141622701] conn(0x7f421c0aad70 msgr2=0x7f421c0ad190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:22.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.935+0000 7f4237ce1700 1 --2- 172.21.15.8:0/2289890079 >> [v2:172.21.15.8:6810/1141622701,v1:172.21.15.8:6811/1141622701] conn(0x7f421c0aad70 0x7f421c0ad190 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:22.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.935+0000 7f4237ce1700 1 -- 172.21.15.8:0/2289890079 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f421c0a1590 msgr2=0x7f421c0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:22.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.935+0000 7f4237ce1700 1 --2- 172.21.15.8:0/2289890079 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f421c0a1590 0x7f421c0a3a50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f422c005950 tx=0x7f422c00b410 comp rx=0 tx=0).stop 2023-12-17T12:03:22.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.935+0000 7f4237ce1700 1 -- 172.21.15.8:0/2289890079 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4230104130 msgr2=0x7f423019fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:22.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.935+0000 7f4237ce1700 1 --2- 172.21.15.8:0/2289890079 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4230104130 0x7f423019fea0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f422000d950 tx=0x7f422000dc60 comp rx=0 tx=0).stop 2023-12-17T12:03:22.508 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.935+0000 7f423627e700 1 -- 172.21.15.8:0/2289890079 reap_dead start 2023-12-17T12:03:22.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.935+0000 7f4237ce1700 1 -- 172.21.15.8:0/2289890079 shutdown_connections 2023-12-17T12:03:22.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.935+0000 7f4237ce1700 1 -- 172.21.15.8:0/2289890079 >> 172.21.15.8:0/2289890079 conn(0x7f42300ff240 msgr2=0x7f42300ffab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:22.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.935+0000 7f4237ce1700 1 -- 172.21.15.8:0/2289890079 shutdown_connections 2023-12-17T12:03:22.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:21.935+0000 7f4237ce1700 1 -- 172.21.15.8:0/2289890079 wait complete. 2023-12-17T12:03:22.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.531+0000 7fa38c929700 1 -- 172.21.15.8:0/2357691695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa388075550 msgr2=0x7fa388073800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:22.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.531+0000 7fa38c929700 1 --2- 172.21.15.8:0/2357691695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa388075550 0x7fa388073800 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa378009990 tx=0x7fa378009ca0 comp rx=0 tx=0).stop 2023-12-17T12:03:22.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.531+0000 7fa38c929700 1 -- 172.21.15.8:0/2357691695 shutdown_connections 2023-12-17T12:03:22.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.531+0000 7fa38c929700 1 --2- 172.21.15.8:0/2357691695 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa388112350 0x7fa388114780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:22.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.531+0000 7fa38c929700 1 --2- 172.21.15.8:0/2357691695 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa388075550 0x7fa388073800 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:22.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.531+0000 7fa38c929700 1 --2- 172.21.15.8:0/2357691695 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa388073d40 0x7fa3880741c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:22.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.531+0000 7fa38c929700 1 -- 172.21.15.8:0/2357691695 >> 172.21.15.8:0/2357691695 conn(0x7fa3880787c0 msgr2=0x7fa388078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:22.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.531+0000 7fa38c929700 1 -- 172.21.15.8:0/2357691695 shutdown_connections 2023-12-17T12:03:22.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.531+0000 7fa38c929700 1 -- 172.21.15.8:0/2357691695 wait complete. 2023-12-17T12:03:22.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.532+0000 7fa38c929700 1 Processor -- start 2023-12-17T12:03:22.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.533+0000 7fa38c929700 1 -- start start 2023-12-17T12:03:22.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.533+0000 7fa38c929700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa388073d40 0x7fa38819e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:22.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.533+0000 7fa38c929700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa388075550 0x7fa38819e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:22.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.533+0000 7fa38c929700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa388112350 0x7fa3881a2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:22.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.533+0000 7fa38c929700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3881a2f60 con 0x7fa388112350 2023-12-17T12:03:22.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.533+0000 7fa38c929700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3881a30d0 con 0x7fa388073d40 2023-12-17T12:03:22.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.533+0000 7fa38c929700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3881a3290 con 0x7fa388075550 2023-12-17T12:03:22.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.533+0000 7fa385d9b700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa388075550 0x7fa38819e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:22.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.533+0000 7fa386d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa388112350 0x7fa3881a2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:22.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.533+0000 7fa385d9b700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa388075550 0x7fa38819e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:59348/0 (socket says 172.21.15.8:59348) 2023-12-17T12:03:22.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.534+0000 7fa385d9b700 1 -- 172.21.15.8:0/699689626 learned_addr learned my addr 172.21.15.8:0/699689626 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:22.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.534+0000 7fa38659c700 1 --2- 172.21.15.8:0/699689626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa388073d40 0x7fa38819e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:22.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.534+0000 7fa386d9d700 1 -- 172.21.15.8:0/699689626 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa388075550 msgr2=0x7fa38819e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:22.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.534+0000 7fa386d9d700 1 --2- 172.21.15.8:0/699689626 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa388075550 0x7fa38819e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:22.536 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.534+0000 7fa386d9d700 1 -- 172.21.15.8:0/699689626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa388073d40 msgr2=0x7fa38819e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:22.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.534+0000 7fa386d9d700 1 --2- 172.21.15.8:0/699689626 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa388073d40 0x7fa38819e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:22.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.534+0000 7fa386d9d700 1 -- 172.21.15.8:0/699689626 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3780095f0 con 0x7fa388112350 2023-12-17T12:03:22.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.534+0000 7fa385d9b700 1 --2- 172.21.15.8:0/699689626 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa388075550 0x7fa38819e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T12:03:22.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.534+0000 7fa386d9d700 1 --2- 172.21.15.8:0/699689626 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa388112350 0x7fa3881a2950 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa38000ef90 tx=0x7fa38000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:22.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.534+0000 7fa3777fe700 1 -- 172.21.15.8:0/699689626 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa380018070 con 0x7fa388112350 2023-12-17T12:03:22.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.534+0000 7fa38c929700 1 -- 172.21.15.8:0/699689626 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3881a3510 con 0x7fa388112350 2023-12-17T12:03:22.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.534+0000 7fa3777fe700 1 -- 172.21.15.8:0/699689626 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa38000f040 con 0x7fa388112350 2023-12-17T12:03:22.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.534+0000 7fa3777fe700 1 -- 172.21.15.8:0/699689626 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38000cb70 con 0x7fa388112350 2023-12-17T12:03:22.537 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.535+0000 7fa38c929700 1 -- 172.21.15.8:0/699689626 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3881aadd0 con 0x7fa388112350 2023-12-17T12:03:22.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.536+0000 7fa38c929700 1 -- 172.21.15.8:0/699689626 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa388117dd0 con 0x7fa388112350 2023-12-17T12:03:22.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.537+0000 7fa3777fe700 1 -- 172.21.15.8:0/699689626 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7fa380003a00 con 0x7fa388112350 2023-12-17T12:03:22.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.539+0000 7fa3777fe700 1 --2- 172.21.15.8:0/699689626 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fa3700a1510 0x7fa3700a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:22.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.539+0000 7fa3777fe700 1 -- 172.21.15.8:0/699689626 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa3800cc850 con 0x7fa388112350 2023-12-17T12:03:22.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.539+0000 7fa38659c700 1 --2- 172.21.15.8:0/699689626 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fa3700a1510 0x7fa3700a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:22.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.539+0000 7fa3777fe700 1 --2- 172.21.15.8:0/699689626 >> [v2:172.21.15.8:6826/3980647643,v1:172.21.15.8:6827/3980647643] conn(0x7fa3700aacf0 0x7fa3700ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:22.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.539+0000 7fa3777fe700 1 -- 172.21.15.8:0/699689626 --> [v2:172.21.15.8:6826/3980647643,v1:172.21.15.8:6827/3980647643] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa3700ad7c0 con 0x7fa3700aacf0 2023-12-17T12:03:22.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.539+0000 7fa3777fe700 1 -- 172.21.15.8:0/699689626 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3800cee30 con 0x7fa388112350 2023-12-17T12:03:22.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.539+0000 7fa385d9b700 1 --2- 172.21.15.8:0/699689626 >> [v2:172.21.15.8:6826/3980647643,v1:172.21.15.8:6827/3980647643] conn(0x7fa3700aacf0 0x7fa3700ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:22.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.540+0000 7fa38659c700 1 --2- 172.21.15.8:0/699689626 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fa3700a1510 0x7fa3700a39d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa378006010 tx=0x7fa37800b260 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:22.541 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.540+0000 7fa385d9b700 1 --2- 172.21.15.8:0/699689626 >> [v2:172.21.15.8:6826/3980647643,v1:172.21.15.8:6827/3980647643] conn(0x7fa3700aacf0 0x7fa3700ad110 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:22.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.541+0000 7fa3777fe700 1 -- 172.21.15.8:0/699689626 <== osd.9 v2:172.21.15.8:6826/3980647643 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fa3700ad7c0 con 0x7fa3700aacf0 2023-12-17T12:03:22.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.559+0000 7fa38c929700 1 -- 172.21.15.8:0/699689626 --> [v2:172.21.15.8:6826/3980647643,v1:172.21.15.8:6827/3980647643] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa388074e90 con 0x7fa3700aacf0 2023-12-17T12:03:22.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.559+0000 7fa3777fe700 1 -- 172.21.15.8:0/699689626 <== osd.9 v2:172.21.15.8:6826/3980647643 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fa388074e90 con 0x7fa3700aacf0 2023-12-17T12:03:22.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.559+0000 7fa38c929700 1 -- 172.21.15.8:0/699689626 >> [v2:172.21.15.8:6826/3980647643,v1:172.21.15.8:6827/3980647643] conn(0x7fa3700aacf0 msgr2=0x7fa3700ad110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:22.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.559+0000 7fa38c929700 1 --2- 172.21.15.8:0/699689626 >> [v2:172.21.15.8:6826/3980647643,v1:172.21.15.8:6827/3980647643] conn(0x7fa3700aacf0 0x7fa3700ad110 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:22.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.560+0000 7fa38c929700 1 -- 172.21.15.8:0/699689626 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fa3700a1510 msgr2=0x7fa3700a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:22.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.560+0000 7fa38c929700 1 --2- 172.21.15.8:0/699689626 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fa3700a1510 0x7fa3700a39d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa378006010 tx=0x7fa37800b260 comp rx=0 tx=0).stop 2023-12-17T12:03:22.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.560+0000 7fa38c929700 1 -- 172.21.15.8:0/699689626 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa388112350 msgr2=0x7fa3881a2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:22.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.560+0000 7fa38c929700 1 --2- 172.21.15.8:0/699689626 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa388112350 0x7fa3881a2950 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fa38000ef90 tx=0x7fa38000c3a0 comp rx=0 tx=0).stop 2023-12-17T12:03:22.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.560+0000 7fa386d9d700 1 -- 172.21.15.8:0/699689626 reap_dead start 2023-12-17T12:03:22.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.560+0000 7fa38c929700 1 -- 172.21.15.8:0/699689626 shutdown_connections 2023-12-17T12:03:22.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.560+0000 7fa38c929700 1 -- 172.21.15.8:0/699689626 >> 172.21.15.8:0/699689626 conn(0x7fa3880787c0 msgr2=0x7fa388111080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:22.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.560+0000 7fa38c929700 1 -- 172.21.15.8:0/699689626 shutdown_connections 2023-12-17T12:03:22.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:22.560+0000 7fa38c929700 1 -- 172.21.15.8:0/699689626 wait complete. 2023-12-17T12:03:22.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:22 smithi008 ceph-mon[36830]: pgmap v280: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 10 op/s 2023-12-17T12:03:22.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:22 smithi100 ceph-mon[41266]: pgmap v280: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 10 op/s 2023-12-17T12:03:22.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:22 smithi186 ceph-mon[41182]: pgmap v280: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 853 B/s wr, 10 op/s 2023-12-17T12:03:23.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.290+0000 7feab68fa700 1 -- 172.21.15.8:0/1919022708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feab01076f0 msgr2=0x7feab0107ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:23.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.290+0000 7feab68fa700 1 --2- 172.21.15.8:0/1919022708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feab01076f0 0x7feab0107ad0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7feaa0009990 tx=0x7feaa0009ca0 comp rx=0 tx=0).stop 2023-12-17T12:03:23.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.290+0000 7feab68fa700 1 -- 172.21.15.8:0/1919022708 shutdown_connections 2023-12-17T12:03:23.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.290+0000 7feab68fa700 1 --2- 172.21.15.8:0/1919022708 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feab0102040 0x7feab010e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:23.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.290+0000 7feab68fa700 1 --2- 172.21.15.8:0/1919022708 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feab01076f0 0x7feab0107ad0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:23.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.290+0000 7feab68fa700 1 --2- 172.21.15.8:0/1919022708 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feab0101680 0x7feab0101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:23.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.290+0000 7feab68fa700 1 -- 172.21.15.8:0/1919022708 >> 172.21.15.8:0/1919022708 conn(0x7feab00787c0 msgr2=0x7feab0078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:23.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.290+0000 7feab68fa700 1 -- 172.21.15.8:0/1919022708 shutdown_connections 2023-12-17T12:03:23.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.290+0000 7feab68fa700 1 -- 172.21.15.8:0/1919022708 wait complete. 2023-12-17T12:03:23.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.291+0000 7feab68fa700 1 Processor -- start 2023-12-17T12:03:23.293 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.291+0000 7feab68fa700 1 -- start start 2023-12-17T12:03:23.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.292+0000 7feab68fa700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feab0101680 0x7feab00738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:23.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.292+0000 7feab68fa700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feab0102040 0x7feab0073e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:23.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.292+0000 7feab68fa700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feab01076f0 0x7feab0074350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:23.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.292+0000 7feab68fa700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab0075890 con 0x7feab0101680 2023-12-17T12:03:23.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.292+0000 7feab68fa700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab01aa2d0 con 0x7feab0102040 2023-12-17T12:03:23.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.292+0000 7feab68fa700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab01aa490 con 0x7feab01076f0 2023-12-17T12:03:23.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.292+0000 7feaaffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feab0101680 0x7feab00738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:23.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.292+0000 7feaaffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feab0101680 0x7feab00738d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36158/0 (socket says 172.21.15.8:36158) 2023-12-17T12:03:23.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.292+0000 7feaaffff700 1 -- 172.21.15.8:0/2671137526 learned_addr learned my addr 172.21.15.8:0/2671137526 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:23.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.292+0000 7feaaf7fe700 1 --2- 172.21.15.8:0/2671137526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feab0102040 0x7feab0073e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:23.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.292+0000 7feab4e97700 1 --2- 172.21.15.8:0/2671137526 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feab01076f0 0x7feab0074350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:23.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.292+0000 7feaaffff700 1 -- 172.21.15.8:0/2671137526 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feab01076f0 msgr2=0x7feab0074350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:23.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.292+0000 7feaaffff700 1 --2- 172.21.15.8:0/2671137526 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feab01076f0 0x7feab0074350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:23.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.293+0000 7feaaffff700 1 -- 172.21.15.8:0/2671137526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feab0102040 msgr2=0x7feab0073e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:23.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.293+0000 7feaaffff700 1 --2- 172.21.15.8:0/2671137526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feab0102040 0x7feab0073e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:23.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.293+0000 7feaaffff700 1 -- 172.21.15.8:0/2671137526 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa00095f0 con 0x7feab0101680 2023-12-17T12:03:23.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.293+0000 7feaaf7fe700 1 --2- 172.21.15.8:0/2671137526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feab0102040 0x7feab0073e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T12:03:23.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.293+0000 7feab4e97700 1 --2- 172.21.15.8:0/2671137526 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feab01076f0 0x7feab0074350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T12:03:23.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.293+0000 7feaaffff700 1 --2- 172.21.15.8:0/2671137526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feab0101680 0x7feab00738d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7feaa0004730 tx=0x7feaa0009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:23.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.293+0000 7feaad7fa700 1 -- 172.21.15.8:0/2671137526 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa001d070 con 0x7feab0101680 2023-12-17T12:03:23.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.293+0000 7feab68fa700 1 -- 172.21.15.8:0/2671137526 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feab01aa710 con 0x7feab0101680 2023-12-17T12:03:23.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.293+0000 7feaad7fa700 1 -- 172.21.15.8:0/2671137526 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feaa0022470 con 0x7feab0101680 2023-12-17T12:03:23.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.293+0000 7feaad7fa700 1 -- 172.21.15.8:0/2671137526 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa0017650 con 0x7feab0101680 2023-12-17T12:03:23.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.293+0000 7feab68fa700 1 -- 172.21.15.8:0/2671137526 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab01aab80 con 0x7feab0101680 2023-12-17T12:03:23.296 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.294+0000 7feab68fa700 1 -- 172.21.15.8:0/2671137526 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7feab0111690 con 0x7feab0101680 2023-12-17T12:03:23.297 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.296+0000 7feaad7fa700 1 -- 172.21.15.8:0/2671137526 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7feaa00225e0 con 0x7feab0101680 2023-12-17T12:03:23.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.297+0000 7feaad7fa700 1 --2- 172.21.15.8:0/2671137526 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fea980a1590 0x7fea980a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:23.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.298+0000 7feaad7fa700 1 -- 172.21.15.8:0/2671137526 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7feaa00ceb90 con 0x7feab0101680 2023-12-17T12:03:23.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.298+0000 7feaaf7fe700 1 --2- 172.21.15.8:0/2671137526 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fea980a1590 0x7fea980a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:23.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.298+0000 7feaad7fa700 1 --2- 172.21.15.8:0/2671137526 >> [v2:172.21.15.100:6824/34112410,v1:172.21.15.100:6825/34112410] conn(0x7fea980aad70 0x7fea980ad190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:23.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.298+0000 7feaad7fa700 1 -- 172.21.15.8:0/2671137526 --> [v2:172.21.15.100:6824/34112410,v1:172.21.15.100:6825/34112410] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fea980ad840 con 0x7fea980aad70 2023-12-17T12:03:23.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.298+0000 7feaad7fa700 1 -- 172.21.15.8:0/2671137526 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7feaa00cef00 con 0x7feab0101680 2023-12-17T12:03:23.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.298+0000 7feaaf7fe700 1 --2- 172.21.15.8:0/2671137526 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fea980a1590 0x7fea980a3a50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7feab0075000 tx=0x7feaa4009260 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:23.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.299+0000 7feab4e97700 1 --2- 172.21.15.8:0/2671137526 >> [v2:172.21.15.100:6824/34112410,v1:172.21.15.100:6825/34112410] conn(0x7fea980aad70 0x7fea980ad190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:23.300 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.299+0000 7feab4e97700 1 --2- 172.21.15.8:0/2671137526 >> [v2:172.21.15.100:6824/34112410,v1:172.21.15.100:6825/34112410] conn(0x7fea980aad70 0x7fea980ad190 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:23.302 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.300+0000 7feaad7fa700 1 -- 172.21.15.8:0/2671137526 <== osd.10 v2:172.21.15.100:6824/34112410 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fea980ad840 con 0x7fea980aad70 2023-12-17T12:03:23.319 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.318+0000 7feab68fa700 1 -- 172.21.15.8:0/2671137526 --> [v2:172.21.15.100:6824/34112410,v1:172.21.15.100:6825/34112410] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7feab0102d10 con 0x7fea980aad70 2023-12-17T12:03:23.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.318+0000 7feaad7fa700 1 -- 172.21.15.8:0/2671137526 <== osd.10 v2:172.21.15.100:6824/34112410 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7feab0102d10 con 0x7fea980aad70 2023-12-17T12:03:23.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.319+0000 7feab68fa700 1 -- 172.21.15.8:0/2671137526 >> [v2:172.21.15.100:6824/34112410,v1:172.21.15.100:6825/34112410] conn(0x7fea980aad70 msgr2=0x7fea980ad190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:23.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.319+0000 7feab68fa700 1 --2- 172.21.15.8:0/2671137526 >> [v2:172.21.15.100:6824/34112410,v1:172.21.15.100:6825/34112410] conn(0x7fea980aad70 0x7fea980ad190 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:23.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.319+0000 7feab68fa700 1 -- 172.21.15.8:0/2671137526 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fea980a1590 msgr2=0x7fea980a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:23.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.319+0000 7feab68fa700 1 --2- 172.21.15.8:0/2671137526 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fea980a1590 0x7fea980a3a50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7feab0075000 tx=0x7feaa4009260 comp rx=0 tx=0).stop 2023-12-17T12:03:23.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.319+0000 7feab68fa700 1 -- 172.21.15.8:0/2671137526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feab0101680 msgr2=0x7feab00738d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:23.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.319+0000 7feab68fa700 1 --2- 172.21.15.8:0/2671137526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feab0101680 0x7feab00738d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7feaa0004730 tx=0x7feaa0009570 comp rx=0 tx=0).stop 2023-12-17T12:03:23.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.319+0000 7feab4e97700 1 -- 172.21.15.8:0/2671137526 reap_dead start 2023-12-17T12:03:23.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.319+0000 7feab68fa700 1 -- 172.21.15.8:0/2671137526 shutdown_connections 2023-12-17T12:03:23.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.319+0000 7feab68fa700 1 -- 172.21.15.8:0/2671137526 >> 172.21.15.8:0/2671137526 conn(0x7feab00787c0 msgr2=0x7feab01004a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:23.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.319+0000 7feab68fa700 1 -- 172.21.15.8:0/2671137526 shutdown_connections 2023-12-17T12:03:23.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.319+0000 7feab68fa700 1 -- 172.21.15.8:0/2671137526 wait complete. 2023-12-17T12:03:23.373 INFO:teuthology.orchestra.run.smithi008.stdout:279172874266 2023-12-17T12:03:23.373 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.9 2023-12-17T12:03:23.822 INFO:teuthology.orchestra.run.smithi008.stdout:34359738436 2023-12-17T12:03:23.822 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.0 2023-12-17T12:03:24.137 INFO:teuthology.orchestra.run.smithi008.stdout:300647710744 2023-12-17T12:03:24.137 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.10 2023-12-17T12:03:24.204 INFO:teuthology.orchestra.run.smithi008.stdout:107374182454 2023-12-17T12:03:24.204 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.3 2023-12-17T12:03:24.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.780+0000 7f5ae8809700 1 -- 172.21.15.8:0/2623798697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ae4069930 msgr2=0x7f5ae410e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:24.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.780+0000 7f5ae8809700 1 --2- 172.21.15.8:0/2623798697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ae4069930 0x7f5ae410e420 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5adc00f560 tx=0x7f5adc00f870 comp rx=0 tx=0).stop 2023-12-17T12:03:24.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.780+0000 7f5ae8809700 1 -- 172.21.15.8:0/2623798697 shutdown_connections 2023-12-17T12:03:24.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.780+0000 7f5ae8809700 1 --2- 172.21.15.8:0/2623798697 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ae4069930 0x7f5ae410e420 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:24.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.780+0000 7f5ae8809700 1 --2- 172.21.15.8:0/2623798697 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ae4107620 0x7f5ae4107a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:24.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.780+0000 7f5ae8809700 1 --2- 172.21.15.8:0/2623798697 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ae4068f70 0x7f5ae40693f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:24.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.780+0000 7f5ae8809700 1 -- 172.21.15.8:0/2623798697 >> 172.21.15.8:0/2623798697 conn(0x7f5ae4076570 msgr2=0x7f5ae4076980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:24.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.781+0000 7f5ae8809700 1 -- 172.21.15.8:0/2623798697 shutdown_connections 2023-12-17T12:03:24.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.781+0000 7f5ae8809700 1 -- 172.21.15.8:0/2623798697 wait complete. 2023-12-17T12:03:24.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.782+0000 7f5ae8809700 1 Processor -- start 2023-12-17T12:03:24.266 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.783+0000 7f5ae8809700 1 -- start start 2023-12-17T12:03:24.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.783+0000 7f5ae8809700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ae4068f70 0x7f5ae419b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:24.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.783+0000 7f5ae8809700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ae4069930 0x7f5ae419ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:24.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.783+0000 7f5ae8809700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ae4107620 0x7f5ae41956e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:24.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.783+0000 7f5ae8809700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae4195d40 con 0x7f5ae4068f70 2023-12-17T12:03:24.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.783+0000 7f5ae8809700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae4195eb0 con 0x7f5ae4107620 2023-12-17T12:03:24.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.783+0000 7f5ae8809700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae4196070 con 0x7f5ae4069930 2023-12-17T12:03:24.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.783+0000 7f5ae259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ae4068f70 0x7f5ae419b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:24.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.784+0000 7f5ae259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ae4068f70 0x7f5ae419b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36178/0 (socket says 172.21.15.8:36178) 2023-12-17T12:03:24.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.784+0000 7f5ae259c700 1 -- 172.21.15.8:0/666541815 learned_addr learned my addr 172.21.15.8:0/666541815 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:24.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.784+0000 7f5ae2d9d700 1 --2- 172.21.15.8:0/666541815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ae4107620 0x7f5ae41956e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:24.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.784+0000 7f5adbfff700 1 --2- 172.21.15.8:0/666541815 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ae4069930 0x7f5ae419ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:24.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.784+0000 7f5ae259c700 1 -- 172.21.15.8:0/666541815 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ae4069930 msgr2=0x7f5ae419ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:24.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.784+0000 7f5ae259c700 1 --2- 172.21.15.8:0/666541815 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ae4069930 0x7f5ae419ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:24.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.784+0000 7f5ae259c700 1 -- 172.21.15.8:0/666541815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ae4107620 msgr2=0x7f5ae41956e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:24.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.784+0000 7f5ae259c700 1 --2- 172.21.15.8:0/666541815 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5ae4107620 0x7f5ae41956e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:24.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.784+0000 7f5ae259c700 1 -- 172.21.15.8:0/666541815 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad4009520 con 0x7f5ae4068f70 2023-12-17T12:03:24.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.784+0000 7f5ae259c700 1 --2- 172.21.15.8:0/666541815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ae4068f70 0x7f5ae419b550 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5ad400eb30 tx=0x7f5ad400ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:24.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.785+0000 7f5adb7fe700 1 -- 172.21.15.8:0/666541815 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad4009880 con 0x7f5ae4068f70 2023-12-17T12:03:24.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.785+0000 7f5ae8809700 1 -- 172.21.15.8:0/666541815 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5adc009d00 con 0x7f5ae4068f70 2023-12-17T12:03:24.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.785+0000 7f5adb7fe700 1 -- 172.21.15.8:0/666541815 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5ad40044b0 con 0x7f5ae4068f70 2023-12-17T12:03:24.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.785+0000 7f5adb7fe700 1 -- 172.21.15.8:0/666541815 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad4003df0 con 0x7f5ae4068f70 2023-12-17T12:03:24.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.785+0000 7f5ae8809700 1 -- 172.21.15.8:0/666541815 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ae4196540 con 0x7f5ae4068f70 2023-12-17T12:03:24.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.786+0000 7f5ae8809700 1 -- 172.21.15.8:0/666541815 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5ae410f500 con 0x7f5ae4068f70 2023-12-17T12:03:24.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.790+0000 7f5adb7fe700 1 -- 172.21.15.8:0/666541815 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f5ad4003f50 con 0x7f5ae4068f70 2023-12-17T12:03:24.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.792+0000 7f5adb7fe700 1 --2- 172.21.15.8:0/666541815 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f5ad00a15d0 0x7f5ad00a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:24.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.792+0000 7f5adb7fe700 1 -- 172.21.15.8:0/666541815 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f5ad4014070 con 0x7f5ae4068f70 2023-12-17T12:03:24.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.792+0000 7f5adbfff700 1 --2- 172.21.15.8:0/666541815 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f5ad00a15d0 0x7f5ad00a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:24.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.792+0000 7f5adb7fe700 1 --2- 172.21.15.8:0/666541815 >> [v2:172.21.15.100:6808/1902152516,v1:172.21.15.100:6809/1902152516] conn(0x7f5ad00aadb0 0x7f5ad00ad1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:24.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.792+0000 7f5adb7fe700 1 -- 172.21.15.8:0/666541815 --> [v2:172.21.15.100:6808/1902152516,v1:172.21.15.100:6809/1902152516] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5ad00ad880 con 0x7f5ad00aadb0 2023-12-17T12:03:24.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.792+0000 7f5adb7fe700 1 -- 172.21.15.8:0/666541815 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ad40cd4b0 con 0x7f5ae4068f70 2023-12-17T12:03:24.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.793+0000 7f5ae2d9d700 1 --2- 172.21.15.8:0/666541815 >> [v2:172.21.15.100:6808/1902152516,v1:172.21.15.100:6809/1902152516] conn(0x7f5ad00aadb0 0x7f5ad00ad1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:24.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.793+0000 7f5adbfff700 1 --2- 172.21.15.8:0/666541815 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f5ad00a15d0 0x7f5ad00a3a90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5acc005950 tx=0x7f5acc0058e0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:24.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.793+0000 7f5ae2d9d700 1 --2- 172.21.15.8:0/666541815 >> [v2:172.21.15.100:6808/1902152516,v1:172.21.15.100:6809/1902152516] conn(0x7f5ad00aadb0 0x7f5ad00ad1d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:24.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.794+0000 7f5adb7fe700 1 -- 172.21.15.8:0/666541815 <== osd.4 v2:172.21.15.100:6808/1902152516 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f5ad00ad880 con 0x7f5ad00aadb0 2023-12-17T12:03:24.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.823+0000 7f5ae8809700 1 -- 172.21.15.8:0/666541815 --> [v2:172.21.15.100:6808/1902152516,v1:172.21.15.100:6809/1902152516] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5ae4102cc0 con 0x7f5ad00aadb0 2023-12-17T12:03:24.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.823+0000 7f5adb7fe700 1 -- 172.21.15.8:0/666541815 <== osd.4 v2:172.21.15.100:6808/1902152516 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f5ae4102cc0 con 0x7f5ad00aadb0 2023-12-17T12:03:24.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.824+0000 7f5ae8809700 1 -- 172.21.15.8:0/666541815 >> [v2:172.21.15.100:6808/1902152516,v1:172.21.15.100:6809/1902152516] conn(0x7f5ad00aadb0 msgr2=0x7f5ad00ad1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:24.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.824+0000 7f5ae8809700 1 --2- 172.21.15.8:0/666541815 >> [v2:172.21.15.100:6808/1902152516,v1:172.21.15.100:6809/1902152516] conn(0x7f5ad00aadb0 0x7f5ad00ad1d0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:24.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.824+0000 7f5ae8809700 1 -- 172.21.15.8:0/666541815 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f5ad00a15d0 msgr2=0x7f5ad00a3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:24.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.824+0000 7f5ae8809700 1 --2- 172.21.15.8:0/666541815 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f5ad00a15d0 0x7f5ad00a3a90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5acc005950 tx=0x7f5acc0058e0 comp rx=0 tx=0).stop 2023-12-17T12:03:24.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.824+0000 7f5ae8809700 1 -- 172.21.15.8:0/666541815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ae4068f70 msgr2=0x7f5ae419b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:24.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.824+0000 7f5ae8809700 1 --2- 172.21.15.8:0/666541815 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5ae4068f70 0x7f5ae419b550 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5ad400eb30 tx=0x7f5ad400ee40 comp rx=0 tx=0).stop 2023-12-17T12:03:24.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.824+0000 7f5ae2d9d700 1 -- 172.21.15.8:0/666541815 reap_dead start 2023-12-17T12:03:24.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.824+0000 7f5ae8809700 1 -- 172.21.15.8:0/666541815 shutdown_connections 2023-12-17T12:03:24.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.824+0000 7f5ae8809700 1 -- 172.21.15.8:0/666541815 >> 172.21.15.8:0/666541815 conn(0x7f5ae4076570 msgr2=0x7f5ae40ff540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:24.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.824+0000 7f5ae8809700 1 -- 172.21.15.8:0/666541815 shutdown_connections 2023-12-17T12:03:24.270 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:23.824+0000 7f5ae8809700 1 -- 172.21.15.8:0/666541815 wait complete. 2023-12-17T12:03:24.581 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:03:24.634 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:03:24.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.690+0000 7f5461a69700 1 -- 172.21.15.8:0/3068926194 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f545c102040 msgr2=0x7f545c10e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:24.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.690+0000 7f5461a69700 1 --2- 172.21.15.8:0/3068926194 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f545c102040 0x7f545c10e430 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f545400b0a0 tx=0x7f545400b3b0 comp rx=0 tx=0).stop 2023-12-17T12:03:24.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.690+0000 7f5461a69700 1 -- 172.21.15.8:0/3068926194 shutdown_connections 2023-12-17T12:03:24.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.690+0000 7f5461a69700 1 --2- 172.21.15.8:0/3068926194 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f545c102040 0x7f545c10e430 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:24.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.690+0000 7f5461a69700 1 --2- 172.21.15.8:0/3068926194 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f545c1076f0 0x7f545c107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:24.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.690+0000 7f5461a69700 1 --2- 172.21.15.8:0/3068926194 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f545c101680 0x7f545c101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:24.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.690+0000 7f5461a69700 1 -- 172.21.15.8:0/3068926194 >> 172.21.15.8:0/3068926194 conn(0x7f545c0787c0 msgr2=0x7f545c078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:24.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.690+0000 7f5461a69700 1 -- 172.21.15.8:0/3068926194 shutdown_connections 2023-12-17T12:03:24.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.690+0000 7f5461a69700 1 -- 172.21.15.8:0/3068926194 wait complete. 2023-12-17T12:03:24.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.692+0000 7f5461a69700 1 Processor -- start 2023-12-17T12:03:24.693 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.692+0000 7f5461a69700 1 -- start start 2023-12-17T12:03:24.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.693+0000 7f5461a69700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f545c101680 0x7f545c19d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:24.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.693+0000 7f5461a69700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f545c102040 0x7f545c19dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:24.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.693+0000 7f5461a69700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f545c1076f0 0x7f545c197850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:24.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.693+0000 7f5461a69700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545c197ec0 con 0x7f545c101680 2023-12-17T12:03:24.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.693+0000 7f5461a69700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545c198030 con 0x7f545c1076f0 2023-12-17T12:03:24.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.693+0000 7f5461a69700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f545c1981f0 con 0x7f545c102040 2023-12-17T12:03:24.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.693+0000 7f545b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f545c101680 0x7f545c19d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:24.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.693+0000 7f545b7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f545c101680 0x7f545c19d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36194/0 (socket says 172.21.15.8:36194) 2023-12-17T12:03:24.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.693+0000 7f545b7fe700 1 -- 172.21.15.8:0/592849831 learned_addr learned my addr 172.21.15.8:0/592849831 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:24.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.693+0000 7f545affd700 1 --2- 172.21.15.8:0/592849831 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f545c102040 0x7f545c19dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:24.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.693+0000 7f545bfff700 1 --2- 172.21.15.8:0/592849831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f545c1076f0 0x7f545c197850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:24.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.693+0000 7f545b7fe700 1 -- 172.21.15.8:0/592849831 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f545c102040 msgr2=0x7f545c19dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:24.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.693+0000 7f545b7fe700 1 --2- 172.21.15.8:0/592849831 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f545c102040 0x7f545c19dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:24.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.693+0000 7f545b7fe700 1 -- 172.21.15.8:0/592849831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f545c1076f0 msgr2=0x7f545c197850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:24.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.693+0000 7f545b7fe700 1 --2- 172.21.15.8:0/592849831 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f545c1076f0 0x7f545c197850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:24.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.693+0000 7f545b7fe700 1 -- 172.21.15.8:0/592849831 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5454009d00 con 0x7f545c101680 2023-12-17T12:03:24.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.694+0000 7f545b7fe700 1 --2- 172.21.15.8:0/592849831 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f545c101680 0x7f545c19d6c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f544c00d950 tx=0x7f544c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:24.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.694+0000 7f5458ff9700 1 -- 172.21.15.8:0/592849831 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c009940 con 0x7f545c101680 2023-12-17T12:03:24.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.694+0000 7f5461a69700 1 -- 172.21.15.8:0/592849831 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f545c1984d0 con 0x7f545c101680 2023-12-17T12:03:24.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.694+0000 7f5458ff9700 1 -- 172.21.15.8:0/592849831 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f544c010460 con 0x7f545c101680 2023-12-17T12:03:24.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.694+0000 7f5458ff9700 1 -- 172.21.15.8:0/592849831 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544c00f620 con 0x7f545c101680 2023-12-17T12:03:24.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.694+0000 7f5461a69700 1 -- 172.21.15.8:0/592849831 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f545c1a46b0 con 0x7f545c101680 2023-12-17T12:03:24.697 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.695+0000 7f5461a69700 1 -- 172.21.15.8:0/592849831 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f545c111690 con 0x7f545c101680 2023-12-17T12:03:24.698 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.697+0000 7f5458ff9700 1 -- 172.21.15.8:0/592849831 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f544c0105d0 con 0x7f545c101680 2023-12-17T12:03:24.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.699+0000 7f5458ff9700 1 --2- 172.21.15.8:0/592849831 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f54440a1510 0x7f54440a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:24.700 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.699+0000 7f5458ff9700 1 -- 172.21.15.8:0/592849831 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f544c0cd110 con 0x7f545c101680 2023-12-17T12:03:24.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.699+0000 7f545affd700 1 --2- 172.21.15.8:0/592849831 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f54440a1510 0x7f54440a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:24.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.699+0000 7f5458ff9700 1 --2- 172.21.15.8:0/592849831 >> [v2:172.21.15.186:6808/648349934,v1:172.21.15.186:6809/648349934] conn(0x7f54440aacf0 0x7f54440ad110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:24.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.699+0000 7f5458ff9700 1 -- 172.21.15.8:0/592849831 --> [v2:172.21.15.186:6808/648349934,v1:172.21.15.186:6809/648349934] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f54440ad7c0 con 0x7f54440aacf0 2023-12-17T12:03:24.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.699+0000 7f5458ff9700 1 -- 172.21.15.8:0/592849831 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f544c0cd480 con 0x7f545c101680 2023-12-17T12:03:24.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.700+0000 7f545bfff700 1 --2- 172.21.15.8:0/592849831 >> [v2:172.21.15.186:6808/648349934,v1:172.21.15.186:6809/648349934] conn(0x7f54440aacf0 0x7f54440ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:24.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.700+0000 7f545affd700 1 --2- 172.21.15.8:0/592849831 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f54440a1510 0x7f54440a39d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f545c198c20 tx=0x7f545000b410 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:24.701 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.700+0000 7f545bfff700 1 --2- 172.21.15.8:0/592849831 >> [v2:172.21.15.186:6808/648349934,v1:172.21.15.186:6809/648349934] conn(0x7f54440aacf0 0x7f54440ad110 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:24.703 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.701+0000 7f5458ff9700 1 -- 172.21.15.8:0/592849831 <== osd.5 v2:172.21.15.186:6808/648349934 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f54440ad7c0 con 0x7f54440aacf0 2023-12-17T12:03:24.720 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.719+0000 7f5461a69700 1 -- 172.21.15.8:0/592849831 --> [v2:172.21.15.186:6808/648349934,v1:172.21.15.186:6809/648349934] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f545c061c50 con 0x7f54440aacf0 2023-12-17T12:03:24.721 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.720+0000 7f5458ff9700 1 -- 172.21.15.8:0/592849831 <== osd.5 v2:172.21.15.186:6808/648349934 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f545c061c50 con 0x7f54440aacf0 2023-12-17T12:03:24.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.720+0000 7f5461a69700 1 -- 172.21.15.8:0/592849831 >> [v2:172.21.15.186:6808/648349934,v1:172.21.15.186:6809/648349934] conn(0x7f54440aacf0 msgr2=0x7f54440ad110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:24.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.720+0000 7f5461a69700 1 --2- 172.21.15.8:0/592849831 >> [v2:172.21.15.186:6808/648349934,v1:172.21.15.186:6809/648349934] conn(0x7f54440aacf0 0x7f54440ad110 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:24.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.720+0000 7f5461a69700 1 -- 172.21.15.8:0/592849831 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f54440a1510 msgr2=0x7f54440a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:24.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.720+0000 7f5461a69700 1 --2- 172.21.15.8:0/592849831 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f54440a1510 0x7f54440a39d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f545c198c20 tx=0x7f545000b410 comp rx=0 tx=0).stop 2023-12-17T12:03:24.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.720+0000 7f5461a69700 1 -- 172.21.15.8:0/592849831 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f545c101680 msgr2=0x7f545c19d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:24.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.720+0000 7f5461a69700 1 --2- 172.21.15.8:0/592849831 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f545c101680 0x7f545c19d6c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f544c00d950 tx=0x7f544c00dc60 comp rx=0 tx=0).stop 2023-12-17T12:03:24.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.720+0000 7f545bfff700 1 -- 172.21.15.8:0/592849831 reap_dead start 2023-12-17T12:03:24.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.720+0000 7f5461a69700 1 -- 172.21.15.8:0/592849831 shutdown_connections 2023-12-17T12:03:24.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.720+0000 7f5461a69700 1 -- 172.21.15.8:0/592849831 >> 172.21.15.8:0/592849831 conn(0x7f545c0787c0 msgr2=0x7f545c1003e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:24.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.720+0000 7f5461a69700 1 -- 172.21.15.8:0/592849831 shutdown_connections 2023-12-17T12:03:24.722 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:24.720+0000 7f5461a69700 1 -- 172.21.15.8:0/592849831 wait complete. 2023-12-17T12:03:24.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:24 smithi008 ceph-mon[36830]: pgmap v281: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 853 B/s wr, 11 op/s 2023-12-17T12:03:24.793 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:03:24.888 INFO:teuthology.orchestra.run.smithi008.stdout:141733920818 2023-12-17T12:03:24.888 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.4 2023-12-17T12:03:24.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:24 smithi100 ceph-mon[41266]: pgmap v281: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 853 B/s wr, 11 op/s 2023-12-17T12:03:24.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:24 smithi186 ceph-mon[41182]: pgmap v281: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 853 B/s wr, 11 op/s 2023-12-17T12:03:25.419 INFO:teuthology.orchestra.run.smithi008.stdout:163208757293 2023-12-17T12:03:25.419 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph osd last-stat-seq osd.5 2023-12-17T12:03:25.493 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:03:25.938 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:03:26.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:25 smithi008 ceph-mon[36830]: pgmap v282: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 341 B/s wr, 10 op/s 2023-12-17T12:03:26.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:25 smithi100 ceph-mon[41266]: pgmap v282: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 341 B/s wr, 10 op/s 2023-12-17T12:03:26.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:25 smithi186 ceph-mon[41182]: pgmap v282: 97 pgs: 97 active+clean; 639 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 341 B/s wr, 10 op/s 2023-12-17T12:03:27.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2023-12-17T12:03:27.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]: dispatch 2023-12-17T12:03:27.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]: dispatch 2023-12-17T12:03:27.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [3, 6]}]: dispatch 2023-12-17T12:03:27.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 6]}]: dispatch 2023-12-17T12:03:27.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.26", "id": [1, 9]}]: dispatch 2023-12-17T12:03:27.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 7]}]: dispatch 2023-12-17T12:03:27.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2023-12-17T12:03:27.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]: dispatch 2023-12-17T12:03:27.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:27 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]}]: dispatch 2023-12-17T12:03:27.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2023-12-17T12:03:27.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]: dispatch 2023-12-17T12:03:27.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]: dispatch 2023-12-17T12:03:27.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [3, 6]}]: dispatch 2023-12-17T12:03:27.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 6]}]: dispatch 2023-12-17T12:03:27.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.26", "id": [1, 9]}]: dispatch 2023-12-17T12:03:27.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 7]}]: dispatch 2023-12-17T12:03:27.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2023-12-17T12:03:27.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]: dispatch 2023-12-17T12:03:27.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:27 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]}]: dispatch 2023-12-17T12:03:27.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2023-12-17T12:03:27.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]: dispatch 2023-12-17T12:03:27.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]: dispatch 2023-12-17T12:03:27.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [3, 6]}]: dispatch 2023-12-17T12:03:27.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 6]}]: dispatch 2023-12-17T12:03:27.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.26", "id": [1, 9]}]: dispatch 2023-12-17T12:03:27.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 7]}]: dispatch 2023-12-17T12:03:27.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]: dispatch 2023-12-17T12:03:27.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]: dispatch 2023-12-17T12:03:27.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:27 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]}]: dispatch 2023-12-17T12:03:28.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.026+0000 7f6f25a0d700 1 -- 172.21.15.8:0/3242720630 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f201022c0 msgr2=0x7f6f20106210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:28.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.026+0000 7f6f25a0d700 1 --2- 172.21.15.8:0/3242720630 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f201022c0 0x7f6f20106210 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6f14009990 tx=0x7f6f14009ca0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.026+0000 7f6f25a0d700 1 -- 172.21.15.8:0/3242720630 shutdown_connections 2023-12-17T12:03:28.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.026+0000 7f6f25a0d700 1 --2- 172.21.15.8:0/3242720630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f20106940 0x7f6f2010e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.026+0000 7f6f25a0d700 1 --2- 172.21.15.8:0/3242720630 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f20101910 0x7f6f20101cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.026+0000 7f6f25a0d700 1 --2- 172.21.15.8:0/3242720630 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f201022c0 0x7f6f20106210 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.026+0000 7f6f25a0d700 1 -- 172.21.15.8:0/3242720630 >> 172.21.15.8:0/3242720630 conn(0x7f6f200786f0 msgr2=0x7f6f20078b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:28.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.026+0000 7f6f25a0d700 1 -- 172.21.15.8:0/3242720630 shutdown_connections 2023-12-17T12:03:28.028 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.026+0000 7f6f25a0d700 1 -- 172.21.15.8:0/3242720630 wait complete. 2023-12-17T12:03:28.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.028+0000 7f6f25a0d700 1 Processor -- start 2023-12-17T12:03:28.029 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.028+0000 7f6f25a0d700 1 -- start start 2023-12-17T12:03:28.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.029+0000 7f6f25a0d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f20101910 0x7f6f2019f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:28.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.029+0000 7f6f25a0d700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f201022c0 0x7f6f2019fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:28.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.029+0000 7f6f25a0d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f20106940 0x7f6f201998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:28.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.029+0000 7f6f25a0d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f20199f40 con 0x7f6f20101910 2023-12-17T12:03:28.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.029+0000 7f6f25a0d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2019a0b0 con 0x7f6f20106940 2023-12-17T12:03:28.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.029+0000 7f6f25a0d700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f2019a270 con 0x7f6f201022c0 2023-12-17T12:03:28.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.029+0000 7f6f1effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f20101910 0x7f6f2019f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:28.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.029+0000 7f6f1effd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f20101910 0x7f6f2019f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36204/0 (socket says 172.21.15.8:36204) 2023-12-17T12:03:28.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.029+0000 7f6f1effd700 1 -- 172.21.15.8:0/2273542033 learned_addr learned my addr 172.21.15.8:0/2273542033 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:28.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.029+0000 7f6f1e7fc700 1 --2- 172.21.15.8:0/2273542033 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f201022c0 0x7f6f2019fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:28.031 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.029+0000 7f6f1f7fe700 1 --2- 172.21.15.8:0/2273542033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f20106940 0x7f6f201998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:28.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.030+0000 7f6f1effd700 1 -- 172.21.15.8:0/2273542033 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f201022c0 msgr2=0x7f6f2019fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:28.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.030+0000 7f6f1effd700 1 --2- 172.21.15.8:0/2273542033 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f201022c0 0x7f6f2019fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.030+0000 7f6f1effd700 1 -- 172.21.15.8:0/2273542033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f20106940 msgr2=0x7f6f201998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:28.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.030+0000 7f6f1effd700 1 --2- 172.21.15.8:0/2273542033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f20106940 0x7f6f201998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.030+0000 7f6f1effd700 1 -- 172.21.15.8:0/2273542033 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f140095f0 con 0x7f6f20101910 2023-12-17T12:03:28.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.030+0000 7f6f1e7fc700 1 --2- 172.21.15.8:0/2273542033 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f201022c0 0x7f6f2019fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T12:03:28.032 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.030+0000 7f6f1effd700 1 --2- 172.21.15.8:0/2273542033 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f20101910 0x7f6f2019f7a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6f1000e9a0 tx=0x7f6f1000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:28.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.030+0000 7f6f24a0b700 1 -- 172.21.15.8:0/2273542033 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f10009790 con 0x7f6f20101910 2023-12-17T12:03:28.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.030+0000 7f6f24a0b700 1 -- 172.21.15.8:0/2273542033 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6f1000cbd0 con 0x7f6f20101910 2023-12-17T12:03:28.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.030+0000 7f6f25a0d700 1 -- 172.21.15.8:0/2273542033 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f2019a550 con 0x7f6f20101910 2023-12-17T12:03:28.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.030+0000 7f6f24a0b700 1 -- 172.21.15.8:0/2273542033 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f10018680 con 0x7f6f20101910 2023-12-17T12:03:28.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.030+0000 7f6f25a0d700 1 -- 172.21.15.8:0/2273542033 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f201a6790 con 0x7f6f20101910 2023-12-17T12:03:28.033 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.032+0000 7f6f25a0d700 1 -- 172.21.15.8:0/2273542033 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f20102cd0 con 0x7f6f20101910 2023-12-17T12:03:28.035 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.034+0000 7f6f24a0b700 1 -- 172.21.15.8:0/2273542033 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f6f1000cd40 con 0x7f6f20101910 2023-12-17T12:03:28.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.036+0000 7f6f24a0b700 1 --2- 172.21.15.8:0/2273542033 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f6f080a1590 0x7f6f080a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:28.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.036+0000 7f6f24a0b700 1 -- 172.21.15.8:0/2273542033 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f6f10014070 con 0x7f6f20101910 2023-12-17T12:03:28.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.037+0000 7f6f1e7fc700 1 --2- 172.21.15.8:0/2273542033 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f6f080a1590 0x7f6f080a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:28.038 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.037+0000 7f6f1e7fc700 1 --2- 172.21.15.8:0/2273542033 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f6f080a1590 0x7f6f080a3a50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6f2019aaa0 tx=0x7f6f1400b260 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:28.043 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.041+0000 7f6f24a0b700 1 -- 172.21.15.8:0/2273542033 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f6f100522f0 con 0x7f6f20101910 2023-12-17T12:03:28.140 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:03:28.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.267+0000 7f6f25a0d700 1 -- 172.21.15.8:0/2273542033 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6f20111390 con 0x7f6f20101910 2023-12-17T12:03:28.269 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.267+0000 7f6f24a0b700 1 -- 172.21.15.8:0/2273542033 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6f10094e60 con 0x7f6f20101910 2023-12-17T12:03:28.269 INFO:teuthology.orchestra.run.smithi008.stdout:55834574911 2023-12-17T12:03:28.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.270+0000 7f6f25a0d700 1 -- 172.21.15.8:0/2273542033 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f6f080a1590 msgr2=0x7f6f080a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:28.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.270+0000 7f6f25a0d700 1 --2- 172.21.15.8:0/2273542033 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f6f080a1590 0x7f6f080a3a50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6f2019aaa0 tx=0x7f6f1400b260 comp rx=0 tx=0).stop 2023-12-17T12:03:28.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.270+0000 7f6f25a0d700 1 -- 172.21.15.8:0/2273542033 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f20101910 msgr2=0x7f6f2019f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:28.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.270+0000 7f6f25a0d700 1 --2- 172.21.15.8:0/2273542033 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f20101910 0x7f6f2019f7a0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6f1000e9a0 tx=0x7f6f1000ecb0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.270+0000 7f6f25a0d700 1 -- 172.21.15.8:0/2273542033 shutdown_connections 2023-12-17T12:03:28.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.270+0000 7f6f25a0d700 1 --2- 172.21.15.8:0/2273542033 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f6f080a1590 0x7f6f080a3a50 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.270+0000 7f6f25a0d700 1 --2- 172.21.15.8:0/2273542033 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6f20106940 0x7f6f201998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.270+0000 7f6f25a0d700 1 --2- 172.21.15.8:0/2273542033 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6f20101910 0x7f6f2019f7a0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.270+0000 7f6f25a0d700 1 --2- 172.21.15.8:0/2273542033 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6f201022c0 0x7f6f2019fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.270+0000 7f6f25a0d700 1 -- 172.21.15.8:0/2273542033 >> 172.21.15.8:0/2273542033 conn(0x7f6f200786f0 msgr2=0x7f6f200ffb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:28.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.270+0000 7f6f25a0d700 1 -- 172.21.15.8:0/2273542033 shutdown_connections 2023-12-17T12:03:28.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.270+0000 7f6f25a0d700 1 -- 172.21.15.8:0/2273542033 wait complete. 2023-12-17T12:03:28.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.285+0000 7fad97fe0700 1 -- 172.21.15.8:0/2801622573 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad901064d0 msgr2=0x7fad90068f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:28.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.285+0000 7fad97fe0700 1 --2- 172.21.15.8:0/2801622573 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad901064d0 0x7fad90068f70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fad8c009990 tx=0x7fad8c009ca0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.285+0000 7fad97fe0700 1 -- 172.21.15.8:0/2801622573 shutdown_connections 2023-12-17T12:03:28.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.285+0000 7fad97fe0700 1 --2- 172.21.15.8:0/2801622573 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad90104030 0x7fad901044e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.285+0000 7fad97fe0700 1 --2- 172.21.15.8:0/2801622573 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad901064d0 0x7fad90068f70 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.285+0000 7fad97fe0700 1 --2- 172.21.15.8:0/2801622573 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad900694b0 0x7fad90069930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.285+0000 7fad97fe0700 1 -- 172.21.15.8:0/2801622573 >> 172.21.15.8:0/2801622573 conn(0x7fad90076570 msgr2=0x7fad90076980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:28.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.286+0000 7fad97fe0700 1 -- 172.21.15.8:0/2801622573 shutdown_connections 2023-12-17T12:03:28.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.286+0000 7fad97fe0700 1 -- 172.21.15.8:0/2801622573 wait complete. 2023-12-17T12:03:28.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.287+0000 7fad97fe0700 1 Processor -- start 2023-12-17T12:03:28.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.287+0000 7fad97fe0700 1 -- start start 2023-12-17T12:03:28.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.287+0000 7fad97fe0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad900694b0 0x7fad9019df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:28.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.287+0000 7fad97fe0700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad90104030 0x7fad9019e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:28.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.287+0000 7fad97fe0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad901064d0 0x7fad901a2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:28.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.287+0000 7fad97fe0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad901a2e80 con 0x7fad900694b0 2023-12-17T12:03:28.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.287+0000 7fad97fe0700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad901a2ff0 con 0x7fad901064d0 2023-12-17T12:03:28.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.287+0000 7fad97fe0700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad901a31b0 con 0x7fad90104030 2023-12-17T12:03:28.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.288+0000 7fad95d7c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad900694b0 0x7fad9019df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:28.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.288+0000 7fad9557b700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad90104030 0x7fad9019e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:28.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.288+0000 7fad9557b700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad90104030 0x7fad9019e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:59426/0 (socket says 172.21.15.8:59426) 2023-12-17T12:03:28.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.288+0000 7fad95d7c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad900694b0 0x7fad9019df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36208/0 (socket says 172.21.15.8:36208) 2023-12-17T12:03:28.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.288+0000 7fad9557b700 1 -- 172.21.15.8:0/3546152084 learned_addr learned my addr 172.21.15.8:0/3546152084 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:28.290 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.288+0000 7fad9657d700 1 --2- 172.21.15.8:0/3546152084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad901064d0 0x7fad901a2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:28.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.288+0000 7fad95d7c700 1 -- 172.21.15.8:0/3546152084 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad90104030 msgr2=0x7fad9019e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:28.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.288+0000 7fad95d7c700 1 --2- 172.21.15.8:0/3546152084 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad90104030 0x7fad9019e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.288+0000 7fad95d7c700 1 -- 172.21.15.8:0/3546152084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad901064d0 msgr2=0x7fad901a2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:28.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.288+0000 7fad95d7c700 1 --2- 172.21.15.8:0/3546152084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad901064d0 0x7fad901a2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.288+0000 7fad95d7c700 1 -- 172.21.15.8:0/3546152084 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad8c0095f0 con 0x7fad900694b0 2023-12-17T12:03:28.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.289+0000 7fad95d7c700 1 --2- 172.21.15.8:0/3546152084 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad900694b0 0x7fad9019df80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fad8c0098e0 tx=0x7fad8c009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:28.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.289+0000 7fad86ffd700 1 -- 172.21.15.8:0/3546152084 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c01d070 con 0x7fad900694b0 2023-12-17T12:03:28.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.289+0000 7fad86ffd700 1 -- 172.21.15.8:0/3546152084 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fad8c00fb00 con 0x7fad900694b0 2023-12-17T12:03:28.291 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.289+0000 7fad97fe0700 1 -- 172.21.15.8:0/3546152084 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad901a3430 con 0x7fad900694b0 2023-12-17T12:03:28.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.289+0000 7fad86ffd700 1 -- 172.21.15.8:0/3546152084 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c022a70 con 0x7fad900694b0 2023-12-17T12:03:28.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.290+0000 7fad97fe0700 1 -- 172.21.15.8:0/3546152084 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad901aacf0 con 0x7fad900694b0 2023-12-17T12:03:28.294 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.292+0000 7fad97fe0700 1 -- 172.21.15.8:0/3546152084 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad90100b10 con 0x7fad900694b0 2023-12-17T12:03:28.295 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.293+0000 7fad86ffd700 1 -- 172.21.15.8:0/3546152084 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7fad8c00fc70 con 0x7fad900694b0 2023-12-17T12:03:28.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.296+0000 7fad86ffd700 1 --2- 172.21.15.8:0/3546152084 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fad7c0a1510 0x7fad7c0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:28.298 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.296+0000 7fad86ffd700 1 -- 172.21.15.8:0/3546152084 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fad8c0ce070 con 0x7fad900694b0 2023-12-17T12:03:28.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.296+0000 7fad9557b700 1 --2- 172.21.15.8:0/3546152084 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fad7c0a1510 0x7fad7c0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:28.299 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.297+0000 7fad9557b700 1 --2- 172.21.15.8:0/3546152084 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fad7c0a1510 0x7fad7c0a39d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fad9019f4e0 tx=0x7fad80007480 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:28.304 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.303+0000 7fad86ffd700 1 -- 172.21.15.8:0/3546152084 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fad8c097580 con 0x7fad900694b0 2023-12-17T12:03:28.523 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:03:28.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.541+0000 7f0651632700 1 -- 172.21.15.8:0/3201521914 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f064c1076f0 msgr2=0x7f064c107ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:28.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.541+0000 7f0651632700 1 --2- 172.21.15.8:0/3201521914 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f064c1076f0 0x7f064c107ad0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f063c009990 tx=0x7f063c009ca0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.541+0000 7f0651632700 1 -- 172.21.15.8:0/3201521914 shutdown_connections 2023-12-17T12:03:28.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.541+0000 7f0651632700 1 --2- 172.21.15.8:0/3201521914 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f064c102040 0x7f064c10e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.541+0000 7f0651632700 1 --2- 172.21.15.8:0/3201521914 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f064c1076f0 0x7f064c107ad0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.541+0000 7f0651632700 1 --2- 172.21.15.8:0/3201521914 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f064c101680 0x7f064c101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.541+0000 7f0651632700 1 -- 172.21.15.8:0/3201521914 >> 172.21.15.8:0/3201521914 conn(0x7f064c0787c0 msgr2=0x7f064c078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:28.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.541+0000 7f0651632700 1 -- 172.21.15.8:0/3201521914 shutdown_connections 2023-12-17T12:03:28.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.541+0000 7f0651632700 1 -- 172.21.15.8:0/3201521914 wait complete. 2023-12-17T12:03:28.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.543+0000 7f0651632700 1 Processor -- start 2023-12-17T12:03:28.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.543+0000 7f0651632700 1 -- start start 2023-12-17T12:03:28.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.543+0000 7f0651632700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f064c101680 0x7f064c1a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:28.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.543+0000 7f0651632700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f064c102040 0x7f064c1a30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:28.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.543+0000 7f0651632700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f064c1076f0 0x7f064c10d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:28.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.543+0000 7f0651632700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c10dcb0 con 0x7f064c101680 2023-12-17T12:03:28.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.544+0000 7f0651632700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c10ddf0 con 0x7f064c102040 2023-12-17T12:03:28.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.544+0000 7f0651632700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c10dfb0 con 0x7f064c1076f0 2023-12-17T12:03:28.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.544+0000 7f064affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f064c101680 0x7f064c1a2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:28.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.544+0000 7f064b7fe700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f064c1076f0 0x7f064c10d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:28.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.544+0000 7f064affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f064c101680 0x7f064c1a2b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36238/0 (socket says 172.21.15.8:36238) 2023-12-17T12:03:28.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.544+0000 7f064affd700 1 -- 172.21.15.8:0/3232459957 learned_addr learned my addr 172.21.15.8:0/3232459957 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:28.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.544+0000 7f064b7fe700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f064c1076f0 0x7f064c10d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:59450/0 (socket says 172.21.15.8:59450) 2023-12-17T12:03:28.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.545+0000 7f064a7fc700 1 --2- 172.21.15.8:0/3232459957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f064c102040 0x7f064c1a30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:28.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.545+0000 7f064b7fe700 1 -- 172.21.15.8:0/3232459957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f064c102040 msgr2=0x7f064c1a30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:28.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.545+0000 7f064b7fe700 1 --2- 172.21.15.8:0/3232459957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f064c102040 0x7f064c1a30c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.545+0000 7f064b7fe700 1 -- 172.21.15.8:0/3232459957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f064c101680 msgr2=0x7f064c1a2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:28.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.545+0000 7f064b7fe700 1 --2- 172.21.15.8:0/3232459957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f064c101680 0x7f064c1a2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.545+0000 7f064b7fe700 1 -- 172.21.15.8:0/3232459957 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f063c0095f0 con 0x7f064c1076f0 2023-12-17T12:03:28.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.545+0000 7f064b7fe700 1 --2- 172.21.15.8:0/3232459957 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f064c1076f0 0x7f064c10d510 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f064400efc0 tx=0x7f064400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:28.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.546+0000 7f0633fff700 1 -- 172.21.15.8:0/3232459957 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0644018070 con 0x7f064c1076f0 2023-12-17T12:03:28.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.546+0000 7f0633fff700 1 -- 172.21.15.8:0/3232459957 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f064400f040 con 0x7f064c1076f0 2023-12-17T12:03:28.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.546+0000 7f0633fff700 1 -- 172.21.15.8:0/3232459957 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064400cb20 con 0x7f064c1076f0 2023-12-17T12:03:28.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.546+0000 7f0651632700 1 -- 172.21.15.8:0/3232459957 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f064c10e230 con 0x7f064c1076f0 2023-12-17T12:03:28.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.546+0000 7f0651632700 1 -- 172.21.15.8:0/3232459957 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f064c06b1c0 con 0x7f064c1076f0 2023-12-17T12:03:28.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.547+0000 7f0651632700 1 -- 172.21.15.8:0/3232459957 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f064c102d10 con 0x7f064c1076f0 2023-12-17T12:03:28.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.549+0000 7f0633fff700 1 -- 172.21.15.8:0/3232459957 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f064400cce0 con 0x7f064c1076f0 2023-12-17T12:03:28.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.552+0000 7f0633fff700 1 --2- 172.21.15.8:0/3232459957 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f06340a1510 0x7f06340a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:28.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.552+0000 7f0633fff700 1 -- 172.21.15.8:0/3232459957 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f06440cc900 con 0x7f064c1076f0 2023-12-17T12:03:28.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.552+0000 7f064affd700 1 --2- 172.21.15.8:0/3232459957 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f06340a1510 0x7f06340a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:28.554 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.553+0000 7f064affd700 1 --2- 172.21.15.8:0/3232459957 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f06340a1510 0x7f06340a39d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f063c006010 tx=0x7f063c00b260 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:28.558 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.556+0000 7f0633fff700 1 -- 172.21.15.8:0/3232459957 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f0644095e10 con 0x7f064c1076f0 2023-12-17T12:03:28.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.568+0000 7fad97fe0700 1 -- 172.21.15.8:0/3546152084 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fad9019f290 con 0x7fad900694b0 2023-12-17T12:03:28.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.568+0000 7fad86ffd700 1 -- 172.21.15.8:0/3546152084 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fad8c097580 con 0x7fad900694b0 2023-12-17T12:03:28.570 INFO:teuthology.orchestra.run.smithi008.stdout:193273528362 2023-12-17T12:03:28.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.572+0000 7fad97fe0700 1 -- 172.21.15.8:0/3546152084 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fad7c0a1510 msgr2=0x7fad7c0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:28.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.572+0000 7fad97fe0700 1 --2- 172.21.15.8:0/3546152084 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fad7c0a1510 0x7fad7c0a39d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fad9019f4e0 tx=0x7fad80007480 comp rx=0 tx=0).stop 2023-12-17T12:03:28.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.572+0000 7fad97fe0700 1 -- 172.21.15.8:0/3546152084 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad900694b0 msgr2=0x7fad9019df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:28.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.572+0000 7fad97fe0700 1 --2- 172.21.15.8:0/3546152084 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad900694b0 0x7fad9019df80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fad8c0098e0 tx=0x7fad8c009580 comp rx=0 tx=0).stop 2023-12-17T12:03:28.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.572+0000 7fad97fe0700 1 -- 172.21.15.8:0/3546152084 shutdown_connections 2023-12-17T12:03:28.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.572+0000 7fad97fe0700 1 --2- 172.21.15.8:0/3546152084 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fad7c0a1510 0x7fad7c0a39d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.572+0000 7fad97fe0700 1 --2- 172.21.15.8:0/3546152084 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fad901064d0 0x7fad901a2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.572+0000 7fad97fe0700 1 --2- 172.21.15.8:0/3546152084 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fad900694b0 0x7fad9019df80 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.572+0000 7fad97fe0700 1 --2- 172.21.15.8:0/3546152084 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fad90104030 0x7fad9019e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.572+0000 7fad97fe0700 1 -- 172.21.15.8:0/3546152084 >> 172.21.15.8:0/3546152084 conn(0x7fad90076570 msgr2=0x7fad9010f360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:28.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.572+0000 7fad97fe0700 1 -- 172.21.15.8:0/3546152084 shutdown_connections 2023-12-17T12:03:28.574 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.573+0000 7fad97fe0700 1 -- 172.21.15.8:0/3546152084 wait complete. 2023-12-17T12:03:28.605 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:28 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2023-12-17T12:03:28.606 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:28 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2023-12-17T12:03:28.606 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:28 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]': finished 2023-12-17T12:03:28.606 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:28 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [3, 6]}]': finished 2023-12-17T12:03:28.606 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:28 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 6]}]': finished 2023-12-17T12:03:28.606 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:28 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.26", "id": [1, 9]}]': finished 2023-12-17T12:03:28.606 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:28 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 7]}]': finished 2023-12-17T12:03:28.606 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:28 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2023-12-17T12:03:28.606 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:28 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]': finished 2023-12-17T12:03:28.606 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:28 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]}]': finished 2023-12-17T12:03:28.606 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:28 smithi008 ceph-mon[36830]: pgmap v283: 97 pgs: 97 active+clean; 641 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 10 op/s 2023-12-17T12:03:28.606 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:28 smithi008 ceph-mon[36830]: osdmap e84: 12 total, 12 up, 12 in 2023-12-17T12:03:28.606 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:28 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/2273542033' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-17T12:03:28.606 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:28 smithi008 ceph-mon[36830]: osdmap e85: 12 total, 12 up, 12 in 2023-12-17T12:03:28.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.620+0000 7f784f1a0700 1 -- 172.21.15.8:0/2667421953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7848103fa0 msgr2=0x7f78481104b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:28.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.620+0000 7f784f1a0700 1 --2- 172.21.15.8:0/2667421953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7848103fa0 0x7f78481104b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f784000b0a0 tx=0x7f784000b3b0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.620+0000 7f784f1a0700 1 -- 172.21.15.8:0/2667421953 shutdown_connections 2023-12-17T12:03:28.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.620+0000 7f784f1a0700 1 --2- 172.21.15.8:0/2667421953 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7848103fa0 0x7f78481104b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.620+0000 7f784f1a0700 1 --2- 172.21.15.8:0/2667421953 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7848109670 0x7f7848109a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.620+0000 7f784f1a0700 1 --2- 172.21.15.8:0/2667421953 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f78481035e0 0x7f7848103a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.622 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.620+0000 7f784f1a0700 1 -- 172.21.15.8:0/2667421953 >> 172.21.15.8:0/2667421953 conn(0x7f78480ff0b0 msgr2=0x7f78481014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:28.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.621+0000 7f784f1a0700 1 -- 172.21.15.8:0/2667421953 shutdown_connections 2023-12-17T12:03:28.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.621+0000 7f784f1a0700 1 -- 172.21.15.8:0/2667421953 wait complete. 2023-12-17T12:03:28.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.622+0000 7f784f1a0700 1 Processor -- start 2023-12-17T12:03:28.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.622+0000 7f784f1a0700 1 -- start start 2023-12-17T12:03:28.623 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.622+0000 7f784f1a0700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f78481035e0 0x7f7848199a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:28.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.622+0000 7f784f1a0700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7848103fa0 0x7f7848199f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:28.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.622+0000 7f784f1a0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7848109670 0x7f784819e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:28.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.622+0000 7f784f1a0700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784819e900 con 0x7f7848109670 2023-12-17T12:03:28.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.622+0000 7f784f1a0700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784819ea70 con 0x7f7848103fa0 2023-12-17T12:03:28.624 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.622+0000 7f784f1a0700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f784819ec30 con 0x7f78481035e0 2023-12-17T12:03:28.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.622+0000 7f784e99f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7848109670 0x7f784819e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:28.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.622+0000 7f784e19e700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f78481035e0 0x7f7848199a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:28.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.622+0000 7f784e19e700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f78481035e0 0x7f7848199a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:59468/0 (socket says 172.21.15.8:59468) 2023-12-17T12:03:28.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.622+0000 7f784e99f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7848109670 0x7f784819e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36258/0 (socket says 172.21.15.8:36258) 2023-12-17T12:03:28.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.622+0000 7f784e19e700 1 -- 172.21.15.8:0/1536436794 learned_addr learned my addr 172.21.15.8:0/1536436794 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:28.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.623+0000 7f784d99d700 1 --2- 172.21.15.8:0/1536436794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7848103fa0 0x7f7848199f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:28.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.623+0000 7f784e99f700 1 -- 172.21.15.8:0/1536436794 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f78481035e0 msgr2=0x7f7848199a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:28.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.623+0000 7f784e99f700 1 --2- 172.21.15.8:0/1536436794 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f78481035e0 0x7f7848199a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.623+0000 7f784e99f700 1 -- 172.21.15.8:0/1536436794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7848103fa0 msgr2=0x7f7848199f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:28.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.623+0000 7f784e99f700 1 --2- 172.21.15.8:0/1536436794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7848103fa0 0x7f7848199f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.623+0000 7f784e99f700 1 -- 172.21.15.8:0/1536436794 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7840009d00 con 0x7f7848109670 2023-12-17T12:03:28.625 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.623+0000 7f784e99f700 1 --2- 172.21.15.8:0/1536436794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7848109670 0x7f784819e330 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f784000b070 tx=0x7f7840009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:28.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.624+0000 7f783f7fe700 1 -- 172.21.15.8:0/1536436794 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784000e040 con 0x7f7848109670 2023-12-17T12:03:28.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.624+0000 7f783f7fe700 1 -- 172.21.15.8:0/1536436794 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7840007930 con 0x7f7848109670 2023-12-17T12:03:28.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.624+0000 7f784f1a0700 1 -- 172.21.15.8:0/1536436794 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f784819eeb0 con 0x7f7848109670 2023-12-17T12:03:28.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.624+0000 7f783f7fe700 1 -- 172.21.15.8:0/1536436794 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7840005040 con 0x7f7848109670 2023-12-17T12:03:28.626 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.624+0000 7f784f1a0700 1 -- 172.21.15.8:0/1536436794 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78481a67b0 con 0x7f7848109670 2023-12-17T12:03:28.627 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.625+0000 7f784f1a0700 1 -- 172.21.15.8:0/1536436794 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f784810bc00 con 0x7f7848109670 2023-12-17T12:03:28.630 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.629+0000 7f783f7fe700 1 -- 172.21.15.8:0/1536436794 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f784001d480 con 0x7f7848109670 2023-12-17T12:03:28.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.630+0000 7f783f7fe700 1 --2- 172.21.15.8:0/1536436794 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f78340a1590 0x7f78340a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:28.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.630+0000 7f783f7fe700 1 -- 172.21.15.8:0/1536436794 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f78400ce070 con 0x7f7848109670 2023-12-17T12:03:28.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.631+0000 7f784e19e700 1 --2- 172.21.15.8:0/1536436794 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f78340a1590 0x7f78340a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:28.632 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.631+0000 7f784e19e700 1 --2- 172.21.15.8:0/1536436794 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f78340a1590 0x7f78340a3a50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f784400bd70 tx=0x7f784400b4a0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:28.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.635+0000 7f783f7fe700 1 -- 172.21.15.8:0/1536436794 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f78401012f0 con 0x7f7848109670 2023-12-17T12:03:28.693 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:03:28.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:28 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2023-12-17T12:03:28.725 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:28 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2023-12-17T12:03:28.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:28 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]': finished 2023-12-17T12:03:28.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:28 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [3, 6]}]': finished 2023-12-17T12:03:28.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:28 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 6]}]': finished 2023-12-17T12:03:28.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:28 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.26", "id": [1, 9]}]': finished 2023-12-17T12:03:28.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:28 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 7]}]': finished 2023-12-17T12:03:28.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:28 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2023-12-17T12:03:28.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:28 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]': finished 2023-12-17T12:03:28.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:28 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]}]': finished 2023-12-17T12:03:28.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:28 smithi186 ceph-mon[41182]: pgmap v283: 97 pgs: 97 active+clean; 641 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 10 op/s 2023-12-17T12:03:28.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:28 smithi186 ceph-mon[41182]: osdmap e84: 12 total, 12 up, 12 in 2023-12-17T12:03:28.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:28 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/2273542033' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-17T12:03:28.726 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:28 smithi186 ceph-mon[41182]: osdmap e85: 12 total, 12 up, 12 in 2023-12-17T12:03:28.810 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.808+0000 7f0651632700 1 -- 172.21.15.8:0/3232459957 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f064c19f290 con 0x7f064c1076f0 2023-12-17T12:03:28.811 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.809+0000 7f0633fff700 1 -- 172.21.15.8:0/3232459957 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0644099430 con 0x7f064c1076f0 2023-12-17T12:03:28.811 INFO:teuthology.orchestra.run.smithi008.stdout:249108103200 2023-12-17T12:03:28.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.812+0000 7f0651632700 1 -- 172.21.15.8:0/3232459957 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f06340a1510 msgr2=0x7f06340a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:28.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.812+0000 7f0651632700 1 --2- 172.21.15.8:0/3232459957 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f06340a1510 0x7f06340a39d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f063c006010 tx=0x7f063c00b260 comp rx=0 tx=0).stop 2023-12-17T12:03:28.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.812+0000 7f0651632700 1 -- 172.21.15.8:0/3232459957 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f064c1076f0 msgr2=0x7f064c10d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:28.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.812+0000 7f0651632700 1 --2- 172.21.15.8:0/3232459957 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f064c1076f0 0x7f064c10d510 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f064400efc0 tx=0x7f064400c3a0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.812+0000 7f0651632700 1 -- 172.21.15.8:0/3232459957 shutdown_connections 2023-12-17T12:03:28.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.812+0000 7f0651632700 1 --2- 172.21.15.8:0/3232459957 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f06340a1510 0x7f06340a39d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.812+0000 7f0651632700 1 --2- 172.21.15.8:0/3232459957 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f064c1076f0 0x7f064c10d510 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.812+0000 7f0651632700 1 --2- 172.21.15.8:0/3232459957 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f064c101680 0x7f064c1a2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.812+0000 7f0651632700 1 --2- 172.21.15.8:0/3232459957 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f064c102040 0x7f064c1a30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.812+0000 7f0651632700 1 -- 172.21.15.8:0/3232459957 >> 172.21.15.8:0/3232459957 conn(0x7f064c0787c0 msgr2=0x7f064c1002c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:28.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.812+0000 7f0651632700 1 -- 172.21.15.8:0/3232459957 shutdown_connections 2023-12-17T12:03:28.814 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.812+0000 7f0651632700 1 -- 172.21.15.8:0/3232459957 wait complete. 2023-12-17T12:03:28.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.873+0000 7f784f1a0700 1 -- 172.21.15.8:0/1536436794 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f784819ad20 con 0x7f7848109670 2023-12-17T12:03:28.875 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.873+0000 7f783f7fe700 1 -- 172.21.15.8:0/1536436794 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f7840097580 con 0x7f7848109670 2023-12-17T12:03:28.875 INFO:teuthology.orchestra.run.smithi008.stdout:335007449107 2023-12-17T12:03:28.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.876+0000 7f784f1a0700 1 -- 172.21.15.8:0/1536436794 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f78340a1590 msgr2=0x7f78340a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:28.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.876+0000 7f784f1a0700 1 --2- 172.21.15.8:0/1536436794 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f78340a1590 0x7f78340a3a50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f784400bd70 tx=0x7f784400b4a0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.876+0000 7f784f1a0700 1 -- 172.21.15.8:0/1536436794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7848109670 msgr2=0x7f784819e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:28.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.876+0000 7f784f1a0700 1 --2- 172.21.15.8:0/1536436794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7848109670 0x7f784819e330 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f784000b070 tx=0x7f7840009300 comp rx=0 tx=0).stop 2023-12-17T12:03:28.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.876+0000 7f784f1a0700 1 -- 172.21.15.8:0/1536436794 shutdown_connections 2023-12-17T12:03:28.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.876+0000 7f784f1a0700 1 --2- 172.21.15.8:0/1536436794 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f78340a1590 0x7f78340a3a50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.876+0000 7f784f1a0700 1 --2- 172.21.15.8:0/1536436794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7848109670 0x7f784819e330 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.876+0000 7f784f1a0700 1 --2- 172.21.15.8:0/1536436794 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f78481035e0 0x7f7848199a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.876+0000 7f784f1a0700 1 --2- 172.21.15.8:0/1536436794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7848103fa0 0x7f7848199f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:28.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.876+0000 7f784f1a0700 1 -- 172.21.15.8:0/1536436794 >> 172.21.15.8:0/1536436794 conn(0x7f78480ff0b0 msgr2=0x7f7848100810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:28.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.876+0000 7f784f1a0700 1 -- 172.21.15.8:0/1536436794 shutdown_connections 2023-12-17T12:03:28.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:28.876+0000 7f784f1a0700 1 -- 172.21.15.8:0/1536436794 wait complete. 2023-12-17T12:03:28.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:28 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2023-12-17T12:03:28.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:28 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.11", "id": [4, 8]}]': finished 2023-12-17T12:03:28.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:28 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.12", "id": [3, 9]}]': finished 2023-12-17T12:03:28.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:28 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.19", "id": [3, 6]}]': finished 2023-12-17T12:03:28.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:28 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 6]}]': finished 2023-12-17T12:03:28.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:28 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.26", "id": [1, 9]}]': finished 2023-12-17T12:03:28.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:28 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 7]}]': finished 2023-12-17T12:03:28.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:28 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2023-12-17T12:03:28.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:28 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.39", "id": [5, 8]}]': finished 2023-12-17T12:03:28.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:28 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 7]}]': finished 2023-12-17T12:03:28.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:28 smithi100 ceph-mon[41266]: pgmap v283: 97 pgs: 97 active+clean; 641 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 597 B/s wr, 10 op/s 2023-12-17T12:03:28.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:28 smithi100 ceph-mon[41266]: osdmap e84: 12 total, 12 up, 12 in 2023-12-17T12:03:28.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:28 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/2273542033' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-12-17T12:03:28.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:28 smithi100 ceph-mon[41266]: osdmap e85: 12 total, 12 up, 12 in 2023-12-17T12:03:29.024 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:03:29.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:29 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/3546152084' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-12-17T12:03:29.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:29 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/3232459957' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-12-17T12:03:29.496 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:29 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/1536436794' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-12-17T12:03:29.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:29 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/3546152084' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-12-17T12:03:29.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:29 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/3232459957' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-12-17T12:03:29.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:29 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/1536436794' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-12-17T12:03:29.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:29 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/3546152084' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-12-17T12:03:29.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:29 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/3232459957' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-12-17T12:03:29.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:29 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/1536436794' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-12-17T12:03:29.996 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:03:30.320 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.318+0000 7fe0bf822700 1 -- 172.21.15.8:0/1145060962 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0b8101680 msgr2=0x7fe0b8101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:30.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.318+0000 7fe0bf822700 1 --2- 172.21.15.8:0/1145060962 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0b8101680 0x7fe0b8101b00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8009990 tx=0x7fe0a8009ca0 comp rx=0 tx=0).stop 2023-12-17T12:03:30.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.318+0000 7fe0bf822700 1 -- 172.21.15.8:0/1145060962 shutdown_connections 2023-12-17T12:03:30.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.318+0000 7fe0bf822700 1 --2- 172.21.15.8:0/1145060962 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0b8102040 0x7fe0b810e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:30.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.318+0000 7fe0bf822700 1 --2- 172.21.15.8:0/1145060962 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0b81076f0 0x7fe0b8107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:30.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.318+0000 7fe0bf822700 1 --2- 172.21.15.8:0/1145060962 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0b8101680 0x7fe0b8101b00 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:30.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.318+0000 7fe0bf822700 1 -- 172.21.15.8:0/1145060962 >> 172.21.15.8:0/1145060962 conn(0x7fe0b80787c0 msgr2=0x7fe0b8078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:30.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.318+0000 7fe0bf822700 1 -- 172.21.15.8:0/1145060962 shutdown_connections 2023-12-17T12:03:30.321 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.318+0000 7fe0bf822700 1 -- 172.21.15.8:0/1145060962 wait complete. 2023-12-17T12:03:30.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.319+0000 7fe0bf822700 1 Processor -- start 2023-12-17T12:03:30.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.319+0000 7fe0bf822700 1 -- start start 2023-12-17T12:03:30.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.319+0000 7fe0bf822700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0b8101680 0x7fe0b819f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:30.322 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.319+0000 7fe0bf822700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0b8102040 0x7fe0b819fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:30.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.319+0000 7fe0bf822700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0b81076f0 0x7fe0b8199a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:30.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.319+0000 7fe0bf822700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b819a060 con 0x7fe0b8102040 2023-12-17T12:03:30.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.319+0000 7fe0bf822700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b819a1d0 con 0x7fe0b8101680 2023-12-17T12:03:30.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.319+0000 7fe0bf822700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b819a390 con 0x7fe0b81076f0 2023-12-17T12:03:30.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.320+0000 7fe0bcdbd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0b8102040 0x7fe0b819fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:30.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.320+0000 7fe0bcdbd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0b8102040 0x7fe0b819fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:36274/0 (socket says 172.21.15.8:36274) 2023-12-17T12:03:30.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.320+0000 7fe0bcdbd700 1 -- 172.21.15.8:0/1221728107 learned_addr learned my addr 172.21.15.8:0/1221728107 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:30.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.320+0000 7fe0bd5be700 1 --2- 172.21.15.8:0/1221728107 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0b8101680 0x7fe0b819f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:30.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.320+0000 7fe0bddbf700 1 --2- 172.21.15.8:0/1221728107 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0b81076f0 0x7fe0b8199a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:30.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.320+0000 7fe0bcdbd700 1 -- 172.21.15.8:0/1221728107 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0b81076f0 msgr2=0x7fe0b8199a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:30.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.320+0000 7fe0bcdbd700 1 --2- 172.21.15.8:0/1221728107 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0b81076f0 0x7fe0b8199a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:30.323 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.320+0000 7fe0bcdbd700 1 -- 172.21.15.8:0/1221728107 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0b8101680 msgr2=0x7fe0b819f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:30.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.320+0000 7fe0bcdbd700 1 --2- 172.21.15.8:0/1221728107 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0b8101680 0x7fe0b819f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:30.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.320+0000 7fe0bcdbd700 1 -- 172.21.15.8:0/1221728107 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a80095f0 con 0x7fe0b8102040 2023-12-17T12:03:30.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.320+0000 7fe0bcdbd700 1 --2- 172.21.15.8:0/1221728107 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0b8102040 0x7fe0b819fe00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8006010 tx=0x7fe0a8005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:30.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.321+0000 7fe0ae7fc700 1 -- 172.21.15.8:0/1221728107 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a801d070 con 0x7fe0b8102040 2023-12-17T12:03:30.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.321+0000 7fe0ae7fc700 1 -- 172.21.15.8:0/1221728107 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe0a800fcc0 con 0x7fe0b8102040 2023-12-17T12:03:30.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.321+0000 7fe0ae7fc700 1 -- 172.21.15.8:0/1221728107 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0a8022cb0 con 0x7fe0b8102040 2023-12-17T12:03:30.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.321+0000 7fe0bf822700 1 -- 172.21.15.8:0/1221728107 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0b819a610 con 0x7fe0b8102040 2023-12-17T12:03:30.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.321+0000 7fe0bf822700 1 -- 172.21.15.8:0/1221728107 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0b81a68b0 con 0x7fe0b8102040 2023-12-17T12:03:30.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.322+0000 7fe0bf822700 1 -- 172.21.15.8:0/1221728107 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0b8104940 con 0x7fe0b8102040 2023-12-17T12:03:30.326 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.324+0000 7fe0ae7fc700 1 -- 172.21.15.8:0/1221728107 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7fe0a8022470 con 0x7fe0b8102040 2023-12-17T12:03:30.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.325+0000 7fe0ae7fc700 1 --2- 172.21.15.8:0/1221728107 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fe0a40a1590 0x7fe0a40a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:30.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.326+0000 7fe0ae7fc700 1 -- 172.21.15.8:0/1221728107 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fe0a80ce420 con 0x7fe0b8102040 2023-12-17T12:03:30.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.326+0000 7fe0bd5be700 1 --2- 172.21.15.8:0/1221728107 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fe0a40a1590 0x7fe0a40a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:30.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.326+0000 7fe0bd5be700 1 --2- 172.21.15.8:0/1221728107 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fe0a40a1590 0x7fe0a40a3a50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe0b4009a10 tx=0x7fe0b4009190 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:30.332 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.330+0000 7fe0ae7fc700 1 -- 172.21.15.8:0/1221728107 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe0a8097930 con 0x7fe0b8102040 2023-12-17T12:03:30.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.557+0000 7fe0bf822700 1 -- 172.21.15.8:0/1221728107 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7fe0b8111480 con 0x7fe0b8102040 2023-12-17T12:03:30.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.557+0000 7fe0ae7fc700 1 -- 172.21.15.8:0/1221728107 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe0a8027020 con 0x7fe0b8102040 2023-12-17T12:03:30.560 INFO:teuthology.orchestra.run.smithi008.stdout:279172874267 2023-12-17T12:03:30.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.560+0000 7fe0bf822700 1 -- 172.21.15.8:0/1221728107 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fe0a40a1590 msgr2=0x7fe0a40a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:30.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.560+0000 7fe0bf822700 1 --2- 172.21.15.8:0/1221728107 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fe0a40a1590 0x7fe0a40a3a50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe0b4009a10 tx=0x7fe0b4009190 comp rx=0 tx=0).stop 2023-12-17T12:03:30.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.560+0000 7fe0bf822700 1 -- 172.21.15.8:0/1221728107 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0b8102040 msgr2=0x7fe0b819fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:30.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.560+0000 7fe0bf822700 1 --2- 172.21.15.8:0/1221728107 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0b8102040 0x7fe0b819fe00 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8006010 tx=0x7fe0a8005740 comp rx=0 tx=0).stop 2023-12-17T12:03:30.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.560+0000 7fe0bf822700 1 -- 172.21.15.8:0/1221728107 shutdown_connections 2023-12-17T12:03:30.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.560+0000 7fe0bf822700 1 --2- 172.21.15.8:0/1221728107 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fe0a40a1590 0x7fe0a40a3a50 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:30.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.560+0000 7fe0bf822700 1 --2- 172.21.15.8:0/1221728107 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe0b81076f0 0x7fe0b8199a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:30.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.560+0000 7fe0bf822700 1 --2- 172.21.15.8:0/1221728107 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe0b8101680 0x7fe0b819f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:30.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.560+0000 7fe0bf822700 1 --2- 172.21.15.8:0/1221728107 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe0b8102040 0x7fe0b819fe00 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:30.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.560+0000 7fe0bf822700 1 -- 172.21.15.8:0/1221728107 >> 172.21.15.8:0/1221728107 conn(0x7fe0b80787c0 msgr2=0x7fe0b810cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:30.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.560+0000 7fe0bf822700 1 -- 172.21.15.8:0/1221728107 shutdown_connections 2023-12-17T12:03:30.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:30.560+0000 7fe0bf822700 1 -- 172.21.15.8:0/1221728107 wait complete. 2023-12-17T12:03:30.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:30 smithi008 ceph-mon[36830]: pgmap v286: 97 pgs: 97 active+clean; 641 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 383 B/s wr, 10 op/s 2023-12-17T12:03:30.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:30 smithi100 ceph-mon[41266]: pgmap v286: 97 pgs: 97 active+clean; 641 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 383 B/s wr, 10 op/s 2023-12-17T12:03:30.949 INFO:tasks.cephadm.ceph_manager.ceph:need seq 335007449106 got 335007449107 for osd.11 2023-12-17T12:03:30.949 DEBUG:teuthology.parallel:result is None 2023-12-17T12:03:30.964 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574910 got 55834574911 for osd.1 2023-12-17T12:03:30.964 DEBUG:teuthology.parallel:result is None 2023-12-17T12:03:30.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:30 smithi186 ceph-mon[41182]: pgmap v286: 97 pgs: 97 active+clean; 641 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 383 B/s wr, 10 op/s 2023-12-17T12:03:31.743 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:31 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/1221728107' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-12-17T12:03:31.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:31 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/1221728107' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-12-17T12:03:31.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:31 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/1221728107' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-12-17T12:03:32.139 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528359 got 193273528362 for osd.6 2023-12-17T12:03:32.139 DEBUG:teuthology.parallel:result is None 2023-12-17T12:03:32.226 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:03:32.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.277+0000 7f7214ed3700 1 -- 172.21.15.8:0/1937142954 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7210102040 msgr2=0x7f721010e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:32.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.277+0000 7f7214ed3700 1 --2- 172.21.15.8:0/1937142954 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7210102040 0x7f721010e430 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f720800b0a0 tx=0x7f720800b3b0 comp rx=0 tx=0).stop 2023-12-17T12:03:32.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.277+0000 7f7214ed3700 1 -- 172.21.15.8:0/1937142954 shutdown_connections 2023-12-17T12:03:32.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.277+0000 7f7214ed3700 1 --2- 172.21.15.8:0/1937142954 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7210102040 0x7f721010e430 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:32.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.277+0000 7f7214ed3700 1 --2- 172.21.15.8:0/1937142954 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f72101076f0 0x7f7210107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:32.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.277+0000 7f7214ed3700 1 --2- 172.21.15.8:0/1937142954 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7210101680 0x7f7210101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:32.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.277+0000 7f7214ed3700 1 -- 172.21.15.8:0/1937142954 >> 172.21.15.8:0/1937142954 conn(0x7f72100787c0 msgr2=0x7f7210078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:32.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.277+0000 7f7214ed3700 1 -- 172.21.15.8:0/1937142954 shutdown_connections 2023-12-17T12:03:32.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.277+0000 7f7214ed3700 1 -- 172.21.15.8:0/1937142954 wait complete. 2023-12-17T12:03:32.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.278+0000 7f7214ed3700 1 Processor -- start 2023-12-17T12:03:32.281 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.279+0000 7f7214ed3700 1 -- start start 2023-12-17T12:03:32.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.279+0000 7f7214ed3700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7210101680 0x7f721019f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:32.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.279+0000 7f7214ed3700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7210102040 0x7f721019fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:32.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.279+0000 7f7214ed3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72101076f0 0x7f7210199aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:32.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.279+0000 7f7214ed3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721019a100 con 0x7f72101076f0 2023-12-17T12:03:32.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.279+0000 7f7214ed3700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721019a270 con 0x7f7210102040 2023-12-17T12:03:32.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.279+0000 7f7214ed3700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f721019a430 con 0x7f7210101680 2023-12-17T12:03:32.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.279+0000 7f720ed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72101076f0 0x7f7210199aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:32.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.280+0000 7f720ed9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72101076f0 0x7f7210199aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34020/0 (socket says 172.21.15.8:34020) 2023-12-17T12:03:32.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.280+0000 7f720ed9d700 1 -- 172.21.15.8:0/2923533768 learned_addr learned my addr 172.21.15.8:0/2923533768 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:32.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.280+0000 7f720dd9b700 1 --2- 172.21.15.8:0/2923533768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7210102040 0x7f721019fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:32.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.280+0000 7f720e59c700 1 --2- 172.21.15.8:0/2923533768 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7210101680 0x7f721019f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:32.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.280+0000 7f720ed9d700 1 -- 172.21.15.8:0/2923533768 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7210101680 msgr2=0x7f721019f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:32.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.280+0000 7f720ed9d700 1 --2- 172.21.15.8:0/2923533768 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7210101680 0x7f721019f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:32.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.280+0000 7f720ed9d700 1 -- 172.21.15.8:0/2923533768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7210102040 msgr2=0x7f721019fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:32.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.280+0000 7f720ed9d700 1 --2- 172.21.15.8:0/2923533768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7210102040 0x7f721019fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:32.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.280+0000 7f720ed9d700 1 -- 172.21.15.8:0/2923533768 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7208009d00 con 0x7f72101076f0 2023-12-17T12:03:32.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.280+0000 7f720ed9d700 1 --2- 172.21.15.8:0/2923533768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72101076f0 0x7f7210199aa0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f720800b070 tx=0x7f720800bd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:32.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.281+0000 7f71ff7fe700 1 -- 172.21.15.8:0/2923533768 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f720800e040 con 0x7f72101076f0 2023-12-17T12:03:32.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.281+0000 7f7214ed3700 1 -- 172.21.15.8:0/2923533768 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f721019a6b0 con 0x7f72101076f0 2023-12-17T12:03:32.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.281+0000 7f7214ed3700 1 -- 172.21.15.8:0/2923533768 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72101a6860 con 0x7f72101076f0 2023-12-17T12:03:32.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.281+0000 7f71ff7fe700 1 -- 172.21.15.8:0/2923533768 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7208003e90 con 0x7f72101076f0 2023-12-17T12:03:32.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.281+0000 7f71ff7fe700 1 -- 172.21.15.8:0/2923533768 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7208005040 con 0x7f72101076f0 2023-12-17T12:03:32.285 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.283+0000 7f7214ed3700 1 -- 172.21.15.8:0/2923533768 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71f00052f0 con 0x7f72101076f0 2023-12-17T12:03:32.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.284+0000 7f71ff7fe700 1 -- 172.21.15.8:0/2923533768 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f7208003a00 con 0x7f72101076f0 2023-12-17T12:03:32.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.285+0000 7f71ff7fe700 1 --2- 172.21.15.8:0/2923533768 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f71f80a1590 0x7f71f80a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:32.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.286+0000 7f71ff7fe700 1 -- 172.21.15.8:0/2923533768 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f72080cdb40 con 0x7f72101076f0 2023-12-17T12:03:32.288 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.286+0000 7f720e59c700 1 --2- 172.21.15.8:0/2923533768 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f71f80a1590 0x7f71f80a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:32.289 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.287+0000 7f720e59c700 1 --2- 172.21.15.8:0/2923533768 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f71f80a1590 0x7f71f80a3a50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7200009bf0 tx=0x7f7200009260 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:32.292 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.290+0000 7f71ff7fe700 1 -- 172.21.15.8:0/2923533768 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f7208097050 con 0x7f72101076f0 2023-12-17T12:03:32.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.521+0000 7f7214ed3700 1 -- 172.21.15.8:0/2923533768 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f71f0005870 con 0x7f72101076f0 2023-12-17T12:03:32.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.521+0000 7f71ff7fe700 1 -- 172.21.15.8:0/2923533768 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f720809a670 con 0x7f72101076f0 2023-12-17T12:03:32.524 INFO:teuthology.orchestra.run.smithi008.stdout:214748364838 2023-12-17T12:03:32.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.524+0000 7f7214ed3700 1 -- 172.21.15.8:0/2923533768 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f71f80a1590 msgr2=0x7f71f80a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:32.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.524+0000 7f7214ed3700 1 --2- 172.21.15.8:0/2923533768 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f71f80a1590 0x7f71f80a3a50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7200009bf0 tx=0x7f7200009260 comp rx=0 tx=0).stop 2023-12-17T12:03:32.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.524+0000 7f7214ed3700 1 -- 172.21.15.8:0/2923533768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72101076f0 msgr2=0x7f7210199aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:32.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.524+0000 7f7214ed3700 1 --2- 172.21.15.8:0/2923533768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72101076f0 0x7f7210199aa0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f720800b070 tx=0x7f720800bd30 comp rx=0 tx=0).stop 2023-12-17T12:03:32.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.524+0000 7f7214ed3700 1 -- 172.21.15.8:0/2923533768 shutdown_connections 2023-12-17T12:03:32.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.524+0000 7f7214ed3700 1 --2- 172.21.15.8:0/2923533768 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f71f80a1590 0x7f71f80a3a50 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:32.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.524+0000 7f7214ed3700 1 --2- 172.21.15.8:0/2923533768 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f72101076f0 0x7f7210199aa0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:32.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.524+0000 7f7214ed3700 1 --2- 172.21.15.8:0/2923533768 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7210101680 0x7f721019f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:32.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.524+0000 7f7214ed3700 1 --2- 172.21.15.8:0/2923533768 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7210102040 0x7f721019fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:32.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.524+0000 7f7214ed3700 1 -- 172.21.15.8:0/2923533768 >> 172.21.15.8:0/2923533768 conn(0x7f72100787c0 msgr2=0x7f7210100160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:32.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.524+0000 7f7214ed3700 1 -- 172.21.15.8:0/2923533768 shutdown_connections 2023-12-17T12:03:32.527 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.524+0000 7f7214ed3700 1 -- 172.21.15.8:0/2923533768 wait complete. 2023-12-17T12:03:32.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:32 smithi008 ceph-mon[36830]: pgmap v287: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 383 B/s wr, 8 op/s; 0 B/s, 0 objects/s recovering 2023-12-17T12:03:32.834 INFO:tasks.cephadm.ceph_manager.ceph:need seq 279172874266 got 279172874267 for osd.9 2023-12-17T12:03:32.834 DEBUG:teuthology.parallel:result is None 2023-12-17T12:03:32.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.842+0000 7f4c44afd700 1 -- 172.21.15.8:0/3657626524 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c40073d40 msgr2=0x7f4c400741c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:32.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.842+0000 7f4c44afd700 1 --2- 172.21.15.8:0/3657626524 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c40073d40 0x7f4c400741c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4c34009990 tx=0x7f4c34009ca0 comp rx=0 tx=0).stop 2023-12-17T12:03:32.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.843+0000 7f4c44afd700 1 -- 172.21.15.8:0/3657626524 shutdown_connections 2023-12-17T12:03:32.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.843+0000 7f4c44afd700 1 --2- 172.21.15.8:0/3657626524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c40112350 0x7f4c40114780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:32.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.843+0000 7f4c44afd700 1 --2- 172.21.15.8:0/3657626524 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c40075550 0x7f4c40073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:32.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.843+0000 7f4c44afd700 1 --2- 172.21.15.8:0/3657626524 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c40073d40 0x7f4c400741c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:32.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.843+0000 7f4c44afd700 1 -- 172.21.15.8:0/3657626524 >> 172.21.15.8:0/3657626524 conn(0x7f4c400787c0 msgr2=0x7f4c40078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:32.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.843+0000 7f4c44afd700 1 -- 172.21.15.8:0/3657626524 shutdown_connections 2023-12-17T12:03:32.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.843+0000 7f4c44afd700 1 -- 172.21.15.8:0/3657626524 wait complete. 2023-12-17T12:03:32.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.844+0000 7f4c44afd700 1 Processor -- start 2023-12-17T12:03:32.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.844+0000 7f4c44afd700 1 -- start start 2023-12-17T12:03:32.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.844+0000 7f4c44afd700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c40073d40 0x7f4c4019dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:32.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.844+0000 7f4c44afd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c40075550 0x7f4c4019e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:32.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.844+0000 7f4c44afd700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c40112350 0x7f4c401a28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:32.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.844+0000 7f4c44afd700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c401a2ed0 con 0x7f4c40075550 2023-12-17T12:03:32.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.844+0000 7f4c44afd700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c401a3040 con 0x7f4c40112350 2023-12-17T12:03:32.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.844+0000 7f4c44afd700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c401a3200 con 0x7f4c40073d40 2023-12-17T12:03:32.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.845+0000 7f4c3dd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c40075550 0x7f4c4019e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:32.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.845+0000 7f4c3dd9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c40075550 0x7f4c4019e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34048/0 (socket says 172.21.15.8:34048) 2023-12-17T12:03:32.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.845+0000 7f4c3e59c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c40073d40 0x7f4c4019dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:32.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.845+0000 7f4c3dd9b700 1 -- 172.21.15.8:0/2391648563 learned_addr learned my addr 172.21.15.8:0/2391648563 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:32.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.845+0000 7f4c3ed9d700 1 --2- 172.21.15.8:0/2391648563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c40112350 0x7f4c401a28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:32.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.845+0000 7f4c3dd9b700 1 -- 172.21.15.8:0/2391648563 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c40073d40 msgr2=0x7f4c4019dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:32.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.845+0000 7f4c3dd9b700 1 --2- 172.21.15.8:0/2391648563 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c40073d40 0x7f4c4019dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:32.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.845+0000 7f4c3dd9b700 1 -- 172.21.15.8:0/2391648563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c40112350 msgr2=0x7f4c401a28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:32.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.845+0000 7f4c3dd9b700 1 --2- 172.21.15.8:0/2391648563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c40112350 0x7f4c401a28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:32.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.845+0000 7f4c3dd9b700 1 -- 172.21.15.8:0/2391648563 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c340095f0 con 0x7f4c40075550 2023-12-17T12:03:32.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.845+0000 7f4c3ed9d700 1 --2- 172.21.15.8:0/2391648563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c40112350 0x7f4c401a28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T12:03:32.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.845+0000 7f4c3dd9b700 1 --2- 172.21.15.8:0/2391648563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c40075550 0x7f4c4019e510 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4c34004730 tx=0x7f4c34004760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:32.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.846+0000 7f4c2f7fe700 1 -- 172.21.15.8:0/2391648563 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3401d070 con 0x7f4c40075550 2023-12-17T12:03:32.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.846+0000 7f4c2f7fe700 1 -- 172.21.15.8:0/2391648563 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4c34022470 con 0x7f4c40075550 2023-12-17T12:03:32.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.846+0000 7f4c2f7fe700 1 -- 172.21.15.8:0/2391648563 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c34017650 con 0x7f4c40075550 2023-12-17T12:03:32.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.846+0000 7f4c44afd700 1 -- 172.21.15.8:0/2391648563 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c401a3480 con 0x7f4c40075550 2023-12-17T12:03:32.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.846+0000 7f4c44afd700 1 -- 172.21.15.8:0/2391648563 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c401aab70 con 0x7f4c40075550 2023-12-17T12:03:32.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.847+0000 7f4c2d7fa700 1 -- 172.21.15.8:0/2391648563 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c240052f0 con 0x7f4c40075550 2023-12-17T12:03:32.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.849+0000 7f4c2f7fe700 1 -- 172.21.15.8:0/2391648563 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f4c340225e0 con 0x7f4c40075550 2023-12-17T12:03:32.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.851+0000 7f4c2f7fe700 1 --2- 172.21.15.8:0/2391648563 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4c280a1590 0x7f4c280a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:32.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.851+0000 7f4c2f7fe700 1 -- 172.21.15.8:0/2391648563 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f4c340ce170 con 0x7f4c40075550 2023-12-17T12:03:32.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.851+0000 7f4c3e59c700 1 --2- 172.21.15.8:0/2391648563 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4c280a1590 0x7f4c280a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:32.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.852+0000 7f4c3e59c700 1 --2- 172.21.15.8:0/2391648563 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4c280a1590 0x7f4c280a3a50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4c30005950 tx=0x7f4c3000b410 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:32.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.855+0000 7f4c2f7fe700 1 -- 172.21.15.8:0/2391648563 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4c34097790 con 0x7f4c40075550 2023-12-17T12:03:32.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.884+0000 7f75d5b07700 1 -- 172.21.15.8:0/1219873209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75d01076f0 msgr2=0x7f75d0107ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:32.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.884+0000 7f75d5b07700 1 --2- 172.21.15.8:0/1219873209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75d01076f0 0x7f75d0107ad0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f75c0009990 tx=0x7f75c0009ca0 comp rx=0 tx=0).stop 2023-12-17T12:03:32.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.884+0000 7f75d5b07700 1 -- 172.21.15.8:0/1219873209 shutdown_connections 2023-12-17T12:03:32.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.884+0000 7f75d5b07700 1 --2- 172.21.15.8:0/1219873209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75d0102040 0x7f75d010e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:32.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.884+0000 7f75d5b07700 1 --2- 172.21.15.8:0/1219873209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75d01076f0 0x7f75d0107ad0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:32.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.884+0000 7f75d5b07700 1 --2- 172.21.15.8:0/1219873209 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f75d0101680 0x7f75d0101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:32.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.884+0000 7f75d5b07700 1 -- 172.21.15.8:0/1219873209 >> 172.21.15.8:0/1219873209 conn(0x7f75d00787c0 msgr2=0x7f75d0078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:32.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.884+0000 7f75d5b07700 1 -- 172.21.15.8:0/1219873209 shutdown_connections 2023-12-17T12:03:32.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.884+0000 7f75d5b07700 1 -- 172.21.15.8:0/1219873209 wait complete. 2023-12-17T12:03:32.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.885+0000 7f75d5b07700 1 Processor -- start 2023-12-17T12:03:32.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.886+0000 7f75d5b07700 1 -- start start 2023-12-17T12:03:32.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.886+0000 7f75d5b07700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75d0101680 0x7f75d019f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:32.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.886+0000 7f75d5b07700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75d0102040 0x7f75d019fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:32.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.886+0000 7f75d5b07700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f75d01076f0 0x7f75d0199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:32.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.886+0000 7f75d5b07700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d0199f60 con 0x7f75d0101680 2023-12-17T12:03:32.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.886+0000 7f75d5b07700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d019a0d0 con 0x7f75d0102040 2023-12-17T12:03:32.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.886+0000 7f75d5b07700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75d019a290 con 0x7f75d01076f0 2023-12-17T12:03:32.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.887+0000 7f75cf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75d0101680 0x7f75d019f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:32.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.887+0000 7f75cf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75d0101680 0x7f75d019f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34070/0 (socket says 172.21.15.8:34070) 2023-12-17T12:03:32.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.887+0000 7f75cf7fe700 1 -- 172.21.15.8:0/1314954627 learned_addr learned my addr 172.21.15.8:0/1314954627 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:32.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.887+0000 7f75cffff700 1 --2- 172.21.15.8:0/1314954627 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f75d01076f0 0x7f75d0199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:32.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.887+0000 7f75ceffd700 1 --2- 172.21.15.8:0/1314954627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75d0102040 0x7f75d019fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:32.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.887+0000 7f75cf7fe700 1 -- 172.21.15.8:0/1314954627 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f75d01076f0 msgr2=0x7f75d0199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:32.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.887+0000 7f75cf7fe700 1 --2- 172.21.15.8:0/1314954627 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f75d01076f0 0x7f75d0199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:32.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.887+0000 7f75cf7fe700 1 -- 172.21.15.8:0/1314954627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75d0102040 msgr2=0x7f75d019fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:32.890 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.887+0000 7f75cf7fe700 1 --2- 172.21.15.8:0/1314954627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75d0102040 0x7f75d019fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:32.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.887+0000 7f75cf7fe700 1 -- 172.21.15.8:0/1314954627 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c00095f0 con 0x7f75d0101680 2023-12-17T12:03:32.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.887+0000 7f75ceffd700 1 --2- 172.21.15.8:0/1314954627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75d0102040 0x7f75d019fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T12:03:32.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.887+0000 7f75cf7fe700 1 --2- 172.21.15.8:0/1314954627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75d0101680 0x7f75d019f7c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f75c00036c0 tx=0x7f75c0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:32.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.888+0000 7f75ccff9700 1 -- 172.21.15.8:0/1314954627 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c001d070 con 0x7f75d0101680 2023-12-17T12:03:32.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.888+0000 7f75ccff9700 1 -- 172.21.15.8:0/1314954627 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f75c000fb00 con 0x7f75d0101680 2023-12-17T12:03:32.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.888+0000 7f75ccff9700 1 -- 172.21.15.8:0/1314954627 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75c0021b30 con 0x7f75d0101680 2023-12-17T12:03:32.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.888+0000 7f75d5b07700 1 -- 172.21.15.8:0/1314954627 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d019a510 con 0x7f75d0101680 2023-12-17T12:03:32.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.888+0000 7f75d5b07700 1 -- 172.21.15.8:0/1314954627 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75d01a67b0 con 0x7f75d0101680 2023-12-17T12:03:32.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.889+0000 7f75d5b07700 1 -- 172.21.15.8:0/1314954627 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75d0104940 con 0x7f75d0101680 2023-12-17T12:03:32.894 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.891+0000 7f75ccff9700 1 -- 172.21.15.8:0/1314954627 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f75c000fc70 con 0x7f75d0101680 2023-12-17T12:03:32.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.894+0000 7f75ccff9700 1 --2- 172.21.15.8:0/1314954627 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f75b80a1590 0x7f75b80a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:32.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.894+0000 7f75ccff9700 1 -- 172.21.15.8:0/1314954627 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f75c00ce2b0 con 0x7f75d0101680 2023-12-17T12:03:32.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.894+0000 7f75ceffd700 1 --2- 172.21.15.8:0/1314954627 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f75b80a1590 0x7f75b80a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:32.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.895+0000 7f75ceffd700 1 --2- 172.21.15.8:0/1314954627 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f75b80a1590 0x7f75b80a3a50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f75c4005950 tx=0x7f75c40058e0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:32.897 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:32.895+0000 7f75ccff9700 1 -- 172.21.15.8:0/1314954627 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f75c00977c0 con 0x7f75d0101680 2023-12-17T12:03:32.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:32 smithi100 ceph-mon[41266]: pgmap v287: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 383 B/s wr, 8 op/s; 0 B/s, 0 objects/s recovering 2023-12-17T12:03:32.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:32 smithi186 ceph-mon[41182]: pgmap v287: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 383 B/s wr, 8 op/s; 0 B/s, 0 objects/s recovering 2023-12-17T12:03:33.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:33.077+0000 7f4c2d7fa700 1 -- 172.21.15.8:0/2391648563 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f4c24005160 con 0x7f4c40075550 2023-12-17T12:03:33.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:33.078+0000 7f4c2f7fe700 1 -- 172.21.15.8:0/2391648563 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f4c3409adb0 con 0x7f4c40075550 2023-12-17T12:03:33.080 INFO:teuthology.orchestra.run.smithi008.stdout:141733920819 2023-12-17T12:03:33.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:33.080+0000 7f4c2d7fa700 1 -- 172.21.15.8:0/2391648563 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4c280a1590 msgr2=0x7f4c280a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:33.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:33.080+0000 7f4c2d7fa700 1 --2- 172.21.15.8:0/2391648563 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4c280a1590 0x7f4c280a3a50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4c30005950 tx=0x7f4c3000b410 comp rx=0 tx=0).stop 2023-12-17T12:03:33.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:33.080+0000 7f4c2d7fa700 1 -- 172.21.15.8:0/2391648563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c40075550 msgr2=0x7f4c4019e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:33.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:33.080+0000 7f4c2d7fa700 1 --2- 172.21.15.8:0/2391648563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c40075550 0x7f4c4019e510 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f4c34004730 tx=0x7f4c34004760 comp rx=0 tx=0).stop 2023-12-17T12:03:33.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:33.080+0000 7f4c2d7fa700 1 -- 172.21.15.8:0/2391648563 shutdown_connections 2023-12-17T12:03:33.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:33.080+0000 7f4c2d7fa700 1 --2- 172.21.15.8:0/2391648563 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4c280a1590 0x7f4c280a3a50 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:33.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:33.080+0000 7f4c2d7fa700 1 --2- 172.21.15.8:0/2391648563 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4c40112350 0x7f4c401a28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:33.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:33.080+0000 7f4c2d7fa700 1 --2- 172.21.15.8:0/2391648563 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4c40073d40 0x7f4c4019dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:33.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:33.080+0000 7f4c2d7fa700 1 --2- 172.21.15.8:0/2391648563 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4c40075550 0x7f4c4019e510 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:33.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:33.080+0000 7f4c2d7fa700 1 -- 172.21.15.8:0/2391648563 >> 172.21.15.8:0/2391648563 conn(0x7f4c400787c0 msgr2=0x7f4c40110f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:33.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:33.081+0000 7f4c2d7fa700 1 -- 172.21.15.8:0/2391648563 shutdown_connections 2023-12-17T12:03:33.084 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:33.081+0000 7f4c2d7fa700 1 -- 172.21.15.8:0/2391648563 wait complete. 2023-12-17T12:03:33.120 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:33.118+0000 7f75d5b07700 1 -- 172.21.15.8:0/1314954627 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f75d0102d10 con 0x7f75d0101680 2023-12-17T12:03:33.121 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:33.118+0000 7f75ccff9700 1 -- 172.21.15.8:0/1314954627 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f75c0026090 con 0x7f75d0101680 2023-12-17T12:03:33.121 INFO:teuthology.orchestra.run.smithi008.stdout:77309411389 2023-12-17T12:03:33.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:33.121+0000 7f75d5b07700 1 -- 172.21.15.8:0/1314954627 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f75b80a1590 msgr2=0x7f75b80a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:33.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:33.121+0000 7f75d5b07700 1 --2- 172.21.15.8:0/1314954627 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f75b80a1590 0x7f75b80a3a50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f75c4005950 tx=0x7f75c40058e0 comp rx=0 tx=0).stop 2023-12-17T12:03:33.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:33.121+0000 7f75d5b07700 1 -- 172.21.15.8:0/1314954627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75d0101680 msgr2=0x7f75d019f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:33.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:33.121+0000 7f75d5b07700 1 --2- 172.21.15.8:0/1314954627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75d0101680 0x7f75d019f7c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f75c00036c0 tx=0x7f75c0004730 comp rx=0 tx=0).stop 2023-12-17T12:03:33.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:33.121+0000 7f75d5b07700 1 -- 172.21.15.8:0/1314954627 shutdown_connections 2023-12-17T12:03:33.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:33.121+0000 7f75d5b07700 1 --2- 172.21.15.8:0/1314954627 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f75b80a1590 0x7f75b80a3a50 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:33.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:33.121+0000 7f75d5b07700 1 --2- 172.21.15.8:0/1314954627 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f75d01076f0 0x7f75d0199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:33.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:33.121+0000 7f75d5b07700 1 --2- 172.21.15.8:0/1314954627 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f75d0101680 0x7f75d019f7c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:33.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:33.121+0000 7f75d5b07700 1 --2- 172.21.15.8:0/1314954627 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f75d0102040 0x7f75d019fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:33.124 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:33.121+0000 7f75d5b07700 1 -- 172.21.15.8:0/1314954627 >> 172.21.15.8:0/1314954627 conn(0x7f75d00787c0 msgr2=0x7f75d010caf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:33.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:33.121+0000 7f75d5b07700 1 -- 172.21.15.8:0/1314954627 shutdown_connections 2023-12-17T12:03:33.125 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:33.122+0000 7f75d5b07700 1 -- 172.21.15.8:0/1314954627 wait complete. 2023-12-17T12:03:33.629 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920818 got 141733920819 for osd.4 2023-12-17T12:03:33.629 DEBUG:teuthology.parallel:result is None 2023-12-17T12:03:33.678 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:33 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/2923533768' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-12-17T12:03:33.678 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:33 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/2391648563' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-17T12:03:33.678 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:33 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/1314954627' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-17T12:03:33.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:33 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/2923533768' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-12-17T12:03:33.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:33 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/2391648563' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-17T12:03:33.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:33 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/1314954627' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-17T12:03:33.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:33 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/2923533768' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-12-17T12:03:33.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:33 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/2391648563' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-12-17T12:03:33.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:33 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/1314954627' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-12-17T12:03:34.182 INFO:tasks.cephadm.ceph_manager.ceph:need seq 214748364835 got 214748364838 for osd.7 2023-12-17T12:03:34.182 DEBUG:teuthology.parallel:result is None 2023-12-17T12:03:34.558 INFO:tasks.cephadm.ceph_manager.ceph:need seq 249108103198 got 249108103200 for osd.8 2023-12-17T12:03:34.558 DEBUG:teuthology.parallel:result is None 2023-12-17T12:03:34.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:34 smithi008 ceph-mon[36830]: pgmap v288: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 383 B/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2023-12-17T12:03:34.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:34 smithi100 ceph-mon[41266]: pgmap v288: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 383 B/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2023-12-17T12:03:34.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:34 smithi186 ceph-mon[41182]: pgmap v288: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 383 B/s wr, 9 op/s; 0 B/s, 0 objects/s recovering 2023-12-17T12:03:35.055 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:03:35.094 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411387 got 77309411389 for osd.2 2023-12-17T12:03:35.094 DEBUG:teuthology.parallel:result is None 2023-12-17T12:03:35.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.255+0000 7fe5c5a30700 1 -- 172.21.15.8:0/309978057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5c0112350 msgr2=0x7fe5c0114780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:35.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.255+0000 7fe5c5a30700 1 --2- 172.21.15.8:0/309978057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5c0112350 0x7fe5c0114780 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fe5b800b0a0 tx=0x7fe5b800b3b0 comp rx=0 tx=0).stop 2023-12-17T12:03:35.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.255+0000 7fe5c5a30700 1 -- 172.21.15.8:0/309978057 shutdown_connections 2023-12-17T12:03:35.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.255+0000 7fe5c5a30700 1 --2- 172.21.15.8:0/309978057 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5c0112350 0x7fe5c0114780 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:35.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.255+0000 7fe5c5a30700 1 --2- 172.21.15.8:0/309978057 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5c0075550 0x7fe5c0073800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:35.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.255+0000 7fe5c5a30700 1 --2- 172.21.15.8:0/309978057 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5c0073d40 0x7fe5c00741c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:35.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.255+0000 7fe5c5a30700 1 -- 172.21.15.8:0/309978057 >> 172.21.15.8:0/309978057 conn(0x7fe5c00787c0 msgr2=0x7fe5c0078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:35.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.255+0000 7fe5c5a30700 1 -- 172.21.15.8:0/309978057 shutdown_connections 2023-12-17T12:03:35.258 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.255+0000 7fe5c5a30700 1 -- 172.21.15.8:0/309978057 wait complete. 2023-12-17T12:03:35.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.256+0000 7fe5c5a30700 1 Processor -- start 2023-12-17T12:03:35.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.257+0000 7fe5c5a30700 1 -- start start 2023-12-17T12:03:35.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.257+0000 7fe5c5a30700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5c0073d40 0x7fe5c019e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:35.259 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.257+0000 7fe5c5a30700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5c0075550 0x7fe5c019e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:35.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.257+0000 7fe5c5a30700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5c0112350 0x7fe5c01a2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:35.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.257+0000 7fe5c5a30700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c01a2fa0 con 0x7fe5c0112350 2023-12-17T12:03:35.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.257+0000 7fe5c5a30700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c01a3110 con 0x7fe5c0073d40 2023-12-17T12:03:35.260 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.257+0000 7fe5c5a30700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c01a32d0 con 0x7fe5c0075550 2023-12-17T12:03:35.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.257+0000 7fe5bf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5c0112350 0x7fe5c01a2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:35.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.257+0000 7fe5bf7fe700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5c0112350 0x7fe5c01a2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34084/0 (socket says 172.21.15.8:34084) 2023-12-17T12:03:35.261 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.257+0000 7fe5bf7fe700 1 -- 172.21.15.8:0/164974327 learned_addr learned my addr 172.21.15.8:0/164974327 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:35.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.258+0000 7fe5beffd700 1 --2- 172.21.15.8:0/164974327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5c0073d40 0x7fe5c019e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:35.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.258+0000 7fe5be7fc700 1 --2- 172.21.15.8:0/164974327 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5c0075550 0x7fe5c019e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:35.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.258+0000 7fe5bf7fe700 1 -- 172.21.15.8:0/164974327 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5c0075550 msgr2=0x7fe5c019e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:35.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.258+0000 7fe5bf7fe700 1 --2- 172.21.15.8:0/164974327 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5c0075550 0x7fe5c019e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:35.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.258+0000 7fe5bf7fe700 1 -- 172.21.15.8:0/164974327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5c0073d40 msgr2=0x7fe5c019e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:35.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.258+0000 7fe5bf7fe700 1 --2- 172.21.15.8:0/164974327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5c0073d40 0x7fe5c019e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:35.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.258+0000 7fe5bf7fe700 1 -- 172.21.15.8:0/164974327 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b8009d00 con 0x7fe5c0112350 2023-12-17T12:03:35.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.258+0000 7fe5be7fc700 1 --2- 172.21.15.8:0/164974327 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5c0075550 0x7fe5c019e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T12:03:35.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.258+0000 7fe5beffd700 1 --2- 172.21.15.8:0/164974327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5c0073d40 0x7fe5c019e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T12:03:35.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.258+0000 7fe5bf7fe700 1 --2- 172.21.15.8:0/164974327 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5c0112350 0x7fe5c01a2990 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe5b800b070 tx=0x7fe5b8009480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:35.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.259+0000 7fe5c4a2e700 1 -- 172.21.15.8:0/164974327 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b800e040 con 0x7fe5c0112350 2023-12-17T12:03:35.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.259+0000 7fe5c4a2e700 1 -- 172.21.15.8:0/164974327 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe5b8003e90 con 0x7fe5c0112350 2023-12-17T12:03:35.262 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.259+0000 7fe5c5a30700 1 -- 172.21.15.8:0/164974327 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5c01a3550 con 0x7fe5c0112350 2023-12-17T12:03:35.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.259+0000 7fe5c4a2e700 1 -- 172.21.15.8:0/164974327 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b801b450 con 0x7fe5c0112350 2023-12-17T12:03:35.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.259+0000 7fe5c5a30700 1 -- 172.21.15.8:0/164974327 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c01aae10 con 0x7fe5c0112350 2023-12-17T12:03:35.263 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.260+0000 7fe5c5a30700 1 -- 172.21.15.8:0/164974327 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5c0074e90 con 0x7fe5c0112350 2023-12-17T12:03:35.265 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.262+0000 7fe5c4a2e700 1 -- 172.21.15.8:0/164974327 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7fe5b801d710 con 0x7fe5c0112350 2023-12-17T12:03:35.267 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.264+0000 7fe5c4a2e700 1 --2- 172.21.15.8:0/164974327 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fe5a80a1510 0x7fe5a80a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:35.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.265+0000 7fe5c4a2e700 1 -- 172.21.15.8:0/164974327 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fe5b80ce1a0 con 0x7fe5c0112350 2023-12-17T12:03:35.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.265+0000 7fe5beffd700 1 --2- 172.21.15.8:0/164974327 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fe5a80a1510 0x7fe5a80a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:35.268 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.265+0000 7fe5beffd700 1 --2- 172.21.15.8:0/164974327 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fe5a80a1510 0x7fe5a80a39d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0011490 tx=0x7fe5b0009260 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:35.272 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.269+0000 7fe5c4a2e700 1 -- 172.21.15.8:0/164974327 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe5b80976b0 con 0x7fe5c0112350 2023-12-17T12:03:35.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.503+0000 7fe5c5a30700 1 -- 172.21.15.8:0/164974327 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe5c019f3b0 con 0x7fe5c0112350 2023-12-17T12:03:35.506 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.504+0000 7fe5c4a2e700 1 -- 172.21.15.8:0/164974327 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe5b809acd0 con 0x7fe5c0112350 2023-12-17T12:03:35.507 INFO:teuthology.orchestra.run.smithi008.stdout:107374182456 2023-12-17T12:03:35.509 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.507+0000 7fe5c5a30700 1 -- 172.21.15.8:0/164974327 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fe5a80a1510 msgr2=0x7fe5a80a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:35.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.507+0000 7fe5c5a30700 1 --2- 172.21.15.8:0/164974327 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fe5a80a1510 0x7fe5a80a39d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe5b0011490 tx=0x7fe5b0009260 comp rx=0 tx=0).stop 2023-12-17T12:03:35.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.507+0000 7fe5c5a30700 1 -- 172.21.15.8:0/164974327 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5c0112350 msgr2=0x7fe5c01a2990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:35.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.507+0000 7fe5c5a30700 1 --2- 172.21.15.8:0/164974327 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5c0112350 0x7fe5c01a2990 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe5b800b070 tx=0x7fe5b8009480 comp rx=0 tx=0).stop 2023-12-17T12:03:35.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.507+0000 7fe5c5a30700 1 -- 172.21.15.8:0/164974327 shutdown_connections 2023-12-17T12:03:35.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.507+0000 7fe5c5a30700 1 --2- 172.21.15.8:0/164974327 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fe5a80a1510 0x7fe5a80a39d0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:35.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.507+0000 7fe5c5a30700 1 --2- 172.21.15.8:0/164974327 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe5c0112350 0x7fe5c01a2990 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:35.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.507+0000 7fe5c5a30700 1 --2- 172.21.15.8:0/164974327 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe5c0073d40 0x7fe5c019e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:35.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.507+0000 7fe5c5a30700 1 --2- 172.21.15.8:0/164974327 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe5c0075550 0x7fe5c019e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:35.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.507+0000 7fe5c5a30700 1 -- 172.21.15.8:0/164974327 >> 172.21.15.8:0/164974327 conn(0x7fe5c00787c0 msgr2=0x7fe5c0110f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:35.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.507+0000 7fe5c5a30700 1 -- 172.21.15.8:0/164974327 shutdown_connections 2023-12-17T12:03:35.510 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.507+0000 7fe5c5a30700 1 -- 172.21.15.8:0/164974327 wait complete. 2023-12-17T12:03:35.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.863+0000 7f5bd6497700 1 -- 172.21.15.8:0/903325282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bd0102040 msgr2=0x7f5bd010e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:35.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.863+0000 7f5bd6497700 1 --2- 172.21.15.8:0/903325282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bd0102040 0x7f5bd010e430 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5bc800b0a0 tx=0x7f5bc800b3b0 comp rx=0 tx=0).stop 2023-12-17T12:03:35.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.863+0000 7f5bd6497700 1 -- 172.21.15.8:0/903325282 shutdown_connections 2023-12-17T12:03:35.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.863+0000 7f5bd6497700 1 --2- 172.21.15.8:0/903325282 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bd0102040 0x7f5bd010e430 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:35.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.863+0000 7f5bd6497700 1 --2- 172.21.15.8:0/903325282 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bd01076f0 0x7f5bd0107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:35.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.863+0000 7f5bd6497700 1 --2- 172.21.15.8:0/903325282 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5bd0101680 0x7f5bd0101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:35.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.863+0000 7f5bd6497700 1 -- 172.21.15.8:0/903325282 >> 172.21.15.8:0/903325282 conn(0x7f5bd00787c0 msgr2=0x7f5bd0078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:35.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.863+0000 7f5bd6497700 1 -- 172.21.15.8:0/903325282 shutdown_connections 2023-12-17T12:03:35.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.863+0000 7f5bd6497700 1 -- 172.21.15.8:0/903325282 wait complete. 2023-12-17T12:03:35.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.864+0000 7f5bd6497700 1 Processor -- start 2023-12-17T12:03:35.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.864+0000 7f5bd6497700 1 -- start start 2023-12-17T12:03:35.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.865+0000 7f5bd6497700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bd0101680 0x7f5bd019f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:35.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.865+0000 7f5bd6497700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5bd0102040 0x7f5bd019fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:35.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.865+0000 7f5bd6497700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bd01076f0 0x7f5bd0199aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:35.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.865+0000 7f5bd6497700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd019a100 con 0x7f5bd01076f0 2023-12-17T12:03:35.869 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.865+0000 7f5bd6497700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd019a270 con 0x7f5bd0101680 2023-12-17T12:03:35.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.865+0000 7f5bd6497700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bd019a430 con 0x7f5bd0102040 2023-12-17T12:03:35.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.865+0000 7f5bd4a34700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bd01076f0 0x7f5bd0199aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:35.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.865+0000 7f5bd4a34700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bd01076f0 0x7f5bd0199aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34104/0 (socket says 172.21.15.8:34104) 2023-12-17T12:03:35.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.865+0000 7f5bcffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bd0101680 0x7f5bd019f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:35.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.865+0000 7f5bd4a34700 1 -- 172.21.15.8:0/4143913427 learned_addr learned my addr 172.21.15.8:0/4143913427 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:35.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.865+0000 7f5bcf7fe700 1 --2- 172.21.15.8:0/4143913427 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5bd0102040 0x7f5bd019fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:35.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.865+0000 7f5bd4a34700 1 -- 172.21.15.8:0/4143913427 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5bd0102040 msgr2=0x7f5bd019fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:35.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.865+0000 7f5bd4a34700 1 --2- 172.21.15.8:0/4143913427 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5bd0102040 0x7f5bd019fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:35.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.865+0000 7f5bd4a34700 1 -- 172.21.15.8:0/4143913427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bd0101680 msgr2=0x7f5bd019f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:35.870 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.865+0000 7f5bd4a34700 1 --2- 172.21.15.8:0/4143913427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bd0101680 0x7f5bd019f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:35.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.865+0000 7f5bd4a34700 1 -- 172.21.15.8:0/4143913427 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc8009d00 con 0x7f5bd01076f0 2023-12-17T12:03:35.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.866+0000 7f5bd4a34700 1 --2- 172.21.15.8:0/4143913427 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bd01076f0 0x7f5bd0199aa0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5bc800b070 tx=0x7f5bc800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:35.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.866+0000 7f5bcd7fa700 1 -- 172.21.15.8:0/4143913427 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc800e040 con 0x7f5bd01076f0 2023-12-17T12:03:35.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.866+0000 7f5bcd7fa700 1 -- 172.21.15.8:0/4143913427 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5bc8007e20 con 0x7f5bd01076f0 2023-12-17T12:03:35.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.866+0000 7f5bd6497700 1 -- 172.21.15.8:0/4143913427 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bd019a6b0 con 0x7f5bd01076f0 2023-12-17T12:03:35.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.866+0000 7f5bcd7fa700 1 -- 172.21.15.8:0/4143913427 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bc8005040 con 0x7f5bd01076f0 2023-12-17T12:03:35.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.866+0000 7f5bd6497700 1 -- 172.21.15.8:0/4143913427 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bd01a6860 con 0x7f5bd01076f0 2023-12-17T12:03:35.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.867+0000 7f5bd6497700 1 -- 172.21.15.8:0/4143913427 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bd0102d10 con 0x7f5bd01076f0 2023-12-17T12:03:35.872 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.869+0000 7f5bcd7fa700 1 -- 172.21.15.8:0/4143913427 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f5bc801d480 con 0x7f5bd01076f0 2023-12-17T12:03:35.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.870+0000 7f5bcd7fa700 1 --2- 172.21.15.8:0/4143913427 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f5bb80a1590 0x7f5bb80a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:35.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.871+0000 7f5bcd7fa700 1 -- 172.21.15.8:0/4143913427 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f5bc80cdd60 con 0x7f5bd01076f0 2023-12-17T12:03:35.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.871+0000 7f5bcffff700 1 --2- 172.21.15.8:0/4143913427 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f5bb80a1590 0x7f5bb80a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:35.874 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.871+0000 7f5bcffff700 1 --2- 172.21.15.8:0/4143913427 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f5bb80a1590 0x7f5bb80a3a50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0009c60 tx=0x7f5bc0009260 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:35.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:35.874+0000 7f5bcd7fa700 1 -- 172.21.15.8:0/4143913427 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f5bc8097270 con 0x7f5bd01076f0 2023-12-17T12:03:36.067 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.064+0000 7fec4d385700 1 -- 172.21.15.8:0/2727451581 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec48102040 msgr2=0x7fec4810e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:36.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.064+0000 7fec4d385700 1 --2- 172.21.15.8:0/2727451581 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec48102040 0x7fec4810e430 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fec40009f90 tx=0x7fec4000b330 comp rx=0 tx=0).stop 2023-12-17T12:03:36.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.064+0000 7fec4d385700 1 -- 172.21.15.8:0/2727451581 shutdown_connections 2023-12-17T12:03:36.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.064+0000 7fec4d385700 1 --2- 172.21.15.8:0/2727451581 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec48102040 0x7fec4810e430 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:36.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.064+0000 7fec4d385700 1 --2- 172.21.15.8:0/2727451581 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fec481076f0 0x7fec48107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:36.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.064+0000 7fec4d385700 1 --2- 172.21.15.8:0/2727451581 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec48101680 0x7fec48101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:36.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.064+0000 7fec4d385700 1 -- 172.21.15.8:0/2727451581 >> 172.21.15.8:0/2727451581 conn(0x7fec480787c0 msgr2=0x7fec48078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:36.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.065+0000 7fec4d385700 1 -- 172.21.15.8:0/2727451581 shutdown_connections 2023-12-17T12:03:36.068 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.065+0000 7fec4d385700 1 -- 172.21.15.8:0/2727451581 wait complete. 2023-12-17T12:03:36.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.066+0000 7fec4d385700 1 Processor -- start 2023-12-17T12:03:36.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.066+0000 7fec4d385700 1 -- start start 2023-12-17T12:03:36.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.066+0000 7fec4d385700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec48101680 0x7fec4819f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:36.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.066+0000 7fec4d385700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec48102040 0x7fec4819fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:36.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.066+0000 7fec4d385700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fec481076f0 0x7fec481999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:36.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.066+0000 7fec4d385700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4819a050 con 0x7fec48101680 2023-12-17T12:03:36.071 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.066+0000 7fec4d385700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4819a1c0 con 0x7fec48102040 2023-12-17T12:03:36.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.066+0000 7fec4d385700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec4819a380 con 0x7fec481076f0 2023-12-17T12:03:36.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.067+0000 7fec46ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec48101680 0x7fec4819f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:36.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.067+0000 7fec46ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec48101680 0x7fec4819f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34118/0 (socket says 172.21.15.8:34118) 2023-12-17T12:03:36.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.067+0000 7fec46ffd700 1 -- 172.21.15.8:0/1692689281 learned_addr learned my addr 172.21.15.8:0/1692689281 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:36.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.067+0000 7fec467fc700 1 --2- 172.21.15.8:0/1692689281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec48102040 0x7fec4819fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:36.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.067+0000 7fec477fe700 1 --2- 172.21.15.8:0/1692689281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fec481076f0 0x7fec481999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:36.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.067+0000 7fec46ffd700 1 -- 172.21.15.8:0/1692689281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fec481076f0 msgr2=0x7fec481999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:36.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.067+0000 7fec46ffd700 1 --2- 172.21.15.8:0/1692689281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fec481076f0 0x7fec481999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:36.072 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.067+0000 7fec46ffd700 1 -- 172.21.15.8:0/1692689281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec48102040 msgr2=0x7fec4819fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:36.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.067+0000 7fec46ffd700 1 --2- 172.21.15.8:0/1692689281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec48102040 0x7fec4819fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:36.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.067+0000 7fec46ffd700 1 -- 172.21.15.8:0/1692689281 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec40009c40 con 0x7fec48101680 2023-12-17T12:03:36.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.067+0000 7fec46ffd700 1 --2- 172.21.15.8:0/1692689281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec48101680 0x7fec4819f8b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fec3800e9c0 tx=0x7fec3800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:36.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.067+0000 7fec2ffff700 1 -- 172.21.15.8:0/1692689281 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3800cbd0 con 0x7fec48101680 2023-12-17T12:03:36.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.068+0000 7fec2ffff700 1 -- 172.21.15.8:0/1692689281 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fec3800eeb0 con 0x7fec48101680 2023-12-17T12:03:36.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.068+0000 7fec4d385700 1 -- 172.21.15.8:0/1692689281 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec4819a660 con 0x7fec48101680 2023-12-17T12:03:36.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.068+0000 7fec2ffff700 1 -- 172.21.15.8:0/1692689281 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec38005410 con 0x7fec48101680 2023-12-17T12:03:36.073 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.068+0000 7fec4d385700 1 -- 172.21.15.8:0/1692689281 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec481a68a0 con 0x7fec48101680 2023-12-17T12:03:36.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.069+0000 7fec4d385700 1 -- 172.21.15.8:0/1692689281 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec48102d10 con 0x7fec48101680 2023-12-17T12:03:36.074 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.071+0000 7fec2ffff700 1 -- 172.21.15.8:0/1692689281 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7fec380055b0 con 0x7fec48101680 2023-12-17T12:03:36.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.073+0000 7fec2ffff700 1 --2- 172.21.15.8:0/1692689281 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fec300a1590 0x7fec300a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:36.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.073+0000 7fec2ffff700 1 -- 172.21.15.8:0/1692689281 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fec38014070 con 0x7fec48101680 2023-12-17T12:03:36.076 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.074+0000 7fec467fc700 1 --2- 172.21.15.8:0/1692689281 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fec300a1590 0x7fec300a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:36.077 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.074+0000 7fec467fc700 1 --2- 172.21.15.8:0/1692689281 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fec300a1590 0x7fec300a3a50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fec4819abb0 tx=0x7fec3c00b410 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:36.080 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.077+0000 7fec2ffff700 1 -- 172.21.15.8:0/1692689281 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fec380965d0 con 0x7fec48101680 2023-12-17T12:03:36.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.094+0000 7f5bd6497700 1 -- 172.21.15.8:0/4143913427 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5bd004f290 con 0x7f5bd01076f0 2023-12-17T12:03:36.098 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.095+0000 7f5bcd7fa700 1 -- 172.21.15.8:0/4143913427 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5bc809a890 con 0x7f5bd01076f0 2023-12-17T12:03:36.098 INFO:teuthology.orchestra.run.smithi008.stdout:34359738439 2023-12-17T12:03:36.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.097+0000 7f5bd6497700 1 -- 172.21.15.8:0/4143913427 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f5bb80a1590 msgr2=0x7f5bb80a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:36.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.097+0000 7f5bd6497700 1 --2- 172.21.15.8:0/4143913427 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f5bb80a1590 0x7f5bb80a3a50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0009c60 tx=0x7f5bc0009260 comp rx=0 tx=0).stop 2023-12-17T12:03:36.100 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.097+0000 7f5bd6497700 1 -- 172.21.15.8:0/4143913427 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bd01076f0 msgr2=0x7f5bd0199aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:36.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.097+0000 7f5bd6497700 1 --2- 172.21.15.8:0/4143913427 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bd01076f0 0x7f5bd0199aa0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f5bc800b070 tx=0x7f5bc800be20 comp rx=0 tx=0).stop 2023-12-17T12:03:36.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.097+0000 7f5bd6497700 1 -- 172.21.15.8:0/4143913427 shutdown_connections 2023-12-17T12:03:36.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.097+0000 7f5bd6497700 1 --2- 172.21.15.8:0/4143913427 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f5bb80a1590 0x7f5bb80a3a50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:36.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.097+0000 7f5bd6497700 1 --2- 172.21.15.8:0/4143913427 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5bd01076f0 0x7f5bd0199aa0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:36.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.097+0000 7f5bd6497700 1 --2- 172.21.15.8:0/4143913427 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5bd0101680 0x7f5bd019f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:36.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.097+0000 7f5bd6497700 1 --2- 172.21.15.8:0/4143913427 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5bd0102040 0x7f5bd019fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:36.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.097+0000 7f5bd6497700 1 -- 172.21.15.8:0/4143913427 >> 172.21.15.8:0/4143913427 conn(0x7f5bd00787c0 msgr2=0x7f5bd0100160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:36.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.097+0000 7f5bd6497700 1 -- 172.21.15.8:0/4143913427 shutdown_connections 2023-12-17T12:03:36.101 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.097+0000 7f5bd6497700 1 -- 172.21.15.8:0/4143913427 wait complete. 2023-12-17T12:03:36.278 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:35 smithi008 ceph-mon[36830]: pgmap v289: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2023-12-17T12:03:36.279 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:35 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/164974327' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-17T12:03:36.282 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182454 got 107374182456 for osd.3 2023-12-17T12:03:36.282 DEBUG:teuthology.parallel:result is None 2023-12-17T12:03:36.324 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.322+0000 7fec4d385700 1 -- 172.21.15.8:0/1692689281 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7fec4804f290 con 0x7fec48101680 2023-12-17T12:03:36.325 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.322+0000 7fec2ffff700 1 -- 172.21.15.8:0/1692689281 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7fec38099bf0 con 0x7fec48101680 2023-12-17T12:03:36.325 INFO:teuthology.orchestra.run.smithi008.stdout:300647710746 2023-12-17T12:03:36.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.325+0000 7fec4d385700 1 -- 172.21.15.8:0/1692689281 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fec300a1590 msgr2=0x7fec300a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:36.327 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.325+0000 7fec4d385700 1 --2- 172.21.15.8:0/1692689281 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fec300a1590 0x7fec300a3a50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fec4819abb0 tx=0x7fec3c00b410 comp rx=0 tx=0).stop 2023-12-17T12:03:36.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.325+0000 7fec4d385700 1 -- 172.21.15.8:0/1692689281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec48101680 msgr2=0x7fec4819f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:36.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.325+0000 7fec4d385700 1 --2- 172.21.15.8:0/1692689281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec48101680 0x7fec4819f8b0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fec3800e9c0 tx=0x7fec3800ecd0 comp rx=0 tx=0).stop 2023-12-17T12:03:36.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.325+0000 7fec4d385700 1 -- 172.21.15.8:0/1692689281 shutdown_connections 2023-12-17T12:03:36.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.325+0000 7fec4d385700 1 --2- 172.21.15.8:0/1692689281 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fec300a1590 0x7fec300a3a50 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:36.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.325+0000 7fec4d385700 1 --2- 172.21.15.8:0/1692689281 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fec481076f0 0x7fec481999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:36.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.325+0000 7fec4d385700 1 --2- 172.21.15.8:0/1692689281 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec48101680 0x7fec4819f8b0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:36.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.325+0000 7fec4d385700 1 --2- 172.21.15.8:0/1692689281 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec48102040 0x7fec4819fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:36.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.325+0000 7fec4d385700 1 -- 172.21.15.8:0/1692689281 >> 172.21.15.8:0/1692689281 conn(0x7fec480787c0 msgr2=0x7fec481000d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:36.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.325+0000 7fec4d385700 1 -- 172.21.15.8:0/1692689281 shutdown_connections 2023-12-17T12:03:36.328 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:36.325+0000 7fec4d385700 1 -- 172.21.15.8:0/1692689281 wait complete. 2023-12-17T12:03:36.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:35 smithi100 ceph-mon[41266]: pgmap v289: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2023-12-17T12:03:36.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:35 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/164974327' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-17T12:03:36.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:35 smithi186 ceph-mon[41182]: pgmap v289: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2023-12-17T12:03:36.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:35 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/164974327' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-12-17T12:03:36.811 INFO:tasks.cephadm.ceph_manager.ceph:need seq 300647710744 got 300647710746 for osd.10 2023-12-17T12:03:36.811 DEBUG:teuthology.parallel:result is None 2023-12-17T12:03:37.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.169+0000 7fec74fd3700 1 -- 172.21.15.8:0/1554836235 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec70101fe0 msgr2=0x7fec7010e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:37.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.169+0000 7fec74fd3700 1 --2- 172.21.15.8:0/1554836235 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec70101fe0 0x7fec7010e460 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fec6800b0a0 tx=0x7fec6800b3b0 comp rx=0 tx=0).stop 2023-12-17T12:03:37.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.169+0000 7fec74fd3700 1 -- 172.21.15.8:0/1554836235 shutdown_connections 2023-12-17T12:03:37.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.169+0000 7fec74fd3700 1 --2- 172.21.15.8:0/1554836235 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec70101fe0 0x7fec7010e460 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:37.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.169+0000 7fec74fd3700 1 --2- 172.21.15.8:0/1554836235 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fec701065a0 0x7fec70106980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:37.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.169+0000 7fec74fd3700 1 --2- 172.21.15.8:0/1554836235 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec70101620 0x7fec70101aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:37.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.169+0000 7fec74fd3700 1 -- 172.21.15.8:0/1554836235 >> 172.21.15.8:0/1554836235 conn(0x7fec70078730 msgr2=0x7fec70078b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:37.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.169+0000 7fec74fd3700 1 -- 172.21.15.8:0/1554836235 shutdown_connections 2023-12-17T12:03:37.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.169+0000 7fec74fd3700 1 -- 172.21.15.8:0/1554836235 wait complete. 2023-12-17T12:03:37.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.170+0000 7fec74fd3700 1 Processor -- start 2023-12-17T12:03:37.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.170+0000 7fec74fd3700 1 -- start start 2023-12-17T12:03:37.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.171+0000 7fec74fd3700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec70101620 0x7fec7019f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:37.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.171+0000 7fec74fd3700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fec70101fe0 0x7fec7019fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:37.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.171+0000 7fec74fd3700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec701065a0 0x7fec701999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:37.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.171+0000 7fec74fd3700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7019a030 con 0x7fec70101620 2023-12-17T12:03:37.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.171+0000 7fec74fd3700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7019a1a0 con 0x7fec701065a0 2023-12-17T12:03:37.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.171+0000 7fec74fd3700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7019a360 con 0x7fec70101fe0 2023-12-17T12:03:37.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.171+0000 7fec6e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec70101620 0x7fec7019f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:37.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.171+0000 7fec6e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec70101620 0x7fec7019f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34142/0 (socket says 172.21.15.8:34142) 2023-12-17T12:03:37.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.171+0000 7fec6e59c700 1 -- 172.21.15.8:0/3761605757 learned_addr learned my addr 172.21.15.8:0/3761605757 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:37.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.171+0000 7fec6dd9b700 1 --2- 172.21.15.8:0/3761605757 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fec70101fe0 0x7fec7019fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:37.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.171+0000 7fec6ed9d700 1 --2- 172.21.15.8:0/3761605757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec701065a0 0x7fec701999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:37.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.171+0000 7fec6e59c700 1 -- 172.21.15.8:0/3761605757 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fec70101fe0 msgr2=0x7fec7019fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:37.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.171+0000 7fec6e59c700 1 --2- 172.21.15.8:0/3761605757 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fec70101fe0 0x7fec7019fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:37.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.171+0000 7fec6e59c700 1 -- 172.21.15.8:0/3761605757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec701065a0 msgr2=0x7fec701999d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:37.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.171+0000 7fec6e59c700 1 --2- 172.21.15.8:0/3761605757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec701065a0 0x7fec701999d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:37.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.171+0000 7fec6e59c700 1 -- 172.21.15.8:0/3761605757 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec68009d00 con 0x7fec70101620 2023-12-17T12:03:37.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.171+0000 7fec6dd9b700 1 --2- 172.21.15.8:0/3761605757 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fec70101fe0 0x7fec7019fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T12:03:37.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.172+0000 7fec6e59c700 1 --2- 172.21.15.8:0/3761605757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec70101620 0x7fec7019f890 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fec6000d980 tx=0x7fec6000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:37.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.172+0000 7fec5f7fe700 1 -- 172.21.15.8:0/3761605757 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec6000de60 con 0x7fec70101620 2023-12-17T12:03:37.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.172+0000 7fec5f7fe700 1 -- 172.21.15.8:0/3761605757 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fec600044b0 con 0x7fec70101620 2023-12-17T12:03:37.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.172+0000 7fec5f7fe700 1 -- 172.21.15.8:0/3761605757 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec60003b40 con 0x7fec70101620 2023-12-17T12:03:37.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.172+0000 7fec74fd3700 1 -- 172.21.15.8:0/3761605757 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec7019a640 con 0x7fec70101620 2023-12-17T12:03:37.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.172+0000 7fec74fd3700 1 -- 172.21.15.8:0/3761605757 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec701a6880 con 0x7fec70101620 2023-12-17T12:03:37.177 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.173+0000 7fec74fd3700 1 -- 172.21.15.8:0/3761605757 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec70102ca0 con 0x7fec70101620 2023-12-17T12:03:37.178 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.175+0000 7fec5f7fe700 1 -- 172.21.15.8:0/3761605757 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7fec60003ca0 con 0x7fec70101620 2023-12-17T12:03:37.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.176+0000 7fec5f7fe700 1 --2- 172.21.15.8:0/3761605757 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fec580a1590 0x7fec580a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:37.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.176+0000 7fec5f7fe700 1 -- 172.21.15.8:0/3761605757 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fec600ccb60 con 0x7fec70101620 2023-12-17T12:03:37.179 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.177+0000 7fec6dd9b700 1 --2- 172.21.15.8:0/3761605757 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fec580a1590 0x7fec580a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:37.180 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.177+0000 7fec6dd9b700 1 --2- 172.21.15.8:0/3761605757 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fec580a1590 0x7fec580a3a50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fec64005fd0 tx=0x7fec64005dc0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:37.183 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.181+0000 7fec5f7fe700 1 -- 172.21.15.8:0/3761605757 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fec60096040 con 0x7fec70101620 2023-12-17T12:03:37.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:36 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/4143913427' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-17T12:03:37.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:36 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/1692689281' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-12-17T12:03:37.321 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738436 got 34359738439 for osd.0 2023-12-17T12:03:37.322 DEBUG:teuthology.parallel:result is None 2023-12-17T12:03:37.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.400+0000 7fec74fd3700 1 -- 172.21.15.8:0/3761605757 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fec70111460 con 0x7fec70101620 2023-12-17T12:03:37.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.400+0000 7fec5f7fe700 1 -- 172.21.15.8:0/3761605757 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fec60009940 con 0x7fec70101620 2023-12-17T12:03:37.403 INFO:teuthology.orchestra.run.smithi008.stdout:163208757296 2023-12-17T12:03:37.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.402+0000 7fec74fd3700 1 -- 172.21.15.8:0/3761605757 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fec580a1590 msgr2=0x7fec580a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:37.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.402+0000 7fec74fd3700 1 --2- 172.21.15.8:0/3761605757 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fec580a1590 0x7fec580a3a50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fec64005fd0 tx=0x7fec64005dc0 comp rx=0 tx=0).stop 2023-12-17T12:03:37.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.402+0000 7fec74fd3700 1 -- 172.21.15.8:0/3761605757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec70101620 msgr2=0x7fec7019f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:37.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.402+0000 7fec74fd3700 1 --2- 172.21.15.8:0/3761605757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec70101620 0x7fec7019f890 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fec6000d980 tx=0x7fec6000dd40 comp rx=0 tx=0).stop 2023-12-17T12:03:37.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.403+0000 7fec74fd3700 1 -- 172.21.15.8:0/3761605757 shutdown_connections 2023-12-17T12:03:37.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.403+0000 7fec74fd3700 1 --2- 172.21.15.8:0/3761605757 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fec580a1590 0x7fec580a3a50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:37.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.403+0000 7fec74fd3700 1 --2- 172.21.15.8:0/3761605757 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fec701065a0 0x7fec701999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:37.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.403+0000 7fec74fd3700 1 --2- 172.21.15.8:0/3761605757 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fec70101620 0x7fec7019f890 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:37.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.403+0000 7fec74fd3700 1 --2- 172.21.15.8:0/3761605757 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fec70101fe0 0x7fec7019fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:37.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.403+0000 7fec74fd3700 1 -- 172.21.15.8:0/3761605757 >> 172.21.15.8:0/3761605757 conn(0x7fec70078730 msgr2=0x7fec7010c820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:37.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.403+0000 7fec74fd3700 1 -- 172.21.15.8:0/3761605757 shutdown_connections 2023-12-17T12:03:37.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:37.403+0000 7fec74fd3700 1 -- 172.21.15.8:0/3761605757 wait complete. 2023-12-17T12:03:37.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:36 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/4143913427' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-17T12:03:37.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:36 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/1692689281' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-12-17T12:03:37.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:37 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/4143913427' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-12-17T12:03:37.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:37 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/1692689281' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-12-17T12:03:37.793 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757293 got 163208757296 for osd.5 2023-12-17T12:03:37.793 DEBUG:teuthology.parallel:result is None 2023-12-17T12:03:37.793 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-12-17T12:03:37.794 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph pg dump --format=json 2023-12-17T12:03:38.220 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:03:38.377 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:38 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/3761605757' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-17T12:03:38.377 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:38 smithi008 ceph-mon[36830]: pgmap v290: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2023-12-17T12:03:38.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:38 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/3761605757' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-17T12:03:38.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:38 smithi100 ceph-mon[41266]: pgmap v290: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2023-12-17T12:03:38.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:38 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/3761605757' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-12-17T12:03:38.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:38 smithi186 ceph-mon[41182]: pgmap v290: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2023-12-17T12:03:39.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.343+0000 7f50ccb3c700 1 -- 172.21.15.8:0/2093053177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50c8101680 msgr2=0x7f50c8101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:39.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.343+0000 7f50ccb3c700 1 --2- 172.21.15.8:0/2093053177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50c8101680 0x7f50c8101b00 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f50bc009990 tx=0x7f50bc009ca0 comp rx=0 tx=0).stop 2023-12-17T12:03:39.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.343+0000 7f50ccb3c700 1 -- 172.21.15.8:0/2093053177 shutdown_connections 2023-12-17T12:03:39.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.343+0000 7f50ccb3c700 1 --2- 172.21.15.8:0/2093053177 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50c8102040 0x7f50c810e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:39.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.343+0000 7f50ccb3c700 1 --2- 172.21.15.8:0/2093053177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c81076f0 0x7f50c8107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:39.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.343+0000 7f50ccb3c700 1 --2- 172.21.15.8:0/2093053177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50c8101680 0x7f50c8101b00 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:39.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.343+0000 7f50ccb3c700 1 -- 172.21.15.8:0/2093053177 >> 172.21.15.8:0/2093053177 conn(0x7f50c80787c0 msgr2=0x7f50c8078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:39.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.344+0000 7f50ccb3c700 1 -- 172.21.15.8:0/2093053177 shutdown_connections 2023-12-17T12:03:39.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.344+0000 7f50ccb3c700 1 -- 172.21.15.8:0/2093053177 wait complete. 2023-12-17T12:03:39.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.345+0000 7f50ccb3c700 1 Processor -- start 2023-12-17T12:03:39.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.345+0000 7f50ccb3c700 1 -- start start 2023-12-17T12:03:39.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.345+0000 7f50ccb3c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c8101680 0x7f50c80738d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:39.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.345+0000 7f50ccb3c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50c8102040 0x7f50c8073e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:39.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.345+0000 7f50ccb3c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50c81076f0 0x7f50c8074350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:39.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.345+0000 7f50ccb3c700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c81a5d40 con 0x7f50c81076f0 2023-12-17T12:03:39.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.345+0000 7f50ccb3c700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c81a5eb0 con 0x7f50c8101680 2023-12-17T12:03:39.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.345+0000 7f50ccb3c700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50c81a6070 con 0x7f50c8102040 2023-12-17T12:03:39.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.345+0000 7f50c6d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50c81076f0 0x7f50c8074350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:39.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.345+0000 7f50c6d9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50c81076f0 0x7f50c8074350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:34168/0 (socket says 172.21.15.8:34168) 2023-12-17T12:03:39.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.345+0000 7f50c6d9d700 1 -- 172.21.15.8:0/3484012377 learned_addr learned my addr 172.21.15.8:0/3484012377 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:39.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.345+0000 7f50c5d9b700 1 --2- 172.21.15.8:0/3484012377 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50c8102040 0x7f50c8073e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:39.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.345+0000 7f50c659c700 1 --2- 172.21.15.8:0/3484012377 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c8101680 0x7f50c80738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:39.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.346+0000 7f50c6d9d700 1 -- 172.21.15.8:0/3484012377 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50c8102040 msgr2=0x7f50c8073e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:39.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.346+0000 7f50c6d9d700 1 --2- 172.21.15.8:0/3484012377 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50c8102040 0x7f50c8073e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:39.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.346+0000 7f50c6d9d700 1 -- 172.21.15.8:0/3484012377 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c8101680 msgr2=0x7f50c80738d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:39.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.346+0000 7f50c6d9d700 1 --2- 172.21.15.8:0/3484012377 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c8101680 0x7f50c80738d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:39.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.346+0000 7f50c6d9d700 1 -- 172.21.15.8:0/3484012377 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50bc0095f0 con 0x7f50c81076f0 2023-12-17T12:03:39.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.346+0000 7f50c6d9d700 1 --2- 172.21.15.8:0/3484012377 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50c81076f0 0x7f50c8074350 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f50c0007f10 tx=0x7f50c000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:39.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.346+0000 7f50b77fe700 1 -- 172.21.15.8:0/3484012377 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c0017070 con 0x7f50c81076f0 2023-12-17T12:03:39.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.346+0000 7f50b77fe700 1 -- 172.21.15.8:0/3484012377 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f50c000f040 con 0x7f50c81076f0 2023-12-17T12:03:39.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.346+0000 7f50b77fe700 1 -- 172.21.15.8:0/3484012377 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50c0005570 con 0x7f50c81076f0 2023-12-17T12:03:39.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.346+0000 7f50ccb3c700 1 -- 172.21.15.8:0/3484012377 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50c81a6350 con 0x7f50c81076f0 2023-12-17T12:03:39.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.346+0000 7f50ccb3c700 1 -- 172.21.15.8:0/3484012377 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50c81a67d0 con 0x7f50c81076f0 2023-12-17T12:03:39.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.348+0000 7f50ccb3c700 1 -- 172.21.15.8:0/3484012377 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50c8109b80 con 0x7f50c81076f0 2023-12-17T12:03:39.353 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.349+0000 7f50b77fe700 1 -- 172.21.15.8:0/3484012377 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f50c000db20 con 0x7f50c81076f0 2023-12-17T12:03:39.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.352+0000 7f50b77fe700 1 --2- 172.21.15.8:0/3484012377 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f50b00a1590 0x7f50b00a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:39.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.352+0000 7f50b77fe700 1 -- 172.21.15.8:0/3484012377 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f50c00cc560 con 0x7f50c81076f0 2023-12-17T12:03:39.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.352+0000 7f50c659c700 1 --2- 172.21.15.8:0/3484012377 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f50b00a1590 0x7f50b00a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:39.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.352+0000 7f50c659c700 1 --2- 172.21.15.8:0/3484012377 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f50b00a1590 0x7f50b00a3a50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f50b8007b60 tx=0x7f50b80073d0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:39.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.356+0000 7f50b77fe700 1 -- 172.21.15.8:0/3484012377 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f50c00959e0 con 0x7f50c81076f0 2023-12-17T12:03:39.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.560+0000 7f50ccb3c700 1 -- 172.21.15.8:0/3484012377 --> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f50c8074db0 con 0x7f50b00a1590 2023-12-17T12:03:39.575 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.572+0000 7f50b77fe700 1 -- 172.21.15.8:0/3484012377 <== mgr.14154 v2:172.21.15.8:6800/268548699 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+339467 (secure 0 0 0) 0x7f50c8074db0 con 0x7f50b00a1590 2023-12-17T12:03:39.581 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:03:39.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.577+0000 7f50ccb3c700 1 -- 172.21.15.8:0/3484012377 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f50b00a1590 msgr2=0x7f50b00a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:39.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.577+0000 7f50ccb3c700 1 --2- 172.21.15.8:0/3484012377 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f50b00a1590 0x7f50b00a3a50 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f50b8007b60 tx=0x7f50b80073d0 comp rx=0 tx=0).stop 2023-12-17T12:03:39.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.577+0000 7f50ccb3c700 1 -- 172.21.15.8:0/3484012377 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50c81076f0 msgr2=0x7f50c8074350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:39.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.577+0000 7f50ccb3c700 1 --2- 172.21.15.8:0/3484012377 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50c81076f0 0x7f50c8074350 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f50c0007f10 tx=0x7f50c000d3b0 comp rx=0 tx=0).stop 2023-12-17T12:03:39.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.577+0000 7f50ccb3c700 1 -- 172.21.15.8:0/3484012377 shutdown_connections 2023-12-17T12:03:39.584 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.577+0000 7f50ccb3c700 1 --2- 172.21.15.8:0/3484012377 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f50b00a1590 0x7f50b00a3a50 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:39.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.577+0000 7f50ccb3c700 1 --2- 172.21.15.8:0/3484012377 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50c81076f0 0x7f50c8074350 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:39.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.577+0000 7f50ccb3c700 1 --2- 172.21.15.8:0/3484012377 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50c8101680 0x7f50c80738d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:39.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.577+0000 7f50ccb3c700 1 --2- 172.21.15.8:0/3484012377 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50c8102040 0x7f50c8073e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:39.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.577+0000 7f50ccb3c700 1 -- 172.21.15.8:0/3484012377 >> 172.21.15.8:0/3484012377 conn(0x7f50c80787c0 msgr2=0x7f50c81004e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:39.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.578+0000 7f50ccb3c700 1 -- 172.21.15.8:0/3484012377 shutdown_connections 2023-12-17T12:03:39.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:39.578+0000 7f50ccb3c700 1 -- 172.21.15.8:0/3484012377 wait complete. 2023-12-17T12:03:39.585 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-12-17T12:03:39.991 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":291,"stamp":"2023-12-17T12:03:39.450610+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655944,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":573,"num_read_kb":405,"num_write":418,"num_write_kb":3071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":344,"ondisk_log_size":344,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335660,"kb_used_data":11396,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606164,"statfs":{"total":1151940427776,"available":1151596711936,"internally_reserved":0,"allocated":11669504,"data_stored":7303951,"data_compressed":178284,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19138,"internal_metadata":331855166},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":105,"num_read_kb":50,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.000398"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.461988+0000","last_change":"2023-12-17T12:02:50.685108+0000","last_active":"2023-12-17T12:03:27.461988+0000","last_peered":"2023-12-17T12:03:27.461988+0000","last_clean":"2023-12-17T12:03:27.461988+0000","last_became_active":"2023-12-17T12:02:50.684394+0000","last_became_peered":"2023-12-17T12:02:50.684394+0000","last_unstale":"2023-12-17T12:03:27.461988+0000","last_undegraded":"2023-12-17T12:03:27.461988+0000","last_fullsized":"2023-12-17T12:03:27.461988+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:42:03.271558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.461528+0000","last_change":"2023-12-17T12:02:50.676657+0000","last_active":"2023-12-17T12:03:27.461528+0000","last_peered":"2023-12-17T12:03:27.461528+0000","last_clean":"2023-12-17T12:03:27.461528+0000","last_became_active":"2023-12-17T12:02:50.676310+0000","last_became_peered":"2023-12-17T12:02:50.676310+0000","last_unstale":"2023-12-17T12:03:27.461528+0000","last_undegraded":"2023-12-17T12:03:27.461528+0000","last_fullsized":"2023-12-17T12:03:27.461528+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:58:16.704219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.461319+0000","last_change":"2023-12-17T12:02:50.691978+0000","last_active":"2023-12-17T12:03:27.461319+0000","last_peered":"2023-12-17T12:03:27.461319+0000","last_clean":"2023-12-17T12:03:27.461319+0000","last_became_active":"2023-12-17T12:02:50.691639+0000","last_became_peered":"2023-12-17T12:02:50.691639+0000","last_unstale":"2023-12-17T12:03:27.461319+0000","last_undegraded":"2023-12-17T12:03:27.461319+0000","last_fullsized":"2023-12-17T12:03:27.461319+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:55:24.002885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.455643+0000","last_change":"2023-12-17T12:02:50.687062+0000","last_active":"2023-12-17T12:03:27.455643+0000","last_peered":"2023-12-17T12:03:27.455643+0000","last_clean":"2023-12-17T12:03:27.455643+0000","last_became_active":"2023-12-17T12:02:50.685906+0000","last_became_peered":"2023-12-17T12:02:50.685906+0000","last_unstale":"2023-12-17T12:03:27.455643+0000","last_undegraded":"2023-12-17T12:03:27.455643+0000","last_fullsized":"2023-12-17T12:03:27.455643+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:15:22.367700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.456822+0000","last_change":"2023-12-17T12:02:50.681528+0000","last_active":"2023-12-17T12:03:27.456822+0000","last_peered":"2023-12-17T12:03:27.456822+0000","last_clean":"2023-12-17T12:03:27.456822+0000","last_became_active":"2023-12-17T12:02:50.681206+0000","last_became_peered":"2023-12-17T12:02:50.681206+0000","last_unstale":"2023-12-17T12:03:27.456822+0000","last_undegraded":"2023-12-17T12:03:27.456822+0000","last_fullsized":"2023-12-17T12:03:27.456822+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:46:48.146735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-17T12:03:28.462022+0000","last_change":"2023-12-17T12:03:28.462022+0000","last_active":"2023-12-17T12:03:28.462022+0000","last_peered":"2023-12-17T12:03:28.462022+0000","last_clean":"2023-12-17T12:03:28.462022+0000","last_became_active":"2023-12-17T12:03:28.461722+0000","last_became_peered":"2023-12-17T12:03:28.461722+0000","last_unstale":"2023-12-17T12:03:28.462022+0000","last_undegraded":"2023-12-17T12:03:28.462022+0000","last_fullsized":"2023-12-17T12:03:28.462022+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:29:24.035940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-17T12:03:28.590774+0000","last_change":"2023-12-17T12:03:28.590774+0000","last_active":"2023-12-17T12:03:28.590774+0000","last_peered":"2023-12-17T12:03:28.590774+0000","last_clean":"2023-12-17T12:03:28.590774+0000","last_became_active":"2023-12-17T12:03:28.590276+0000","last_became_peered":"2023-12-17T12:03:28.590276+0000","last_unstale":"2023-12-17T12:03:28.590774+0000","last_undegraded":"2023-12-17T12:03:28.590774+0000","last_fullsized":"2023-12-17T12:03:28.590774+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:38:56.633581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.458083+0000","last_change":"2023-12-17T12:02:50.687583+0000","last_active":"2023-12-17T12:03:27.458083+0000","last_peered":"2023-12-17T12:03:27.458083+0000","last_clean":"2023-12-17T12:03:27.458083+0000","last_became_active":"2023-12-17T12:02:50.687232+0000","last_became_peered":"2023-12-17T12:02:50.687232+0000","last_unstale":"2023-12-17T12:03:27.458083+0000","last_undegraded":"2023-12-17T12:03:27.458083+0000","last_fullsized":"2023-12-17T12:03:27.458083+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:48:22.795244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.458160+0000","last_change":"2023-12-17T12:02:50.683443+0000","last_active":"2023-12-17T12:03:27.458160+0000","last_peered":"2023-12-17T12:03:27.458160+0000","last_clean":"2023-12-17T12:03:27.458160+0000","last_became_active":"2023-12-17T12:02:50.683092+0000","last_became_peered":"2023-12-17T12:02:50.683092+0000","last_unstale":"2023-12-17T12:03:27.458160+0000","last_undegraded":"2023-12-17T12:03:27.458160+0000","last_fullsized":"2023-12-17T12:03:27.458160+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:56:24.455890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.451946+0000","last_change":"2023-12-17T12:02:50.689885+0000","last_active":"2023-12-17T12:03:27.451946+0000","last_peered":"2023-12-17T12:03:27.451946+0000","last_clean":"2023-12-17T12:03:27.451946+0000","last_became_active":"2023-12-17T12:02:50.689312+0000","last_became_peered":"2023-12-17T12:02:50.689312+0000","last_unstale":"2023-12-17T12:03:27.451946+0000","last_undegraded":"2023-12-17T12:03:27.451946+0000","last_fullsized":"2023-12-17T12:03:27.451946+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:23:35.348565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.454271+0000","last_change":"2023-12-17T12:02:50.684120+0000","last_active":"2023-12-17T12:03:27.454271+0000","last_peered":"2023-12-17T12:03:27.454271+0000","last_clean":"2023-12-17T12:03:27.454271+0000","last_became_active":"2023-12-17T12:02:50.683811+0000","last_became_peered":"2023-12-17T12:02:50.683811+0000","last_unstale":"2023-12-17T12:03:27.454271+0000","last_undegraded":"2023-12-17T12:03:27.454271+0000","last_fullsized":"2023-12-17T12:03:27.454271+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:58:14.651264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.455461+0000","last_change":"2023-12-17T12:02:50.678350+0000","last_active":"2023-12-17T12:03:27.455461+0000","last_peered":"2023-12-17T12:03:27.455461+0000","last_clean":"2023-12-17T12:03:27.455461+0000","last_became_active":"2023-12-17T12:02:50.677640+0000","last_became_peered":"2023-12-17T12:02:50.677640+0000","last_unstale":"2023-12-17T12:03:27.455461+0000","last_undegraded":"2023-12-17T12:03:27.455461+0000","last_fullsized":"2023-12-17T12:03:27.455461+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:01:54.303216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-17T12:03:28.461996+0000","last_change":"2023-12-17T12:03:28.461996+0000","last_active":"2023-12-17T12:03:28.461996+0000","last_peered":"2023-12-17T12:03:28.461996+0000","last_clean":"2023-12-17T12:03:28.461996+0000","last_became_active":"2023-12-17T12:03:28.461667+0000","last_became_peered":"2023-12-17T12:03:28.461667+0000","last_unstale":"2023-12-17T12:03:28.461996+0000","last_undegraded":"2023-12-17T12:03:28.461996+0000","last_fullsized":"2023-12-17T12:03:28.461996+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:03:56.084937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.460073+0000","last_change":"2023-12-17T12:02:50.686975+0000","last_active":"2023-12-17T12:03:27.460073+0000","last_peered":"2023-12-17T12:03:27.460073+0000","last_clean":"2023-12-17T12:03:27.460073+0000","last_became_active":"2023-12-17T12:02:50.684301+0000","last_became_peered":"2023-12-17T12:02:50.684301+0000","last_unstale":"2023-12-17T12:03:27.460073+0000","last_undegraded":"2023-12-17T12:03:27.460073+0000","last_fullsized":"2023-12-17T12:03:27.460073+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:43:43.676085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-17T12:03:28.468251+0000","last_change":"2023-12-17T12:03:28.468251+0000","last_active":"2023-12-17T12:03:28.468251+0000","last_peered":"2023-12-17T12:03:28.468251+0000","last_clean":"2023-12-17T12:03:28.468251+0000","last_became_active":"2023-12-17T12:03:28.466855+0000","last_became_peered":"2023-12-17T12:03:28.466855+0000","last_unstale":"2023-12-17T12:03:28.468251+0000","last_undegraded":"2023-12-17T12:03:28.468251+0000","last_fullsized":"2023-12-17T12:03:28.468251+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:56:42.987063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.455919+0000","last_change":"2023-12-17T12:02:50.691615+0000","last_active":"2023-12-17T12:03:27.455919+0000","last_peered":"2023-12-17T12:03:27.455919+0000","last_clean":"2023-12-17T12:03:27.455919+0000","last_became_active":"2023-12-17T12:02:50.690942+0000","last_became_peered":"2023-12-17T12:02:50.690942+0000","last_unstale":"2023-12-17T12:03:27.455919+0000","last_undegraded":"2023-12-17T12:03:27.455919+0000","last_fullsized":"2023-12-17T12:03:27.455919+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:29:03.412722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.462068+0000","last_change":"2023-12-17T12:02:50.685709+0000","last_active":"2023-12-17T12:03:27.462068+0000","last_peered":"2023-12-17T12:03:27.462068+0000","last_clean":"2023-12-17T12:03:27.462068+0000","last_became_active":"2023-12-17T12:02:50.685111+0000","last_became_peered":"2023-12-17T12:02:50.685111+0000","last_unstale":"2023-12-17T12:03:27.462068+0000","last_undegraded":"2023-12-17T12:03:27.462068+0000","last_fullsized":"2023-12-17T12:03:27.462068+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:26:56.486285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.453150+0000","last_change":"2023-12-17T12:02:50.683639+0000","last_active":"2023-12-17T12:03:27.453150+0000","last_peered":"2023-12-17T12:03:27.453150+0000","last_clean":"2023-12-17T12:03:27.453150+0000","last_became_active":"2023-12-17T12:02:50.683267+0000","last_became_peered":"2023-12-17T12:02:50.683267+0000","last_unstale":"2023-12-17T12:03:27.453150+0000","last_undegraded":"2023-12-17T12:03:27.453150+0000","last_fullsized":"2023-12-17T12:03:27.453150+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:09:01.026688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.454456+0000","last_change":"2023-12-17T12:02:50.690116+0000","last_active":"2023-12-17T12:03:27.454456+0000","last_peered":"2023-12-17T12:03:27.454456+0000","last_clean":"2023-12-17T12:03:27.454456+0000","last_became_active":"2023-12-17T12:02:50.688731+0000","last_became_peered":"2023-12-17T12:02:50.688731+0000","last_unstale":"2023-12-17T12:03:27.454456+0000","last_undegraded":"2023-12-17T12:03:27.454456+0000","last_fullsized":"2023-12-17T12:03:27.454456+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:21:37.730460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'13","reported_seq":67,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-17T12:03:34.126938+0000","last_change":"2023-12-17T12:02:49.662068+0000","last_active":"2023-12-17T12:03:34.126938+0000","last_peered":"2023-12-17T12:03:34.126938+0000","last_clean":"2023-12-17T12:03:34.126938+0000","last_became_active":"2023-12-17T12:02:49.661755+0000","last_became_peered":"2023-12-17T12:02:49.661755+0000","last_unstale":"2023-12-17T12:03:34.126938+0000","last_undegraded":"2023-12-17T12:03:34.126938+0000","last_fullsized":"2023-12-17T12:03:34.126938+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:51:16.128618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":39,"num_read_kb":39,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.458885+0000","last_change":"2023-12-17T12:02:50.687855+0000","last_active":"2023-12-17T12:03:27.458885+0000","last_peered":"2023-12-17T12:03:27.458885+0000","last_clean":"2023-12-17T12:03:27.458885+0000","last_became_active":"2023-12-17T12:02:50.687567+0000","last_became_peered":"2023-12-17T12:02:50.687567+0000","last_unstale":"2023-12-17T12:03:27.458885+0000","last_undegraded":"2023-12-17T12:03:27.458885+0000","last_fullsized":"2023-12-17T12:03:27.458885+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:49:51.627898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.459064+0000","last_change":"2023-12-17T12:02:49.673995+0000","last_active":"2023-12-17T12:03:27.459064+0000","last_peered":"2023-12-17T12:03:27.459064+0000","last_clean":"2023-12-17T12:03:27.459064+0000","last_became_active":"2023-12-17T12:02:49.673509+0000","last_became_peered":"2023-12-17T12:02:49.673509+0000","last_unstale":"2023-12-17T12:03:27.459064+0000","last_undegraded":"2023-12-17T12:03:27.459064+0000","last_fullsized":"2023-12-17T12:03:27.459064+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:53:19.695998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.461682+0000","last_change":"2023-12-17T12:02:50.687537+0000","last_active":"2023-12-17T12:03:27.461682+0000","last_peered":"2023-12-17T12:03:27.461682+0000","last_clean":"2023-12-17T12:03:27.461682+0000","last_became_active":"2023-12-17T12:02:50.687203+0000","last_became_peered":"2023-12-17T12:02:50.687203+0000","last_unstale":"2023-12-17T12:03:27.461682+0000","last_undegraded":"2023-12-17T12:03:27.461682+0000","last_fullsized":"2023-12-17T12:03:27.461682+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:08:27.551628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.457396+0000","last_change":"2023-12-17T12:02:49.666605+0000","last_active":"2023-12-17T12:03:27.457396+0000","last_peered":"2023-12-17T12:03:27.457396+0000","last_clean":"2023-12-17T12:03:27.457396+0000","last_became_active":"2023-12-17T12:02:49.666203+0000","last_became_peered":"2023-12-17T12:02:49.666203+0000","last_unstale":"2023-12-17T12:03:27.457396+0000","last_undegraded":"2023-12-17T12:03:27.457396+0000","last_fullsized":"2023-12-17T12:03:27.457396+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:06:19.429798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.454883+0000","last_change":"2023-12-17T12:02:50.683718+0000","last_active":"2023-12-17T12:03:27.454883+0000","last_peered":"2023-12-17T12:03:27.454883+0000","last_clean":"2023-12-17T12:03:27.454883+0000","last_became_active":"2023-12-17T12:02:50.683417+0000","last_became_peered":"2023-12-17T12:02:50.683417+0000","last_unstale":"2023-12-17T12:03:27.454883+0000","last_undegraded":"2023-12-17T12:03:27.454883+0000","last_fullsized":"2023-12-17T12:03:27.454883+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:10:10.662913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.457136+0000","last_change":"2023-12-17T12:02:49.667711+0000","last_active":"2023-12-17T12:03:27.457136+0000","last_peered":"2023-12-17T12:03:27.457136+0000","last_clean":"2023-12-17T12:03:27.457136+0000","last_became_active":"2023-12-17T12:02:49.667358+0000","last_became_peered":"2023-12-17T12:02:49.667358+0000","last_unstale":"2023-12-17T12:03:27.457136+0000","last_undegraded":"2023-12-17T12:03:27.457136+0000","last_fullsized":"2023-12-17T12:03:27.457136+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:54:38.336318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.451594+0000","last_change":"2023-12-17T12:02:50.684036+0000","last_active":"2023-12-17T12:03:27.451594+0000","last_peered":"2023-12-17T12:03:27.451594+0000","last_clean":"2023-12-17T12:03:27.451594+0000","last_became_active":"2023-12-17T12:02:50.683580+0000","last_became_peered":"2023-12-17T12:02:50.683580+0000","last_unstale":"2023-12-17T12:03:27.451594+0000","last_undegraded":"2023-12-17T12:03:27.451594+0000","last_fullsized":"2023-12-17T12:03:27.451594+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:08:40.380574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'6","reported_seq":65,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-17T12:03:34.052093+0000","last_change":"2023-12-17T12:02:49.664481+0000","last_active":"2023-12-17T12:03:34.052093+0000","last_peered":"2023-12-17T12:03:34.052093+0000","last_clean":"2023-12-17T12:03:34.052093+0000","last_became_active":"2023-12-17T12:02:49.659106+0000","last_became_peered":"2023-12-17T12:02:49.659106+0000","last_unstale":"2023-12-17T12:03:34.052093+0000","last_undegraded":"2023-12-17T12:03:34.052093+0000","last_fullsized":"2023-12-17T12:03:34.052093+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:41:05.093724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1011,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":44,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.455981+0000","last_change":"2023-12-17T12:02:50.677862+0000","last_active":"2023-12-17T12:03:27.455981+0000","last_peered":"2023-12-17T12:03:27.455981+0000","last_clean":"2023-12-17T12:03:27.455981+0000","last_became_active":"2023-12-17T12:02:50.677511+0000","last_became_peered":"2023-12-17T12:02:50.677511+0000","last_unstale":"2023-12-17T12:03:27.455981+0000","last_undegraded":"2023-12-17T12:03:27.455981+0000","last_fullsized":"2023-12-17T12:03:27.455981+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:16:05.792201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.450707+0000","last_change":"2023-12-17T12:02:49.654735+0000","last_active":"2023-12-17T12:03:27.450707+0000","last_peered":"2023-12-17T12:03:27.450707+0000","last_clean":"2023-12-17T12:03:27.450707+0000","last_became_active":"2023-12-17T12:02:49.654192+0000","last_became_peered":"2023-12-17T12:02:49.654192+0000","last_unstale":"2023-12-17T12:03:27.450707+0000","last_undegraded":"2023-12-17T12:03:27.450707+0000","last_fullsized":"2023-12-17T12:03:27.450707+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:37:04.500685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.451458+0000","last_change":"2023-12-17T12:02:50.676395+0000","last_active":"2023-12-17T12:03:27.451458+0000","last_peered":"2023-12-17T12:03:27.451458+0000","last_clean":"2023-12-17T12:03:27.451458+0000","last_became_active":"2023-12-17T12:02:50.675969+0000","last_became_peered":"2023-12-17T12:02:50.675969+0000","last_unstale":"2023-12-17T12:03:27.451458+0000","last_undegraded":"2023-12-17T12:03:27.451458+0000","last_fullsized":"2023-12-17T12:03:27.451458+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:36:27.541564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.454117+0000","last_change":"2023-12-17T12:02:49.660990+0000","last_active":"2023-12-17T12:03:27.454117+0000","last_peered":"2023-12-17T12:03:27.454117+0000","last_clean":"2023-12-17T12:03:27.454117+0000","last_became_active":"2023-12-17T12:02:49.660623+0000","last_became_peered":"2023-12-17T12:02:49.660623+0000","last_unstale":"2023-12-17T12:03:27.454117+0000","last_undegraded":"2023-12-17T12:03:27.454117+0000","last_fullsized":"2023-12-17T12:03:27.454117+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:59:58.462681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.457923+0000","last_change":"2023-12-17T12:02:50.677481+0000","last_active":"2023-12-17T12:03:27.457923+0000","last_peered":"2023-12-17T12:03:27.457923+0000","last_clean":"2023-12-17T12:03:27.457923+0000","last_became_active":"2023-12-17T12:02:50.677101+0000","last_became_peered":"2023-12-17T12:02:50.677101+0000","last_unstale":"2023-12-17T12:03:27.457923+0000","last_undegraded":"2023-12-17T12:03:27.457923+0000","last_fullsized":"2023-12-17T12:03:27.457923+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:47:24.777071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.451120+0000","last_change":"2023-12-17T12:02:49.662973+0000","last_active":"2023-12-17T12:03:27.451120+0000","last_peered":"2023-12-17T12:03:27.451120+0000","last_clean":"2023-12-17T12:03:27.451120+0000","last_became_active":"2023-12-17T12:02:49.662653+0000","last_became_peered":"2023-12-17T12:02:49.662653+0000","last_unstale":"2023-12-17T12:03:27.451120+0000","last_undegraded":"2023-12-17T12:03:27.451120+0000","last_fullsized":"2023-12-17T12:03:27.451120+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:01:34.858207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-17T12:03:28.462933+0000","last_change":"2023-12-17T12:03:28.462933+0000","last_active":"2023-12-17T12:03:28.462933+0000","last_peered":"2023-12-17T12:03:28.462933+0000","last_clean":"2023-12-17T12:03:28.462933+0000","last_became_active":"2023-12-17T12:03:28.462508+0000","last_became_peered":"2023-12-17T12:03:28.462508+0000","last_unstale":"2023-12-17T12:03:28.462933+0000","last_undegraded":"2023-12-17T12:03:28.462933+0000","last_fullsized":"2023-12-17T12:03:28.462933+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:06:57.808882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6,10],"acting":[9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":102,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-17T12:03:37.056220+0000","last_change":"2023-12-17T12:02:49.656001+0000","last_active":"2023-12-17T12:03:37.056220+0000","last_peered":"2023-12-17T12:03:37.056220+0000","last_clean":"2023-12-17T12:03:37.056220+0000","last_became_active":"2023-12-17T12:02:49.655292+0000","last_became_peered":"2023-12-17T12:02:49.655292+0000","last_unstale":"2023-12-17T12:03:37.056220+0000","last_undegraded":"2023-12-17T12:03:37.056220+0000","last_fullsized":"2023-12-17T12:03:37.056220+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:41:34.836929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":83,"num_read_kb":83,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.457902+0000","last_change":"2023-12-17T12:02:50.692734+0000","last_active":"2023-12-17T12:03:27.457902+0000","last_peered":"2023-12-17T12:03:27.457902+0000","last_clean":"2023-12-17T12:03:27.457902+0000","last_became_active":"2023-12-17T12:02:50.691567+0000","last_became_peered":"2023-12-17T12:02:50.691567+0000","last_unstale":"2023-12-17T12:03:27.457902+0000","last_undegraded":"2023-12-17T12:03:27.457902+0000","last_fullsized":"2023-12-17T12:03:27.457902+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:23:39.685352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.453286+0000","last_change":"2023-12-17T12:02:49.664634+0000","last_active":"2023-12-17T12:03:27.453286+0000","last_peered":"2023-12-17T12:03:27.453286+0000","last_clean":"2023-12-17T12:03:27.453286+0000","last_became_active":"2023-12-17T12:02:49.664260+0000","last_became_peered":"2023-12-17T12:02:49.664260+0000","last_unstale":"2023-12-17T12:03:27.453286+0000","last_undegraded":"2023-12-17T12:03:27.453286+0000","last_fullsized":"2023-12-17T12:03:27.453286+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:55:06.887646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.461722+0000","last_change":"2023-12-17T12:02:50.679341+0000","last_active":"2023-12-17T12:03:27.461722+0000","last_peered":"2023-12-17T12:03:27.461722+0000","last_clean":"2023-12-17T12:03:27.461722+0000","last_became_active":"2023-12-17T12:02:50.677115+0000","last_became_peered":"2023-12-17T12:02:50.677115+0000","last_unstale":"2023-12-17T12:03:27.461722+0000","last_undegraded":"2023-12-17T12:03:27.461722+0000","last_fullsized":"2023-12-17T12:03:27.461722+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:59:09.665514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.451648+0000","last_change":"2023-12-17T12:02:49.653748+0000","last_active":"2023-12-17T12:03:27.451648+0000","last_peered":"2023-12-17T12:03:27.451648+0000","last_clean":"2023-12-17T12:03:27.451648+0000","last_became_active":"2023-12-17T12:02:49.652647+0000","last_became_peered":"2023-12-17T12:02:49.652647+0000","last_unstale":"2023-12-17T12:03:27.451648+0000","last_undegraded":"2023-12-17T12:03:27.451648+0000","last_fullsized":"2023-12-17T12:03:27.451648+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:13:40.817124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.455228+0000","last_change":"2023-12-17T12:02:50.686787+0000","last_active":"2023-12-17T12:03:27.455228+0000","last_peered":"2023-12-17T12:03:27.455228+0000","last_clean":"2023-12-17T12:03:27.455228+0000","last_became_active":"2023-12-17T12:02:50.685133+0000","last_became_peered":"2023-12-17T12:02:50.685133+0000","last_unstale":"2023-12-17T12:03:27.455228+0000","last_undegraded":"2023-12-17T12:03:27.455228+0000","last_fullsized":"2023-12-17T12:03:27.455228+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:35:17.972258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'31","reported_seq":141,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-17T12:03:37.055819+0000","last_change":"2023-12-17T12:02:49.662054+0000","last_active":"2023-12-17T12:03:37.055819+0000","last_peered":"2023-12-17T12:03:37.055819+0000","last_clean":"2023-12-17T12:03:37.055819+0000","last_became_active":"2023-12-17T12:02:49.661675+0000","last_became_peered":"2023-12-17T12:02:49.661675+0000","last_unstale":"2023-12-17T12:03:37.055819+0000","last_undegraded":"2023-12-17T12:03:37.055819+0000","last_fullsized":"2023-12-17T12:03:37.055819+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:44:32.547926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58130,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":95,"num_read_kb":104,"num_write":33,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.457225+0000","last_change":"2023-12-17T12:02:50.678514+0000","last_active":"2023-12-17T12:03:27.457225+0000","last_peered":"2023-12-17T12:03:27.457225+0000","last_clean":"2023-12-17T12:03:27.457225+0000","last_became_active":"2023-12-17T12:02:50.677739+0000","last_became_peered":"2023-12-17T12:02:50.677739+0000","last_unstale":"2023-12-17T12:03:27.457225+0000","last_undegraded":"2023-12-17T12:03:27.457225+0000","last_fullsized":"2023-12-17T12:03:27.457225+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:42:36.269803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.454380+0000","last_change":"2023-12-17T12:02:49.655037+0000","last_active":"2023-12-17T12:03:27.454380+0000","last_peered":"2023-12-17T12:03:27.454380+0000","last_clean":"2023-12-17T12:03:27.454380+0000","last_became_active":"2023-12-17T12:02:49.654263+0000","last_became_peered":"2023-12-17T12:02:49.654263+0000","last_unstale":"2023-12-17T12:03:27.454380+0000","last_undegraded":"2023-12-17T12:03:27.454380+0000","last_fullsized":"2023-12-17T12:03:27.454380+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:42:16.512434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-17T12:03:28.461238+0000","last_change":"2023-12-17T12:03:28.461238+0000","last_active":"2023-12-17T12:03:28.461238+0000","last_peered":"2023-12-17T12:03:28.461238+0000","last_clean":"2023-12-17T12:03:28.461238+0000","last_became_active":"2023-12-17T12:03:28.460869+0000","last_became_peered":"2023-12-17T12:03:28.460869+0000","last_unstale":"2023-12-17T12:03:28.461238+0000","last_undegraded":"2023-12-17T12:03:28.461238+0000","last_fullsized":"2023-12-17T12:03:28.461238+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:45:42.438201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.451775+0000","last_change":"2023-12-17T12:02:49.660993+0000","last_active":"2023-12-17T12:03:27.451775+0000","last_peered":"2023-12-17T12:03:27.451775+0000","last_clean":"2023-12-17T12:03:27.451775+0000","last_became_active":"2023-12-17T12:02:49.658165+0000","last_became_peered":"2023-12-17T12:02:49.658165+0000","last_unstale":"2023-12-17T12:03:27.451775+0000","last_undegraded":"2023-12-17T12:03:27.451775+0000","last_fullsized":"2023-12-17T12:03:27.451775+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:22:41.721994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.454498+0000","last_change":"2023-12-17T12:02:50.679349+0000","last_active":"2023-12-17T12:03:27.454498+0000","last_peered":"2023-12-17T12:03:27.454498+0000","last_clean":"2023-12-17T12:03:27.454498+0000","last_became_active":"2023-12-17T12:02:50.678932+0000","last_became_peered":"2023-12-17T12:02:50.678932+0000","last_unstale":"2023-12-17T12:03:27.454498+0000","last_undegraded":"2023-12-17T12:03:27.454498+0000","last_fullsized":"2023-12-17T12:03:27.454498+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:05:41.517038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'6","reported_seq":64,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-17T12:03:37.113008+0000","last_change":"2023-12-17T12:02:49.656800+0000","last_active":"2023-12-17T12:03:37.113008+0000","last_peered":"2023-12-17T12:03:37.113008+0000","last_clean":"2023-12-17T12:03:37.113008+0000","last_became_active":"2023-12-17T12:02:49.656440+0000","last_became_peered":"2023-12-17T12:02:49.656440+0000","last_unstale":"2023-12-17T12:03:37.113008+0000","last_undegraded":"2023-12-17T12:03:37.113008+0000","last_fullsized":"2023-12-17T12:03:37.113008+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:04:17.951090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":977,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.453217+0000","last_change":"2023-12-17T12:02:50.684650+0000","last_active":"2023-12-17T12:03:27.453217+0000","last_peered":"2023-12-17T12:03:27.453217+0000","last_clean":"2023-12-17T12:03:27.453217+0000","last_became_active":"2023-12-17T12:02:50.684209+0000","last_became_peered":"2023-12-17T12:02:50.684209+0000","last_unstale":"2023-12-17T12:03:27.453217+0000","last_undegraded":"2023-12-17T12:03:27.453217+0000","last_fullsized":"2023-12-17T12:03:27.453217+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:51:15.756837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.456100+0000","last_change":"2023-12-17T12:02:49.673270+0000","last_active":"2023-12-17T12:03:27.456100+0000","last_peered":"2023-12-17T12:03:27.456100+0000","last_clean":"2023-12-17T12:03:27.456100+0000","last_became_active":"2023-12-17T12:02:49.672935+0000","last_became_peered":"2023-12-17T12:02:49.672935+0000","last_unstale":"2023-12-17T12:03:27.456100+0000","last_undegraded":"2023-12-17T12:03:27.456100+0000","last_fullsized":"2023-12-17T12:03:27.456100+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:41:00.777171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-17T12:03:28.590490+0000","last_change":"2023-12-17T12:03:28.590490+0000","last_active":"2023-12-17T12:03:28.590490+0000","last_peered":"2023-12-17T12:03:28.590490+0000","last_clean":"2023-12-17T12:03:28.590490+0000","last_became_active":"2023-12-17T12:03:28.589957+0000","last_became_peered":"2023-12-17T12:03:28.589957+0000","last_unstale":"2023-12-17T12:03:28.590490+0000","last_undegraded":"2023-12-17T12:03:28.590490+0000","last_fullsized":"2023-12-17T12:03:28.590490+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:15:52.936197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.457432+0000","last_change":"2023-12-17T12:02:49.667849+0000","last_active":"2023-12-17T12:03:27.457432+0000","last_peered":"2023-12-17T12:03:27.457432+0000","last_clean":"2023-12-17T12:03:27.457432+0000","last_became_active":"2023-12-17T12:02:49.667565+0000","last_became_peered":"2023-12-17T12:02:49.667565+0000","last_unstale":"2023-12-17T12:03:27.457432+0000","last_undegraded":"2023-12-17T12:03:27.457432+0000","last_fullsized":"2023-12-17T12:03:27.457432+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:39:56.248614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.461722+0000","last_change":"2023-12-17T12:02:50.669342+0000","last_active":"2023-12-17T12:03:27.461722+0000","last_peered":"2023-12-17T12:03:27.461722+0000","last_clean":"2023-12-17T12:03:27.461722+0000","last_became_active":"2023-12-17T12:02:50.668007+0000","last_became_peered":"2023-12-17T12:02:50.668007+0000","last_unstale":"2023-12-17T12:03:27.461722+0000","last_undegraded":"2023-12-17T12:03:27.461722+0000","last_fullsized":"2023-12-17T12:03:27.461722+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:54:56.753474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.453293+0000","last_change":"2023-12-17T12:02:49.656914+0000","last_active":"2023-12-17T12:03:27.453293+0000","last_peered":"2023-12-17T12:03:27.453293+0000","last_clean":"2023-12-17T12:03:27.453293+0000","last_became_active":"2023-12-17T12:02:49.656531+0000","last_became_peered":"2023-12-17T12:02:49.656531+0000","last_unstale":"2023-12-17T12:03:27.453293+0000","last_undegraded":"2023-12-17T12:03:27.453293+0000","last_fullsized":"2023-12-17T12:03:27.453293+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:45:14.558037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.452143+0000","last_change":"2023-12-17T12:02:50.677659+0000","last_active":"2023-12-17T12:03:27.452143+0000","last_peered":"2023-12-17T12:03:27.452143+0000","last_clean":"2023-12-17T12:03:27.452143+0000","last_became_active":"2023-12-17T12:02:50.677311+0000","last_became_peered":"2023-12-17T12:02:50.677311+0000","last_unstale":"2023-12-17T12:03:27.452143+0000","last_undegraded":"2023-12-17T12:03:27.452143+0000","last_fullsized":"2023-12-17T12:03:27.452143+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:20:23.134613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'5","reported_seq":58,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-17T12:03:33.125796+0000","last_change":"2023-12-17T12:02:49.665031+0000","last_active":"2023-12-17T12:03:33.125796+0000","last_peered":"2023-12-17T12:03:33.125796+0000","last_clean":"2023-12-17T12:03:33.125796+0000","last_became_active":"2023-12-17T12:02:49.663004+0000","last_became_peered":"2023-12-17T12:02:49.663004+0000","last_unstale":"2023-12-17T12:03:33.125796+0000","last_undegraded":"2023-12-17T12:03:33.125796+0000","last_fullsized":"2023-12-17T12:03:33.125796+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:19:44.410346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":38,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.451411+0000","last_change":"2023-12-17T12:02:50.685113+0000","last_active":"2023-12-17T12:03:27.451411+0000","last_peered":"2023-12-17T12:03:27.451411+0000","last_clean":"2023-12-17T12:03:27.451411+0000","last_became_active":"2023-12-17T12:02:50.684804+0000","last_became_peered":"2023-12-17T12:02:50.684804+0000","last_unstale":"2023-12-17T12:03:27.451411+0000","last_undegraded":"2023-12-17T12:03:27.451411+0000","last_fullsized":"2023-12-17T12:03:27.451411+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:54:32.686360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.451675+0000","last_change":"2023-12-17T12:02:50.688514+0000","last_active":"2023-12-17T12:03:27.451675+0000","last_peered":"2023-12-17T12:03:27.451675+0000","last_clean":"2023-12-17T12:03:27.451675+0000","last_became_active":"2023-12-17T12:02:50.687800+0000","last_became_peered":"2023-12-17T12:02:50.687800+0000","last_unstale":"2023-12-17T12:03:27.451675+0000","last_undegraded":"2023-12-17T12:03:27.451675+0000","last_fullsized":"2023-12-17T12:03:27.451675+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:41:45.981241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":61,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-17T12:03:36.110919+0000","last_change":"2023-12-17T12:02:49.669423+0000","last_active":"2023-12-17T12:03:36.110919+0000","last_peered":"2023-12-17T12:03:36.110919+0000","last_clean":"2023-12-17T12:03:36.110919+0000","last_became_active":"2023-12-17T12:02:49.668652+0000","last_became_peered":"2023-12-17T12:02:49.668652+0000","last_unstale":"2023-12-17T12:03:36.110919+0000","last_undegraded":"2023-12-17T12:03:36.110919+0000","last_fullsized":"2023-12-17T12:03:36.110919+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:32:02.981652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.458311+0000","last_change":"2023-12-17T12:02:50.685913+0000","last_active":"2023-12-17T12:03:27.458311+0000","last_peered":"2023-12-17T12:03:27.458311+0000","last_clean":"2023-12-17T12:03:27.458311+0000","last_became_active":"2023-12-17T12:02:50.684652+0000","last_became_peered":"2023-12-17T12:02:50.684652+0000","last_unstale":"2023-12-17T12:03:27.458311+0000","last_undegraded":"2023-12-17T12:03:27.458311+0000","last_fullsized":"2023-12-17T12:03:27.458311+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:07:11.077987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.454926+0000","last_change":"2023-12-17T12:02:49.653594+0000","last_active":"2023-12-17T12:03:27.454926+0000","last_peered":"2023-12-17T12:03:27.454926+0000","last_clean":"2023-12-17T12:03:27.454926+0000","last_became_active":"2023-12-17T12:02:49.653183+0000","last_became_peered":"2023-12-17T12:02:49.653183+0000","last_unstale":"2023-12-17T12:03:27.454926+0000","last_undegraded":"2023-12-17T12:03:27.454926+0000","last_fullsized":"2023-12-17T12:03:27.454926+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:17:38.111876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":312,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.453388+0000","last_change":"2023-12-17T12:01:45.376881+0000","last_active":"2023-12-17T12:03:27.453388+0000","last_peered":"2023-12-17T12:03:27.453388+0000","last_clean":"2023-12-17T12:03:27.453388+0000","last_became_active":"2023-12-17T12:01:45.376453+0000","last_became_peered":"2023-12-17T12:01:45.376453+0000","last_unstale":"2023-12-17T12:03:27.453388+0000","last_undegraded":"2023-12-17T12:03:27.453388+0000","last_fullsized":"2023-12-17T12:03:27.453388+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:58:44.022902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:58:44.022902+0000","last_clean_scrub_stamp":"2023-12-17T11:58:44.022902+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:31:55.352161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.454010+0000","last_change":"2023-12-17T12:02:50.683902+0000","last_active":"2023-12-17T12:03:27.454010+0000","last_peered":"2023-12-17T12:03:27.454010+0000","last_clean":"2023-12-17T12:03:27.454010+0000","last_became_active":"2023-12-17T12:02:50.682977+0000","last_became_peered":"2023-12-17T12:02:50.682977+0000","last_unstale":"2023-12-17T12:03:27.454010+0000","last_undegraded":"2023-12-17T12:03:27.454010+0000","last_fullsized":"2023-12-17T12:03:27.454010+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:40:51.002822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.453751+0000","last_change":"2023-12-17T12:02:49.659631+0000","last_active":"2023-12-17T12:03:27.453751+0000","last_peered":"2023-12-17T12:03:27.453751+0000","last_clean":"2023-12-17T12:03:27.453751+0000","last_became_active":"2023-12-17T12:02:49.658336+0000","last_became_peered":"2023-12-17T12:02:49.658336+0000","last_unstale":"2023-12-17T12:03:27.453751+0000","last_undegraded":"2023-12-17T12:03:27.453751+0000","last_fullsized":"2023-12-17T12:03:27.453751+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:05:27.210484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.457480+0000","last_change":"2023-12-17T12:02:49.675201+0000","last_active":"2023-12-17T12:03:27.457480+0000","last_peered":"2023-12-17T12:03:27.457480+0000","last_clean":"2023-12-17T12:03:27.457480+0000","last_became_active":"2023-12-17T12:02:49.674759+0000","last_became_peered":"2023-12-17T12:02:49.674759+0000","last_unstale":"2023-12-17T12:03:27.457480+0000","last_undegraded":"2023-12-17T12:03:27.457480+0000","last_fullsized":"2023-12-17T12:03:27.457480+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:20:04.166073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.454280+0000","last_change":"2023-12-17T12:02:50.687776+0000","last_active":"2023-12-17T12:03:27.454280+0000","last_peered":"2023-12-17T12:03:27.454280+0000","last_clean":"2023-12-17T12:03:27.454280+0000","last_became_active":"2023-12-17T12:02:50.687428+0000","last_became_peered":"2023-12-17T12:02:50.687428+0000","last_unstale":"2023-12-17T12:03:27.454280+0000","last_undegraded":"2023-12-17T12:03:27.454280+0000","last_fullsized":"2023-12-17T12:03:27.454280+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:59:33.970025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'10","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.453245+0000","last_change":"2023-12-17T12:02:49.655786+0000","last_active":"2023-12-17T12:03:27.453245+0000","last_peered":"2023-12-17T12:03:27.453245+0000","last_clean":"2023-12-17T12:03:27.453245+0000","last_became_active":"2023-12-17T12:02:49.655141+0000","last_became_peered":"2023-12-17T12:02:49.655141+0000","last_unstale":"2023-12-17T12:03:27.453245+0000","last_undegraded":"2023-12-17T12:03:27.453245+0000","last_fullsized":"2023-12-17T12:03:27.453245+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:53:08.992755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.458813+0000","last_change":"2023-12-17T12:02:50.677999+0000","last_active":"2023-12-17T12:03:27.458813+0000","last_peered":"2023-12-17T12:03:27.458813+0000","last_clean":"2023-12-17T12:03:27.458813+0000","last_became_active":"2023-12-17T12:02:50.677631+0000","last_became_peered":"2023-12-17T12:02:50.677631+0000","last_unstale":"2023-12-17T12:03:27.458813+0000","last_undegraded":"2023-12-17T12:03:27.458813+0000","last_fullsized":"2023-12-17T12:03:27.458813+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:07:16.006293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.455829+0000","last_change":"2023-12-17T12:02:49.654073+0000","last_active":"2023-12-17T12:03:27.455829+0000","last_peered":"2023-12-17T12:03:27.455829+0000","last_clean":"2023-12-17T12:03:27.455829+0000","last_became_active":"2023-12-17T12:02:49.653064+0000","last_became_peered":"2023-12-17T12:02:49.653064+0000","last_unstale":"2023-12-17T12:03:27.455829+0000","last_undegraded":"2023-12-17T12:03:27.455829+0000","last_fullsized":"2023-12-17T12:03:27.455829+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:48:53.075054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.461623+0000","last_change":"2023-12-17T12:02:50.675577+0000","last_active":"2023-12-17T12:03:27.461623+0000","last_peered":"2023-12-17T12:03:27.461623+0000","last_clean":"2023-12-17T12:03:27.461623+0000","last_became_active":"2023-12-17T12:02:50.675142+0000","last_became_peered":"2023-12-17T12:02:50.675142+0000","last_unstale":"2023-12-17T12:03:27.461623+0000","last_undegraded":"2023-12-17T12:03:27.461623+0000","last_fullsized":"2023-12-17T12:03:27.461623+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:38:38.865207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-17T12:03:28.487658+0000","last_change":"2023-12-17T12:03:28.487658+0000","last_active":"2023-12-17T12:03:28.487658+0000","last_peered":"2023-12-17T12:03:28.487658+0000","last_clean":"2023-12-17T12:03:28.487658+0000","last_became_active":"2023-12-17T12:03:28.484258+0000","last_became_peered":"2023-12-17T12:03:28.484258+0000","last_unstale":"2023-12-17T12:03:28.487658+0000","last_undegraded":"2023-12-17T12:03:28.487658+0000","last_fullsized":"2023-12-17T12:03:28.487658+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:48:25.919813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.456230+0000","last_change":"2023-12-17T12:02:50.677089+0000","last_active":"2023-12-17T12:03:27.456230+0000","last_peered":"2023-12-17T12:03:27.456230+0000","last_clean":"2023-12-17T12:03:27.456230+0000","last_became_active":"2023-12-17T12:02:50.676405+0000","last_became_peered":"2023-12-17T12:02:50.676405+0000","last_unstale":"2023-12-17T12:03:27.456230+0000","last_undegraded":"2023-12-17T12:03:27.456230+0000","last_fullsized":"2023-12-17T12:03:27.456230+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:32:55.011141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.458554+0000","last_change":"2023-12-17T12:02:49.659949+0000","last_active":"2023-12-17T12:03:27.458554+0000","last_peered":"2023-12-17T12:03:27.458554+0000","last_clean":"2023-12-17T12:03:27.458554+0000","last_became_active":"2023-12-17T12:02:49.659552+0000","last_became_peered":"2023-12-17T12:02:49.659552+0000","last_unstale":"2023-12-17T12:03:27.458554+0000","last_undegraded":"2023-12-17T12:03:27.458554+0000","last_fullsized":"2023-12-17T12:03:27.458554+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:39:26.912670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.461559+0000","last_change":"2023-12-17T12:02:50.680666+0000","last_active":"2023-12-17T12:03:27.461559+0000","last_peered":"2023-12-17T12:03:27.461559+0000","last_clean":"2023-12-17T12:03:27.461559+0000","last_became_active":"2023-12-17T12:02:50.680288+0000","last_became_peered":"2023-12-17T12:02:50.680288+0000","last_unstale":"2023-12-17T12:03:27.461559+0000","last_undegraded":"2023-12-17T12:03:27.461559+0000","last_fullsized":"2023-12-17T12:03:27.461559+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:52:36.966423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.454357+0000","last_change":"2023-12-17T12:02:49.655780+0000","last_active":"2023-12-17T12:03:27.454357+0000","last_peered":"2023-12-17T12:03:27.454357+0000","last_clean":"2023-12-17T12:03:27.454357+0000","last_became_active":"2023-12-17T12:02:49.655455+0000","last_became_peered":"2023-12-17T12:02:49.655455+0000","last_unstale":"2023-12-17T12:03:27.454357+0000","last_undegraded":"2023-12-17T12:03:27.454357+0000","last_fullsized":"2023-12-17T12:03:27.454357+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:14:42.145280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.458696+0000","last_change":"2023-12-17T12:02:50.682874+0000","last_active":"2023-12-17T12:03:27.458696+0000","last_peered":"2023-12-17T12:03:27.458696+0000","last_clean":"2023-12-17T12:03:27.458696+0000","last_became_active":"2023-12-17T12:02:50.682521+0000","last_became_peered":"2023-12-17T12:02:50.682521+0000","last_unstale":"2023-12-17T12:03:27.458696+0000","last_undegraded":"2023-12-17T12:03:27.458696+0000","last_fullsized":"2023-12-17T12:03:27.458696+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:51:21.609286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.456868+0000","last_change":"2023-12-17T12:02:49.666401+0000","last_active":"2023-12-17T12:03:27.456868+0000","last_peered":"2023-12-17T12:03:27.456868+0000","last_clean":"2023-12-17T12:03:27.456868+0000","last_became_active":"2023-12-17T12:02:49.663964+0000","last_became_peered":"2023-12-17T12:02:49.663964+0000","last_unstale":"2023-12-17T12:03:27.456868+0000","last_undegraded":"2023-12-17T12:03:27.456868+0000","last_fullsized":"2023-12-17T12:03:27.456868+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:07:45.806809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.454427+0000","last_change":"2023-12-17T12:02:50.689647+0000","last_active":"2023-12-17T12:03:27.454427+0000","last_peered":"2023-12-17T12:03:27.454427+0000","last_clean":"2023-12-17T12:03:27.454427+0000","last_became_active":"2023-12-17T12:02:50.686507+0000","last_became_peered":"2023-12-17T12:02:50.686507+0000","last_unstale":"2023-12-17T12:03:27.454427+0000","last_undegraded":"2023-12-17T12:03:27.454427+0000","last_fullsized":"2023-12-17T12:03:27.454427+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:44:33.359008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'5","reported_seq":63,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-17T12:03:37.121381+0000","last_change":"2023-12-17T12:02:49.661156+0000","last_active":"2023-12-17T12:03:37.121381+0000","last_peered":"2023-12-17T12:03:37.121381+0000","last_clean":"2023-12-17T12:03:37.121381+0000","last_became_active":"2023-12-17T12:02:49.660277+0000","last_became_peered":"2023-12-17T12:02:49.660277+0000","last_unstale":"2023-12-17T12:03:37.121381+0000","last_undegraded":"2023-12-17T12:03:37.121381+0000","last_fullsized":"2023-12-17T12:03:37.121381+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:58:57.108942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":43,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.454357+0000","last_change":"2023-12-17T12:02:50.684018+0000","last_active":"2023-12-17T12:03:27.454357+0000","last_peered":"2023-12-17T12:03:27.454357+0000","last_clean":"2023-12-17T12:03:27.454357+0000","last_became_active":"2023-12-17T12:02:50.683381+0000","last_became_peered":"2023-12-17T12:02:50.683381+0000","last_unstale":"2023-12-17T12:03:27.454357+0000","last_undegraded":"2023-12-17T12:03:27.454357+0000","last_fullsized":"2023-12-17T12:03:27.454357+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:13:45.847989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.451522+0000","last_change":"2023-12-17T12:02:49.651097+0000","last_active":"2023-12-17T12:03:27.451522+0000","last_peered":"2023-12-17T12:03:27.451522+0000","last_clean":"2023-12-17T12:03:27.451522+0000","last_became_active":"2023-12-17T12:02:49.650677+0000","last_became_peered":"2023-12-17T12:02:49.650677+0000","last_unstale":"2023-12-17T12:03:27.451522+0000","last_undegraded":"2023-12-17T12:03:27.451522+0000","last_fullsized":"2023-12-17T12:03:27.451522+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:43:51.383835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.453445+0000","last_change":"2023-12-17T12:02:50.680988+0000","last_active":"2023-12-17T12:03:27.453445+0000","last_peered":"2023-12-17T12:03:27.453445+0000","last_clean":"2023-12-17T12:03:27.453445+0000","last_became_active":"2023-12-17T12:02:50.680254+0000","last_became_peered":"2023-12-17T12:02:50.680254+0000","last_unstale":"2023-12-17T12:03:27.453445+0000","last_undegraded":"2023-12-17T12:03:27.453445+0000","last_fullsized":"2023-12-17T12:03:27.453445+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:18:12.341302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.455014+0000","last_change":"2023-12-17T12:02:49.670420+0000","last_active":"2023-12-17T12:03:27.455014+0000","last_peered":"2023-12-17T12:03:27.455014+0000","last_clean":"2023-12-17T12:03:27.455014+0000","last_became_active":"2023-12-17T12:02:49.668729+0000","last_became_peered":"2023-12-17T12:02:49.668729+0000","last_unstale":"2023-12-17T12:03:27.455014+0000","last_undegraded":"2023-12-17T12:03:27.455014+0000","last_fullsized":"2023-12-17T12:03:27.455014+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:07:14.206167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.454955+0000","last_change":"2023-12-17T12:02:50.681966+0000","last_active":"2023-12-17T12:03:27.454955+0000","last_peered":"2023-12-17T12:03:27.454955+0000","last_clean":"2023-12-17T12:03:27.454955+0000","last_became_active":"2023-12-17T12:02:50.681628+0000","last_became_peered":"2023-12-17T12:02:50.681628+0000","last_unstale":"2023-12-17T12:03:27.454955+0000","last_undegraded":"2023-12-17T12:03:27.454955+0000","last_fullsized":"2023-12-17T12:03:27.454955+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:11:59.882145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.461553+0000","last_change":"2023-12-17T12:02:50.686865+0000","last_active":"2023-12-17T12:03:27.461553+0000","last_peered":"2023-12-17T12:03:27.461553+0000","last_clean":"2023-12-17T12:03:27.461553+0000","last_became_active":"2023-12-17T12:02:50.684800+0000","last_became_peered":"2023-12-17T12:02:50.684800+0000","last_unstale":"2023-12-17T12:03:27.461553+0000","last_undegraded":"2023-12-17T12:03:27.461553+0000","last_fullsized":"2023-12-17T12:03:27.461553+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:14:27.121624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-17T12:03:28.463257+0000","last_change":"2023-12-17T12:03:28.463257+0000","last_active":"2023-12-17T12:03:28.463257+0000","last_peered":"2023-12-17T12:03:28.463257+0000","last_clean":"2023-12-17T12:03:28.463257+0000","last_became_active":"2023-12-17T12:03:28.462830+0000","last_became_peered":"2023-12-17T12:03:28.462830+0000","last_unstale":"2023-12-17T12:03:28.463257+0000","last_undegraded":"2023-12-17T12:03:28.463257+0000","last_fullsized":"2023-12-17T12:03:28.463257+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:37:30.051602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.454223+0000","last_change":"2023-12-17T12:02:50.690916+0000","last_active":"2023-12-17T12:03:27.454223+0000","last_peered":"2023-12-17T12:03:27.454223+0000","last_clean":"2023-12-17T12:03:27.454223+0000","last_became_active":"2023-12-17T12:02:50.690551+0000","last_became_peered":"2023-12-17T12:02:50.690551+0000","last_unstale":"2023-12-17T12:03:27.454223+0000","last_undegraded":"2023-12-17T12:03:27.454223+0000","last_fullsized":"2023-12-17T12:03:27.454223+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:08:42.166489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.461878+0000","last_change":"2023-12-17T12:02:50.680813+0000","last_active":"2023-12-17T12:03:27.461878+0000","last_peered":"2023-12-17T12:03:27.461878+0000","last_clean":"2023-12-17T12:03:27.461878+0000","last_became_active":"2023-12-17T12:02:50.680501+0000","last_became_peered":"2023-12-17T12:02:50.680501+0000","last_unstale":"2023-12-17T12:03:27.461878+0000","last_undegraded":"2023-12-17T12:03:27.461878+0000","last_fullsized":"2023-12-17T12:03:27.461878+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:11:50.421163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.454413+0000","last_change":"2023-12-17T12:02:50.678160+0000","last_active":"2023-12-17T12:03:27.454413+0000","last_peered":"2023-12-17T12:03:27.454413+0000","last_clean":"2023-12-17T12:03:27.454413+0000","last_became_active":"2023-12-17T12:02:50.677801+0000","last_became_peered":"2023-12-17T12:02:50.677801+0000","last_unstale":"2023-12-17T12:03:27.454413+0000","last_undegraded":"2023-12-17T12:03:27.454413+0000","last_fullsized":"2023-12-17T12:03:27.454413+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:23:50.851920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.461816+0000","last_change":"2023-12-17T12:02:50.671312+0000","last_active":"2023-12-17T12:03:27.461816+0000","last_peered":"2023-12-17T12:03:27.461816+0000","last_clean":"2023-12-17T12:03:27.461816+0000","last_became_active":"2023-12-17T12:02:50.670331+0000","last_became_peered":"2023-12-17T12:02:50.670331+0000","last_unstale":"2023-12-17T12:03:27.461816+0000","last_undegraded":"2023-12-17T12:03:27.461816+0000","last_fullsized":"2023-12-17T12:03:27.461816+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:53:35.185205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-17T12:03:28.589968+0000","last_change":"2023-12-17T12:03:28.589968+0000","last_active":"2023-12-17T12:03:28.589968+0000","last_peered":"2023-12-17T12:03:28.589968+0000","last_clean":"2023-12-17T12:03:28.589968+0000","last_became_active":"2023-12-17T12:03:28.589119+0000","last_became_peered":"2023-12-17T12:03:28.589119+0000","last_unstale":"2023-12-17T12:03:28.589968+0000","last_undegraded":"2023-12-17T12:03:28.589968+0000","last_fullsized":"2023-12-17T12:03:28.589968+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:10:15.036823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,9],"acting":[2,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.458790+0000","last_change":"2023-12-17T12:02:50.692248+0000","last_active":"2023-12-17T12:03:27.458790+0000","last_peered":"2023-12-17T12:03:27.458790+0000","last_clean":"2023-12-17T12:03:27.458790+0000","last_became_active":"2023-12-17T12:02:50.691902+0000","last_became_peered":"2023-12-17T12:02:50.691902+0000","last_unstale":"2023-12-17T12:03:27.458790+0000","last_undegraded":"2023-12-17T12:03:27.458790+0000","last_fullsized":"2023-12-17T12:03:27.458790+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:00:43.992500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.451045+0000","last_change":"2023-12-17T12:02:50.677912+0000","last_active":"2023-12-17T12:03:27.451045+0000","last_peered":"2023-12-17T12:03:27.451045+0000","last_clean":"2023-12-17T12:03:27.451045+0000","last_became_active":"2023-12-17T12:02:50.676818+0000","last_became_peered":"2023-12-17T12:02:50.676818+0000","last_unstale":"2023-12-17T12:03:27.451045+0000","last_undegraded":"2023-12-17T12:03:27.451045+0000","last_fullsized":"2023-12-17T12:03:27.451045+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:16:53.103771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.458368+0000","last_change":"2023-12-17T12:02:50.684966+0000","last_active":"2023-12-17T12:03:27.458368+0000","last_peered":"2023-12-17T12:03:27.458368+0000","last_clean":"2023-12-17T12:03:27.458368+0000","last_became_active":"2023-12-17T12:02:50.684622+0000","last_became_peered":"2023-12-17T12:02:50.684622+0000","last_unstale":"2023-12-17T12:03:27.458368+0000","last_undegraded":"2023-12-17T12:03:27.458368+0000","last_fullsized":"2023-12-17T12:03:27.458368+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:58:41.810005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.457056+0000","last_change":"2023-12-17T12:02:50.683939+0000","last_active":"2023-12-17T12:03:27.457056+0000","last_peered":"2023-12-17T12:03:27.457056+0000","last_clean":"2023-12-17T12:03:27.457056+0000","last_became_active":"2023-12-17T12:02:50.682306+0000","last_became_peered":"2023-12-17T12:02:50.682306+0000","last_unstale":"2023-12-17T12:03:27.457056+0000","last_undegraded":"2023-12-17T12:03:27.457056+0000","last_fullsized":"2023-12-17T12:03:27.457056+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:02:24.342403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.455099+0000","last_change":"2023-12-17T12:02:50.684219+0000","last_active":"2023-12-17T12:03:27.455099+0000","last_peered":"2023-12-17T12:03:27.455099+0000","last_clean":"2023-12-17T12:03:27.455099+0000","last_became_active":"2023-12-17T12:02:50.681446+0000","last_became_peered":"2023-12-17T12:02:50.681446+0000","last_unstale":"2023-12-17T12:03:27.455099+0000","last_undegraded":"2023-12-17T12:03:27.455099+0000","last_fullsized":"2023-12-17T12:03:27.455099+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:14:09.223818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.461667+0000","last_change":"2023-12-17T12:02:50.669333+0000","last_active":"2023-12-17T12:03:27.461667+0000","last_peered":"2023-12-17T12:03:27.461667+0000","last_clean":"2023-12-17T12:03:27.461667+0000","last_became_active":"2023-12-17T12:02:50.668958+0000","last_became_peered":"2023-12-17T12:02:50.668958+0000","last_unstale":"2023-12-17T12:03:27.461667+0000","last_undegraded":"2023-12-17T12:03:27.461667+0000","last_fullsized":"2023-12-17T12:03:27.461667+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:34:37.234282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":248082,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65330,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":447,"num_read_kb":296,"num_write":235,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":195990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449109,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":446043,"data_compressed":5821,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 12:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.5880000000000001,"5min":2.5880000000000001,"15min":2.5880000000000001},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.68799999999999994}]},{"osd":1,"last update":"Sun Dec 17 12:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.748}]},{"osd":2,"last update":"Sun Dec 17 12:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.53100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":4,"last update":"Sun Dec 17 12:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":2.3849999999999998,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":0.66900000000000004}]},{"osd":5,"last update":"Sun Dec 17 12:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.70799999999999996}]},{"osd":6,"last update":"Sun Dec 17 12:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.82099999999999995}]},{"osd":7,"last update":"Sun Dec 17 12:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.5339999999999998,"5min":2.5339999999999998,"15min":2.5339999999999998},"last":0.84499999999999997}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":9,"last update":"Sun Dec 17 12:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.91100000000000003},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.77100000000000002}]},{"osd":10,"last update":"Sun Dec 17 12:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.472,"5min":2.472,"15min":2.472},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":0.97399999999999998}]}]},{"osd":10,"up_from":70,"seq":300647710747,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1077248,"data_stored":1095266,"data_compressed":41965,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":1,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.47499999999999998}]},{"osd":2,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":1.026},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.59599999999999997}]},{"osd":3,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.75800000000000001}]},{"osd":4,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.78700000000000003}]},{"osd":5,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.63600000000000001}]},{"osd":6,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.083}]},{"osd":7,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.111}]},{"osd":8,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":1.1399999999999999}]},{"osd":9,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":1.165}]},{"osd":11,"last update":"Sun Dec 17 12:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.96899999999999997}]}]},{"osd":9,"up_from":65,"seq":279172874269,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":445973,"data_compressed":5821,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 12:03:21 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.55200000000000005,"15min":0.56499999999999995},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66100000000000003,"5min":1.069,"15min":1.069},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.59199999999999997,"15min":0.60399999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72699999999999998,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.39200000000000002}]},{"osd":1,"last update":"Sun Dec 17 12:03:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.71299999999999997,"15min":0.72499999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.86799999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.746,"15min":0.754},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.84999999999999998,"5min":1.147,"15min":1.147},"last":0.504}]},{"osd":2,"last update":"Sun Dec 17 12:03:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.84199999999999997,"15min":0.85899999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0169999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.80400000000000005,"15min":0.82599999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.92300000000000004,"5min":1.413,"15min":1.413},"last":0.57299999999999995}]},{"osd":3,"last update":"Sun Dec 17 12:03:21 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.74199999999999999,"15min":0.76200000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.98299999999999998,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.71399999999999997,"15min":0.73599999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96099999999999997,"5min":1.484,"15min":1.484},"last":0.41599999999999998}]},{"osd":4,"last update":"Sun Dec 17 12:03:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.88200000000000001,"15min":0.90600000000000003},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.96099999999999997,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.96699999999999997},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.90900000000000003,"15min":0.93500000000000005},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.98599999999999999,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.83199999999999996}]},{"osd":5,"last update":"Sun Dec 17 12:03:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.93899999999999995,"15min":0.96499999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0920000000000001,"5min":1.341,"15min":1.341},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.88300000000000001,"15min":0.90500000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.89200000000000002,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.53200000000000003}]},{"osd":6,"last update":"Sun Dec 17 12:03:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.94699999999999995,"15min":0.97699999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.143,"5min":1.444,"15min":1.444},"last":0.628},{"interface":"front","average":{"1min":0.752,"5min":0.88,"15min":0.90100000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.05,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.48699999999999999}]},{"osd":7,"last update":"Sun Dec 17 12:03:21 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.92700000000000005,"15min":0.92900000000000005},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.90700000000000003,"5min":1.046,"15min":1.069},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.1910000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.875}]},{"osd":8,"last update":"Sun Dec 17 12:03:21 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":1.0469999999999999,"15min":1.073},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.238,"5min":1.605,"15min":1.605},"last":0.751},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.95799999999999996,"15min":0.97399999999999998},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.2010000000000001,"5min":1.274,"15min":1.274},"last":0.68799999999999994}]},{"osd":10,"last update":"Sun Dec 17 12:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.92500000000000004}]}]},{"osd":8,"up_from":58,"seq":249108103203,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":942080,"data_stored":446020,"data_compressed":5821,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 12:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.71599999999999997,"15min":0.72199999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.96699999999999997,"5min":1.093,"15min":1.093},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.73299999999999998,"15min":0.745},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.81699999999999995}]},{"osd":1,"last update":"Sun Dec 17 12:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.749,"15min":0.74299999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.67700000000000005,"15min":0.67300000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.55500000000000005}]},{"osd":2,"last update":"Sun Dec 17 12:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60199999999999998,"15min":0.60099999999999998},"min":{"1min":0.38,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.995,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63300000000000001,"15min":0.63200000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.53000000000000003}]},{"osd":3,"last update":"Sun Dec 17 12:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76900000000000002,"15min":0.77900000000000003},"min":{"1min":0.55200000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.0449999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.82099999999999995,"15min":0.82599999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.76300000000000001}]},{"osd":4,"last update":"Sun Dec 17 12:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.751,"15min":0.753},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.95699999999999996,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.876,"5min":0.84199999999999997,"15min":0.83599999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3049999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.91400000000000003}]},{"osd":5,"last update":"Sun Dec 17 12:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73499999999999999,"15min":0.74199999999999999},"min":{"1min":0.40699999999999997,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0589999999999999,"5min":1.163,"15min":1.163},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.71099999999999997,"15min":0.72099999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.876,"5min":1.135,"15min":1.135},"last":0.74299999999999999}]},{"osd":6,"last update":"Sun Dec 17 12:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.88500000000000001,"15min":0.89300000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.2450000000000001,"5min":1.28,"15min":1.28},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.88,"5min":0.91100000000000003,"15min":0.91600000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.109,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.93700000000000006}]},{"osd":7,"last update":"Sun Dec 17 12:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.91900000000000004,"15min":0.91400000000000003},"min":{"1min":0.61599999999999999,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.218,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":1.028},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.871,"15min":0.86499999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.224,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.88200000000000001}]},{"osd":9,"last update":"Sun Dec 17 12:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.86399999999999999,"15min":0.86199999999999999},"min":{"1min":0.65400000000000003,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.127,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.93200000000000005,"15min":0.92700000000000005},"min":{"1min":0.67800000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1779999999999999,"5min":1.304,"15min":1.304},"last":0.99099999999999999}]},{"osd":10,"last update":"Sun Dec 17 12:02:43 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":1.0409999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]}]},{"osd":7,"up_from":50,"seq":214748364839,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":1039262,"data_compressed":41965,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.627,"15min":0.61899999999999999},"min":{"1min":0.47999999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.61499999999999999,"15min":0.60799999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91500000000000004,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.67500000000000004}]},{"osd":1,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.48399999999999999,"15min":0.47599999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.38300000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83399999999999996,"5min":1.056,"15min":1.056},"last":1.01}]},{"osd":2,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":0.80100000000000005,"15min":0.76200000000000001},"min":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":5.8949999999999996,"5min":5.8949999999999996,"15min":5.8949999999999996},"last":0.71399999999999997},{"interface":"front","average":{"1min":1.024,"5min":0.77900000000000003,"15min":0.73799999999999999},"min":{"1min":0.52100000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":5.9210000000000003,"5min":5.9210000000000003,"15min":5.9210000000000003},"last":0.67400000000000004}]},{"osd":3,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.66600000000000004,"15min":0.66200000000000003},"min":{"1min":0.53400000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.84699999999999998,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.995},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.70499999999999996,"15min":0.70099999999999996},"min":{"1min":0.46700000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.96099999999999997}]},{"osd":4,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.437,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.96899999999999997,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.63500000000000001,"15min":0.626},"min":{"1min":0.45900000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.61299999999999999}]},{"osd":5,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80500000000000005,"15min":0.80400000000000005},"min":{"1min":0.63700000000000001,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.87},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98499999999999999,"5min":1.022,"15min":1.022},"last":0.91800000000000004}]},{"osd":6,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.79900000000000004,"15min":0.79300000000000004},"min":{"1min":0.60399999999999998,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.036,"5min":1.125,"15min":1.125},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.79300000000000004,"15min":0.78300000000000003},"min":{"1min":0.66800000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.98099999999999998}]},{"osd":8,"last update":"Sun Dec 17 12:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.54900000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.84699999999999998,"15min":0.84499999999999997},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.82899999999999996}]},{"osd":9,"last update":"Sun Dec 17 12:03:25 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.86299999999999999,"15min":0.86699999999999999},"min":{"1min":0.59099999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.048,"5min":1.129,"15min":1.129},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.83799999999999997,"15min":0.83999999999999997},"min":{"1min":0.64000000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":0.98099999999999998,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":1.038}]},{"osd":10,"last update":"Sun Dec 17 12:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.76300000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]}]},{"osd":6,"up_from":45,"seq":193273528364,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":929792,"data_stored":445423,"data_compressed":5821,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 12:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.48899999999999999,"15min":0.48499999999999999},"min":{"1min":0.33300000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69599999999999995,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.51300000000000001,"15min":0.51700000000000002},"min":{"1min":0.41899999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.629,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.41599999999999998}]},{"osd":1,"last update":"Sun Dec 17 12:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.67200000000000004,"15min":0.66800000000000004},"min":{"1min":0.48099999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.70099999999999996,"15min":0.69299999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.77600000000000002}]},{"osd":2,"last update":"Sun Dec 17 12:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70799999999999996,"15min":0.70699999999999996},"min":{"1min":0.56999999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.89400000000000002,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.71199999999999997,"15min":0.69299999999999995},"min":{"1min":0.54600000000000004,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.60199999999999998}]},{"osd":3,"last update":"Sun Dec 17 12:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.629,"15min":0.63},"min":{"1min":0.38,"5min":0.374,"15min":0.374},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69299999999999995,"15min":0.69099999999999995},"min":{"1min":0.435,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":0.49399999999999999}]},{"osd":4,"last update":"Sun Dec 17 12:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.76500000000000001,"15min":0.77600000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80300000000000005,"15min":0.81299999999999994},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.79300000000000004}]},{"osd":5,"last update":"Sun Dec 17 12:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.56100000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.85299999999999998,"15min":0.85599999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0549999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.63600000000000001}]},{"osd":7,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1639999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.89000000000000001,"15min":0.89800000000000002},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.0960000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.90500000000000003}]},{"osd":8,"last update":"Sun Dec 17 12:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.90800000000000003,"15min":0.92000000000000004},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.046,"5min":1.238,"15min":1.238},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.90400000000000003,"15min":0.91200000000000003},"min":{"1min":0.68000000000000005,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.0029999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.72999999999999998}]},{"osd":9,"last update":"Sun Dec 17 12:03:21 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.84599999999999997,"15min":0.84399999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.95099999999999996,"15min":0.95499999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":0.754}]},{"osd":10,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.84099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574914,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":995328,"data_stored":504733,"data_compressed":5821,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 12:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.67300000000000004,"15min":0.64400000000000002},"min":{"1min":0.38100000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.86099999999999999,"5min":4.7089999999999996,"15min":4.7089999999999996},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.64800000000000002,"15min":0.61399999999999999},"min":{"1min":0.41899999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.93300000000000005,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.71399999999999997}]},{"osd":2,"last update":"Sun Dec 17 12:02:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.68000000000000005,"15min":0.60299999999999998},"min":{"1min":0.53800000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.139,"5min":3.8809999999999998,"15min":3.8809999999999998},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.69499999999999995,"15min":0.60399999999999998},"min":{"1min":0.59299999999999997,"5min":0.312,"15min":0.312},"max":{"1min":1.0369999999999999,"5min":4.7270000000000003,"15min":4.7270000000000003},"last":1.0940000000000001}]},{"osd":3,"last update":"Sun Dec 17 12:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.66600000000000004,"15min":0.61399999999999999},"min":{"1min":0.46400000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.96299999999999997,"5min":3.9510000000000001,"15min":3.9510000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.70399999999999996,"15min":0.64400000000000002},"min":{"1min":0.51000000000000001,"5min":0.374,"15min":0.374},"max":{"1min":1.028,"5min":3.8639999999999999,"15min":3.8639999999999999},"last":0.88300000000000001}]},{"osd":4,"last update":"Sun Dec 17 12:03:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.56200000000000006,"15min":0.499},"min":{"1min":0.41699999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.0249999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.55400000000000005,"15min":0.49099999999999999},"min":{"1min":0.504,"5min":0.307,"15min":0.307},"max":{"1min":1.0589999999999999,"5min":1.099,"15min":1.099},"last":0.76600000000000001}]},{"osd":5,"last update":"Sun Dec 17 12:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.71699999999999997,"15min":0.70099999999999996},"min":{"1min":0.52000000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1060000000000001,"5min":1.196,"15min":1.196},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.85799999999999998,"15min":0.872},"min":{"1min":0.64000000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.157,"5min":4.7619999999999996,"15min":4.7619999999999996},"last":1.202}]},{"osd":6,"last update":"Sun Dec 17 12:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.78800000000000003,"15min":0.80600000000000005},"min":{"1min":0.56699999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.98199999999999998,"5min":3.895,"15min":3.895},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.86499999999999999,"15min":0.88500000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0800000000000001,"5min":3.9260000000000002,"15min":3.9260000000000002},"last":0.86899999999999999}]},{"osd":7,"last update":"Sun Dec 17 12:02:36 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.76400000000000001,"15min":0.75},"min":{"1min":0.48399999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":1.163},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.70499999999999996,"15min":0.69999999999999996},"min":{"1min":0.503,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.95099999999999996,"5min":1.175,"15min":1.175},"last":0.96999999999999997}]},{"osd":8,"last update":"Sun Dec 17 12:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.871,"15min":0.86699999999999999},"min":{"1min":0.58599999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.151,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":1.02},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.92500000000000004,"15min":0.92300000000000004},"min":{"1min":0.71299999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.27,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":1.258}]},{"osd":9,"last update":"Sun Dec 17 12:03:23 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.84799999999999998,"15min":0.84399999999999997},"min":{"1min":0.60199999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.94899999999999995,"15min":0.94499999999999995},"min":{"1min":0.72599999999999998,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.252,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.0509999999999999}]},{"osd":10,"last update":"Sun Dec 17 12:02:45 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":1.2330000000000001},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":1.008}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1299999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738439,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":446756,"data_compressed":5821,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 17 12:03:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.64100000000000001,"15min":0.57599999999999996},"min":{"1min":0.42699999999999999,"5min":0.375,"15min":0.375},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.62,"15min":0.58199999999999996},"min":{"1min":0.51900000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.71899999999999997}]},{"osd":2,"last update":"Sun Dec 17 12:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.65700000000000003,"15min":0.621},"min":{"1min":0.52400000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.92000000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.74099999999999999,"15min":0.65300000000000002},"min":{"1min":0.49099999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.998,"5min":6.9859999999999998,"15min":6.9859999999999998},"last":0.997}]},{"osd":3,"last update":"Sun Dec 17 12:01:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46100000000000002,"15min":0.45900000000000002},"min":{"1min":0.34000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72899999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.47399999999999998,"15min":0.46800000000000003},"min":{"1min":0.374,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.67300000000000004,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.89700000000000002}]},{"osd":4,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.67800000000000005,"15min":0.63},"min":{"1min":0.56200000000000006,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.359,"5min":1.359,"15min":1.359},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.747,"5min":0.65800000000000003,"15min":0.629},"min":{"1min":0.45900000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.56799999999999995}]},{"osd":5,"last update":"Sun Dec 17 12:02:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.72899999999999998,"15min":0.71099999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0189999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.73999999999999999,"15min":0.71599999999999997},"min":{"1min":0.58199999999999996,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95799999999999996,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.93899999999999995}]},{"osd":6,"last update":"Sun Dec 17 12:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.68400000000000005,"15min":0.63500000000000001},"min":{"1min":0.45600000000000002,"5min":0.434,"15min":0.434},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.72699999999999998,"15min":0.67900000000000005},"min":{"1min":0.502,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":0.85599999999999998}]},{"osd":7,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.77500000000000002,"15min":0.77200000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.878},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.81899999999999995,"15min":0.80800000000000005},"min":{"1min":0.69399999999999995,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.80200000000000005}]},{"osd":8,"last update":"Sun Dec 17 12:02:59 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.89300000000000002,"15min":0.89800000000000002},"min":{"1min":0.67100000000000004,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.0529999999999999,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.92400000000000004,"15min":0.92800000000000005},"min":{"1min":0.76400000000000001,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0209999999999999,"5min":1.486,"15min":1.486},"last":1.137}]},{"osd":9,"last update":"Sun Dec 17 12:03:23 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.92300000000000004,"15min":0.93100000000000005},"min":{"1min":0.54900000000000004,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":1.048},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.999,"15min":1.0069999999999999},"min":{"1min":0.54200000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":1.093}]},{"osd":10,"last update":"Sun Dec 17 12:02:46 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":1.2170000000000001},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":1.0680000000000001}]},{"osd":11,"last update":"Sun Dec 17 12:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":1.085},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":1.1779999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411391,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1011712,"data_stored":505069,"data_compressed":5821,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 12:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.63800000000000001,"15min":0.60399999999999998},"min":{"1min":0.38400000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.62},{"interface":"front","average":{"1min":0.62,"5min":0.60999999999999999,"15min":0.59499999999999997},"min":{"1min":0.442,"5min":0.377,"15min":0.377},"max":{"1min":0.84199999999999997,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.86699999999999999}]},{"osd":1,"last update":"Sun Dec 17 12:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.63100000000000001,"15min":0.61799999999999999},"min":{"1min":0.50600000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82399999999999995,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.63700000000000001,"15min":0.60699999999999998},"min":{"1min":0.48899999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.81799999999999995,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.89300000000000002}]},{"osd":3,"last update":"Sun Dec 17 12:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.68600000000000005,"15min":0.65700000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.66700000000000004,"15min":0.65500000000000003},"min":{"1min":0.42099999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.66000000000000003}]},{"osd":4,"last update":"Sun Dec 17 12:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64300000000000002,"15min":0.63200000000000001},"min":{"1min":0.46000000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.76700000000000002,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.68200000000000005,"15min":0.64600000000000002},"min":{"1min":0.52600000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95999999999999996,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.94999999999999996}]},{"osd":5,"last update":"Sun Dec 17 12:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.56000000000000005,"15min":0.53400000000000003},"min":{"1min":0.36099999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.625,"15min":0.60899999999999999},"min":{"1min":0.41799999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.97499999999999998,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.78900000000000003}]},{"osd":6,"last update":"Sun Dec 17 12:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.81000000000000005,"15min":0.79200000000000004},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.75600000000000001,"15min":0.73799999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.93300000000000005}]},{"osd":7,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.75600000000000001,"15min":0.76200000000000001},"min":{"1min":0.53700000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.86499999999999999,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.62},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.72599999999999998,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.0549999999999999,"5min":1.212,"15min":1.212},"last":0.54200000000000004}]},{"osd":8,"last update":"Sun Dec 17 12:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.76400000000000001,"15min":0.76800000000000002},"min":{"1min":0.53400000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.014,"5min":1.03,"15min":1.03},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.751,"15min":0.76500000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.75}]},{"osd":9,"last update":"Sun Dec 17 12:03:27 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.92300000000000004,"15min":0.91900000000000004},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.873,"15min":0.86799999999999999},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":1.038}]},{"osd":10,"last update":"Sun Dec 17 12:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":1.0720000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0980000000000001}]}]},{"osd":3,"up_from":25,"seq":107374182457,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":445246,"data_compressed":5821,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 12:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.45200000000000001,"15min":0.41999999999999998},"min":{"1min":0.36099999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.81299999999999994,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.47799999999999998,"15min":0.44},"min":{"1min":0.35799999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.46400000000000002}]},{"osd":1,"last update":"Sun Dec 17 12:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.69199999999999995,"15min":0.63},"min":{"1min":0.58099999999999996,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.746,"5min":0.68500000000000005,"15min":0.64000000000000001},"min":{"1min":0.53900000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.97999999999999998,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.70199999999999996}]},{"osd":2,"last update":"Sun Dec 17 12:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.626,"15min":0.61799999999999999},"min":{"1min":0.442,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.69199999999999995,"15min":0.64800000000000002},"min":{"1min":0.48999999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.143,"5min":1.27,"15min":1.27},"last":0.53700000000000003}]},{"osd":4,"last update":"Sun Dec 17 12:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.70299999999999996,"15min":0.66200000000000003},"min":{"1min":0.61499999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0409999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.74199999999999999,"15min":0.68300000000000005},"min":{"1min":0.68600000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.004,"5min":1.115,"15min":1.115},"last":0.64000000000000001}]},{"osd":5,"last update":"Sun Dec 17 12:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.72199999999999998,"15min":0.69799999999999995},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.70699999999999996,"15min":0.68899999999999995},"min":{"1min":0.49099999999999999,"5min":0.441,"15min":0.441},"max":{"1min":1.1279999999999999,"5min":1.137,"15min":1.137},"last":0.78100000000000003}]},{"osd":6,"last update":"Sun Dec 17 12:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58799999999999997,"15min":0.57399999999999995},"min":{"1min":0.40100000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.78000000000000003,"5min":1.141,"15min":1.141},"last":0.496},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.72199999999999998,"15min":0.68100000000000005},"min":{"1min":0.46600000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.59199999999999997}]},{"osd":7,"last update":"Sun Dec 17 12:02:45 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.66100000000000003,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0209999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.91500000000000004,"15min":0.90600000000000003},"min":{"1min":0.70499999999999996,"5min":0.622,"15min":0.622},"max":{"1min":1.345,"5min":1.395,"15min":1.395},"last":0.79600000000000004}]},{"osd":8,"last update":"Sun Dec 17 12:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.92800000000000005}]},{"osd":9,"last update":"Sun Dec 17 12:03:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.88700000000000001,"15min":0.91500000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.1599999999999999,"5min":1.3,"15min":1.3},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.98299999999999998,"15min":0.99299999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.3740000000000001,"5min":1.456,"15min":1.456},"last":0.77000000000000002}]},{"osd":10,"last update":"Sun Dec 17 12:02:45 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.73999999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]}]},{"osd":4,"up_from":33,"seq":141733920821,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":933888,"data_stored":445940,"data_compressed":5821,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 12:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.57199999999999995,"15min":0.54300000000000004},"min":{"1min":0.48999999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.96899999999999997,"15min":1.103},"min":{"1min":0.46899999999999997,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.294,"5min":13.124000000000001,"15min":13.124000000000001},"last":0.52400000000000002}]},{"osd":1,"last update":"Sun Dec 17 12:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.502,"15min":0.44900000000000001},"min":{"1min":0.377,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.501,"15min":0.45700000000000002},"min":{"1min":0.39100000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.498}]},{"osd":2,"last update":"Sun Dec 17 12:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.70699999999999996,"15min":0.65500000000000003},"min":{"1min":0.504,"5min":0.435,"15min":0.435},"max":{"1min":0.98899999999999999,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.71499999999999997,"15min":0.67000000000000004},"min":{"1min":0.51600000000000001,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1160000000000001,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.68500000000000005}]},{"osd":3,"last update":"Sun Dec 17 12:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66400000000000003,"15min":0.59999999999999998},"min":{"1min":0.50800000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.68500000000000005,"15min":0.61499999999999999},"min":{"1min":0.56499999999999995,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.96499999999999997,"5min":1.121,"15min":1.121},"last":0.66200000000000003}]},{"osd":5,"last update":"Sun Dec 17 12:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.69199999999999995,"15min":0.64800000000000002},"min":{"1min":0.54900000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1970000000000001,"5min":1.21,"15min":1.21},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72699999999999998,"15min":0.69899999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0509999999999999,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.63600000000000001}]},{"osd":6,"last update":"Sun Dec 17 12:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.76600000000000001,"15min":0.75900000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1499999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.78400000000000003,"15min":0.78200000000000003},"min":{"1min":0.61199999999999999,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.97799999999999998,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.70499999999999996}]},{"osd":7,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.752,"15min":0.746},"min":{"1min":0.52400000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.77500000000000002,"15min":0.76500000000000001},"min":{"1min":0.48399999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.75900000000000001}]},{"osd":8,"last update":"Sun Dec 17 12:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3520000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.90000000000000002,"15min":0.90800000000000003},"min":{"1min":0.60999999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1619999999999999,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.83699999999999997}]},{"osd":9,"last update":"Sun Dec 17 12:03:25 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.93200000000000005,"15min":0.93999999999999995},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.2869999999999999,"5min":1.425,"15min":1.425},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.91400000000000003,"15min":0.91700000000000004},"min":{"1min":0.67300000000000004,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.123,"5min":1.274,"15min":1.274},"last":0.90800000000000003}]},{"osd":10,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.752},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.96199999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]}]},{"osd":5,"up_from":38,"seq":163208757296,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":1038220,"data_compressed":41965,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 12:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.65000000000000002,"15min":0.58699999999999997},"min":{"1min":0.36599999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.871,"5min":7.077,"15min":7.077},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59499999999999997,"15min":0.58899999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.57999999999999996}]},{"osd":1,"last update":"Sun Dec 17 12:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.65500000000000003,"15min":0.63100000000000001},"min":{"1min":0.54200000000000004,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.65700000000000003,"15min":0.63400000000000001},"min":{"1min":0.46899999999999997,"5min":0.441,"15min":0.441},"max":{"1min":0.91200000000000003,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.75600000000000001}]},{"osd":2,"last update":"Sun Dec 17 12:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.49199999999999999,"15min":0.48499999999999999},"min":{"1min":0.34100000000000003,"5min":0.307,"15min":0.307},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53500000000000003,"15min":0.54200000000000004},"min":{"1min":0.35799999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78600000000000003,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.71599999999999997}]},{"osd":3,"last update":"Sun Dec 17 12:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.64400000000000002,"15min":0.63800000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85699999999999998,"5min":1.026,"15min":1.026},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67100000000000004,"15min":0.64700000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0700000000000001,"5min":1.548,"15min":1.548},"last":0.44}]},{"osd":4,"last update":"Sun Dec 17 12:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.72799999999999998,"15min":0.70899999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73199999999999998,"15min":0.72999999999999998},"min":{"1min":0.496,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.96099999999999997,"5min":1.345,"15min":1.345},"last":0.65100000000000002}]},{"osd":6,"last update":"Sun Dec 17 12:03:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.70999999999999996,"15min":0.69499999999999995},"min":{"1min":0.54700000000000004,"5min":0.504,"15min":0.504},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.76300000000000001,"15min":0.73699999999999999},"min":{"1min":0.68100000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.66100000000000003}]},{"osd":7,"last update":"Sun Dec 17 12:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76100000000000001,"15min":0.75900000000000001},"min":{"1min":0.49199999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.90100000000000002,"15min":0.91500000000000004},"min":{"1min":0.54500000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.034,"5min":3.4620000000000002,"15min":3.4620000000000002},"last":0.74399999999999999}]},{"osd":8,"last update":"Sun Dec 17 12:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.73799999999999999,"15min":0.72499999999999998},"min":{"1min":0.46100000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.73599999999999999,"15min":0.72399999999999998},"min":{"1min":0.48399999999999999,"5min":0.436,"15min":0.436},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.878}]},{"osd":9,"last update":"Sun Dec 17 12:03:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.78500000000000003,"15min":0.78300000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0529999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.88500000000000001,"15min":0.88},"min":{"1min":0.52300000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.77700000000000002}]},{"osd":10,"last update":"Sun Dec 17 12:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.84599999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34502,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34502,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34502,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36144,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36144,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36144,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36144,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":59882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":60491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":60255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-17T12:03:39.997 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph pg dump --format=json 2023-12-17T12:03:40.423 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:03:40.762 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:40 smithi008 ceph-mon[36830]: pgmap v291: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2023-12-17T12:03:40.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:40 smithi100 ceph-mon[41266]: pgmap v291: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2023-12-17T12:03:40.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:40 smithi186 ceph-mon[41182]: pgmap v291: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2023-12-17T12:03:41.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.643+0000 7fc949091700 1 -- 172.21.15.8:0/3568048916 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc944107650 msgr2=0x7fc944107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:41.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.643+0000 7fc949091700 1 --2- 172.21.15.8:0/3568048916 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc944107650 0x7fc944107a30 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc934009990 tx=0x7fc934009ca0 comp rx=0 tx=0).stop 2023-12-17T12:03:41.646 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.643+0000 7fc949091700 1 -- 172.21.15.8:0/3568048916 shutdown_connections 2023-12-17T12:03:41.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.644+0000 7fc949091700 1 --2- 172.21.15.8:0/3568048916 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc94406a1c0 0x7fc94410e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:41.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.644+0000 7fc949091700 1 --2- 172.21.15.8:0/3568048916 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc944107650 0x7fc944107a30 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:41.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.644+0000 7fc949091700 1 --2- 172.21.15.8:0/3568048916 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc944069800 0x7fc944069c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:41.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.644+0000 7fc949091700 1 -- 172.21.15.8:0/3568048916 >> 172.21.15.8:0/3568048916 conn(0x7fc944076570 msgr2=0x7fc944076980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:41.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.644+0000 7fc949091700 1 -- 172.21.15.8:0/3568048916 shutdown_connections 2023-12-17T12:03:41.647 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.644+0000 7fc949091700 1 -- 172.21.15.8:0/3568048916 wait complete. 2023-12-17T12:03:41.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.645+0000 7fc949091700 1 Processor -- start 2023-12-17T12:03:41.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.645+0000 7fc949091700 1 -- start start 2023-12-17T12:03:41.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.645+0000 7fc949091700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc944069800 0x7fc94419f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:41.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.645+0000 7fc949091700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc94406a1c0 0x7fc94419fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:41.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.645+0000 7fc949091700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc944107650 0x7fc944199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:41.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.645+0000 7fc949091700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc944199fe0 con 0x7fc94406a1c0 2023-12-17T12:03:41.649 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.645+0000 7fc949091700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94419a120 con 0x7fc944107650 2023-12-17T12:03:41.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.645+0000 7fc949091700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94419a2e0 con 0x7fc944069800 2023-12-17T12:03:41.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.646+0000 7fc94259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc94406a1c0 0x7fc94419fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:41.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.646+0000 7fc942d9d700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc944069800 0x7fc94419f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:41.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.646+0000 7fc94259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc94406a1c0 0x7fc94419fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57220/0 (socket says 172.21.15.8:57220) 2023-12-17T12:03:41.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.646+0000 7fc94259c700 1 -- 172.21.15.8:0/3108996290 learned_addr learned my addr 172.21.15.8:0/3108996290 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:41.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.646+0000 7fc94359e700 1 --2- 172.21.15.8:0/3108996290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc944107650 0x7fc944199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:41.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.646+0000 7fc94259c700 1 -- 172.21.15.8:0/3108996290 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc944069800 msgr2=0x7fc94419f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:41.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.646+0000 7fc94259c700 1 --2- 172.21.15.8:0/3108996290 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc944069800 0x7fc94419f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:41.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.646+0000 7fc94259c700 1 -- 172.21.15.8:0/3108996290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc944107650 msgr2=0x7fc944199980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:41.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.646+0000 7fc94259c700 1 --2- 172.21.15.8:0/3108996290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc944107650 0x7fc944199980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:41.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.646+0000 7fc94259c700 1 -- 172.21.15.8:0/3108996290 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9340095f0 con 0x7fc94406a1c0 2023-12-17T12:03:41.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.646+0000 7fc94359e700 1 --2- 172.21.15.8:0/3108996290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc944107650 0x7fc944199980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T12:03:41.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.646+0000 7fc94259c700 1 --2- 172.21.15.8:0/3108996290 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc94406a1c0 0x7fc94419fc60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc93800d950 tx=0x7fc93800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:41.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.647+0000 7fc92bfff700 1 -- 172.21.15.8:0/3108996290 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc938009940 con 0x7fc94406a1c0 2023-12-17T12:03:41.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.647+0000 7fc949091700 1 -- 172.21.15.8:0/3108996290 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc94419a5c0 con 0x7fc94406a1c0 2023-12-17T12:03:41.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.647+0000 7fc92bfff700 1 -- 172.21.15.8:0/3108996290 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc938010460 con 0x7fc94406a1c0 2023-12-17T12:03:41.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.647+0000 7fc92bfff700 1 -- 172.21.15.8:0/3108996290 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93800f620 con 0x7fc94406a1c0 2023-12-17T12:03:41.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.647+0000 7fc949091700 1 -- 172.21.15.8:0/3108996290 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9441a67c0 con 0x7fc94406a1c0 2023-12-17T12:03:41.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.648+0000 7fc949091700 1 -- 172.21.15.8:0/3108996290 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc944102cf0 con 0x7fc94406a1c0 2023-12-17T12:03:41.652 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.650+0000 7fc92bfff700 1 -- 172.21.15.8:0/3108996290 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7fc9380105d0 con 0x7fc94406a1c0 2023-12-17T12:03:41.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.651+0000 7fc92bfff700 1 --2- 172.21.15.8:0/3108996290 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fc92c0a1510 0x7fc92c0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:41.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.652+0000 7fc92bfff700 1 -- 172.21.15.8:0/3108996290 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fc9380ccd70 con 0x7fc94406a1c0 2023-12-17T12:03:41.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.652+0000 7fc942d9d700 1 --2- 172.21.15.8:0/3108996290 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fc92c0a1510 0x7fc92c0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:41.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.652+0000 7fc942d9d700 1 --2- 172.21.15.8:0/3108996290 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fc92c0a1510 0x7fc92c0a39d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc93400b5c0 tx=0x7fc934005fb0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:41.658 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.656+0000 7fc92bfff700 1 -- 172.21.15.8:0/3108996290 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fc9380961f0 con 0x7fc94406a1c0 2023-12-17T12:03:41.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:41 smithi008 ceph-mon[36830]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-17T12:03:41.862 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.860+0000 7fc949091700 1 -- 172.21.15.8:0/3108996290 --> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc944111380 con 0x7fc92c0a1510 2023-12-17T12:03:41.873 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.871+0000 7fc92bfff700 1 -- 172.21.15.8:0/3108996290 <== mgr.14154 v2:172.21.15.8:6800/268548699 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+339538 (secure 0 0 0) 0x7fc944111380 con 0x7fc92c0a1510 2023-12-17T12:03:41.879 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:03:41.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.876+0000 7fc949091700 1 -- 172.21.15.8:0/3108996290 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fc92c0a1510 msgr2=0x7fc92c0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:41.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.876+0000 7fc949091700 1 --2- 172.21.15.8:0/3108996290 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fc92c0a1510 0x7fc92c0a39d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc93400b5c0 tx=0x7fc934005fb0 comp rx=0 tx=0).stop 2023-12-17T12:03:41.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.876+0000 7fc949091700 1 -- 172.21.15.8:0/3108996290 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc94406a1c0 msgr2=0x7fc94419fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:41.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.876+0000 7fc949091700 1 --2- 172.21.15.8:0/3108996290 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc94406a1c0 0x7fc94419fc60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fc93800d950 tx=0x7fc93800dc60 comp rx=0 tx=0).stop 2023-12-17T12:03:41.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.877+0000 7fc949091700 1 -- 172.21.15.8:0/3108996290 shutdown_connections 2023-12-17T12:03:41.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.877+0000 7fc949091700 1 --2- 172.21.15.8:0/3108996290 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fc92c0a1510 0x7fc92c0a39d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:41.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.877+0000 7fc949091700 1 --2- 172.21.15.8:0/3108996290 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fc944107650 0x7fc944199980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:41.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.877+0000 7fc949091700 1 --2- 172.21.15.8:0/3108996290 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc944069800 0x7fc94419f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:41.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.877+0000 7fc949091700 1 --2- 172.21.15.8:0/3108996290 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fc94406a1c0 0x7fc94419fc60 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:41.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.877+0000 7fc949091700 1 -- 172.21.15.8:0/3108996290 >> 172.21.15.8:0/3108996290 conn(0x7fc944076570 msgr2=0x7fc9440ff0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:41.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.877+0000 7fc949091700 1 -- 172.21.15.8:0/3108996290 shutdown_connections 2023-12-17T12:03:41.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:41.877+0000 7fc949091700 1 -- 172.21.15.8:0/3108996290 wait complete. 2023-12-17T12:03:41.883 INFO:teuthology.orchestra.run.smithi008.stderr:dumped all 2023-12-17T12:03:41.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:41 smithi100 ceph-mon[41266]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-17T12:03:41.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:41 smithi186 ceph-mon[41182]: from='client.15006 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-17T12:03:42.302 INFO:teuthology.orchestra.run.smithi008.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2023-12-17T12:03:41.450995+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655944,"num_objects":102,"num_object_clones":0,"num_object_copies":306,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":588,"num_read_kb":410,"num_write":418,"num_write_kb":3071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":344,"ondisk_log_size":344,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":335660,"kb_used_data":11396,"kb_used_omap":18,"kb_used_meta":324077,"kb_avail":1124606164,"statfs":{"total":1151940427776,"available":1151596711936,"internally_reserved":0,"allocated":11669504,"data_stored":7303951,"data_compressed":178284,"data_compressed_allocated":233472,"data_compressed_original":1966080,"omap_allocated":19138,"internal_metadata":331855166},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":55,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002710"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.461988+0000","last_change":"2023-12-17T12:02:50.685108+0000","last_active":"2023-12-17T12:03:27.461988+0000","last_peered":"2023-12-17T12:03:27.461988+0000","last_clean":"2023-12-17T12:03:27.461988+0000","last_became_active":"2023-12-17T12:02:50.684394+0000","last_became_peered":"2023-12-17T12:02:50.684394+0000","last_unstale":"2023-12-17T12:03:27.461988+0000","last_undegraded":"2023-12-17T12:03:27.461988+0000","last_fullsized":"2023-12-17T12:03:27.461988+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:42:03.271558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.461528+0000","last_change":"2023-12-17T12:02:50.676657+0000","last_active":"2023-12-17T12:03:27.461528+0000","last_peered":"2023-12-17T12:03:27.461528+0000","last_clean":"2023-12-17T12:03:27.461528+0000","last_became_active":"2023-12-17T12:02:50.676310+0000","last_became_peered":"2023-12-17T12:02:50.676310+0000","last_unstale":"2023-12-17T12:03:27.461528+0000","last_undegraded":"2023-12-17T12:03:27.461528+0000","last_fullsized":"2023-12-17T12:03:27.461528+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:58:16.704219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.461319+0000","last_change":"2023-12-17T12:02:50.691978+0000","last_active":"2023-12-17T12:03:27.461319+0000","last_peered":"2023-12-17T12:03:27.461319+0000","last_clean":"2023-12-17T12:03:27.461319+0000","last_became_active":"2023-12-17T12:02:50.691639+0000","last_became_peered":"2023-12-17T12:02:50.691639+0000","last_unstale":"2023-12-17T12:03:27.461319+0000","last_undegraded":"2023-12-17T12:03:27.461319+0000","last_fullsized":"2023-12-17T12:03:27.461319+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:55:24.002885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.455643+0000","last_change":"2023-12-17T12:02:50.687062+0000","last_active":"2023-12-17T12:03:27.455643+0000","last_peered":"2023-12-17T12:03:27.455643+0000","last_clean":"2023-12-17T12:03:27.455643+0000","last_became_active":"2023-12-17T12:02:50.685906+0000","last_became_peered":"2023-12-17T12:02:50.685906+0000","last_unstale":"2023-12-17T12:03:27.455643+0000","last_undegraded":"2023-12-17T12:03:27.455643+0000","last_fullsized":"2023-12-17T12:03:27.455643+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:15:22.367700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.456822+0000","last_change":"2023-12-17T12:02:50.681528+0000","last_active":"2023-12-17T12:03:27.456822+0000","last_peered":"2023-12-17T12:03:27.456822+0000","last_clean":"2023-12-17T12:03:27.456822+0000","last_became_active":"2023-12-17T12:02:50.681206+0000","last_became_peered":"2023-12-17T12:02:50.681206+0000","last_unstale":"2023-12-17T12:03:27.456822+0000","last_undegraded":"2023-12-17T12:03:27.456822+0000","last_fullsized":"2023-12-17T12:03:27.456822+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:46:48.146735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-17T12:03:28.462022+0000","last_change":"2023-12-17T12:03:28.462022+0000","last_active":"2023-12-17T12:03:28.462022+0000","last_peered":"2023-12-17T12:03:28.462022+0000","last_clean":"2023-12-17T12:03:28.462022+0000","last_became_active":"2023-12-17T12:03:28.461722+0000","last_became_peered":"2023-12-17T12:03:28.461722+0000","last_unstale":"2023-12-17T12:03:28.462022+0000","last_undegraded":"2023-12-17T12:03:28.462022+0000","last_fullsized":"2023-12-17T12:03:28.462022+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:29:24.035940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,7],"acting":[10,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-17T12:03:28.590774+0000","last_change":"2023-12-17T12:03:28.590774+0000","last_active":"2023-12-17T12:03:28.590774+0000","last_peered":"2023-12-17T12:03:28.590774+0000","last_clean":"2023-12-17T12:03:28.590774+0000","last_became_active":"2023-12-17T12:03:28.590276+0000","last_became_peered":"2023-12-17T12:03:28.590276+0000","last_unstale":"2023-12-17T12:03:28.590774+0000","last_undegraded":"2023-12-17T12:03:28.590774+0000","last_fullsized":"2023-12-17T12:03:28.590774+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:38:56.633581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,8],"acting":[7,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.458083+0000","last_change":"2023-12-17T12:02:50.687583+0000","last_active":"2023-12-17T12:03:27.458083+0000","last_peered":"2023-12-17T12:03:27.458083+0000","last_clean":"2023-12-17T12:03:27.458083+0000","last_became_active":"2023-12-17T12:02:50.687232+0000","last_became_peered":"2023-12-17T12:02:50.687232+0000","last_unstale":"2023-12-17T12:03:27.458083+0000","last_undegraded":"2023-12-17T12:03:27.458083+0000","last_fullsized":"2023-12-17T12:03:27.458083+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:48:22.795244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.458160+0000","last_change":"2023-12-17T12:02:50.683443+0000","last_active":"2023-12-17T12:03:27.458160+0000","last_peered":"2023-12-17T12:03:27.458160+0000","last_clean":"2023-12-17T12:03:27.458160+0000","last_became_active":"2023-12-17T12:02:50.683092+0000","last_became_peered":"2023-12-17T12:02:50.683092+0000","last_unstale":"2023-12-17T12:03:27.458160+0000","last_undegraded":"2023-12-17T12:03:27.458160+0000","last_fullsized":"2023-12-17T12:03:27.458160+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:56:24.455890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.451946+0000","last_change":"2023-12-17T12:02:50.689885+0000","last_active":"2023-12-17T12:03:27.451946+0000","last_peered":"2023-12-17T12:03:27.451946+0000","last_clean":"2023-12-17T12:03:27.451946+0000","last_became_active":"2023-12-17T12:02:50.689312+0000","last_became_peered":"2023-12-17T12:02:50.689312+0000","last_unstale":"2023-12-17T12:03:27.451946+0000","last_undegraded":"2023-12-17T12:03:27.451946+0000","last_fullsized":"2023-12-17T12:03:27.451946+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:23:35.348565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.454271+0000","last_change":"2023-12-17T12:02:50.684120+0000","last_active":"2023-12-17T12:03:27.454271+0000","last_peered":"2023-12-17T12:03:27.454271+0000","last_clean":"2023-12-17T12:03:27.454271+0000","last_became_active":"2023-12-17T12:02:50.683811+0000","last_became_peered":"2023-12-17T12:02:50.683811+0000","last_unstale":"2023-12-17T12:03:27.454271+0000","last_undegraded":"2023-12-17T12:03:27.454271+0000","last_fullsized":"2023-12-17T12:03:27.454271+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:58:14.651264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.455461+0000","last_change":"2023-12-17T12:02:50.678350+0000","last_active":"2023-12-17T12:03:27.455461+0000","last_peered":"2023-12-17T12:03:27.455461+0000","last_clean":"2023-12-17T12:03:27.455461+0000","last_became_active":"2023-12-17T12:02:50.677640+0000","last_became_peered":"2023-12-17T12:02:50.677640+0000","last_unstale":"2023-12-17T12:03:27.455461+0000","last_undegraded":"2023-12-17T12:03:27.455461+0000","last_fullsized":"2023-12-17T12:03:27.455461+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:01:54.303216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-17T12:03:28.461996+0000","last_change":"2023-12-17T12:03:28.461996+0000","last_active":"2023-12-17T12:03:28.461996+0000","last_peered":"2023-12-17T12:03:28.461996+0000","last_clean":"2023-12-17T12:03:28.461996+0000","last_became_active":"2023-12-17T12:03:28.461667+0000","last_became_peered":"2023-12-17T12:03:28.461667+0000","last_unstale":"2023-12-17T12:03:28.461996+0000","last_undegraded":"2023-12-17T12:03:28.461996+0000","last_fullsized":"2023-12-17T12:03:28.461996+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:03:56.084937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.460073+0000","last_change":"2023-12-17T12:02:50.686975+0000","last_active":"2023-12-17T12:03:27.460073+0000","last_peered":"2023-12-17T12:03:27.460073+0000","last_clean":"2023-12-17T12:03:27.460073+0000","last_became_active":"2023-12-17T12:02:50.684301+0000","last_became_peered":"2023-12-17T12:02:50.684301+0000","last_unstale":"2023-12-17T12:03:27.460073+0000","last_undegraded":"2023-12-17T12:03:27.460073+0000","last_fullsized":"2023-12-17T12:03:27.460073+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:43:43.676085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-17T12:03:28.468251+0000","last_change":"2023-12-17T12:03:28.468251+0000","last_active":"2023-12-17T12:03:28.468251+0000","last_peered":"2023-12-17T12:03:28.468251+0000","last_clean":"2023-12-17T12:03:28.468251+0000","last_became_active":"2023-12-17T12:03:28.466855+0000","last_became_peered":"2023-12-17T12:03:28.466855+0000","last_unstale":"2023-12-17T12:03:28.468251+0000","last_undegraded":"2023-12-17T12:03:28.468251+0000","last_fullsized":"2023-12-17T12:03:28.468251+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:56:42.987063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.455919+0000","last_change":"2023-12-17T12:02:50.691615+0000","last_active":"2023-12-17T12:03:27.455919+0000","last_peered":"2023-12-17T12:03:27.455919+0000","last_clean":"2023-12-17T12:03:27.455919+0000","last_became_active":"2023-12-17T12:02:50.690942+0000","last_became_peered":"2023-12-17T12:02:50.690942+0000","last_unstale":"2023-12-17T12:03:27.455919+0000","last_undegraded":"2023-12-17T12:03:27.455919+0000","last_fullsized":"2023-12-17T12:03:27.455919+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:29:03.412722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.462068+0000","last_change":"2023-12-17T12:02:50.685709+0000","last_active":"2023-12-17T12:03:27.462068+0000","last_peered":"2023-12-17T12:03:27.462068+0000","last_clean":"2023-12-17T12:03:27.462068+0000","last_became_active":"2023-12-17T12:02:50.685111+0000","last_became_peered":"2023-12-17T12:02:50.685111+0000","last_unstale":"2023-12-17T12:03:27.462068+0000","last_undegraded":"2023-12-17T12:03:27.462068+0000","last_fullsized":"2023-12-17T12:03:27.462068+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:26:56.486285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.453150+0000","last_change":"2023-12-17T12:02:50.683639+0000","last_active":"2023-12-17T12:03:27.453150+0000","last_peered":"2023-12-17T12:03:27.453150+0000","last_clean":"2023-12-17T12:03:27.453150+0000","last_became_active":"2023-12-17T12:02:50.683267+0000","last_became_peered":"2023-12-17T12:02:50.683267+0000","last_unstale":"2023-12-17T12:03:27.453150+0000","last_undegraded":"2023-12-17T12:03:27.453150+0000","last_fullsized":"2023-12-17T12:03:27.453150+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:09:01.026688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.454456+0000","last_change":"2023-12-17T12:02:50.690116+0000","last_active":"2023-12-17T12:03:27.454456+0000","last_peered":"2023-12-17T12:03:27.454456+0000","last_clean":"2023-12-17T12:03:27.454456+0000","last_became_active":"2023-12-17T12:02:50.688731+0000","last_became_peered":"2023-12-17T12:02:50.688731+0000","last_unstale":"2023-12-17T12:03:27.454456+0000","last_undegraded":"2023-12-17T12:03:27.454456+0000","last_fullsized":"2023-12-17T12:03:27.454456+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:21:37.730460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"83'13","reported_seq":72,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-17T12:03:39.137640+0000","last_change":"2023-12-17T12:02:49.662068+0000","last_active":"2023-12-17T12:03:39.137640+0000","last_peered":"2023-12-17T12:03:39.137640+0000","last_clean":"2023-12-17T12:03:39.137640+0000","last_became_active":"2023-12-17T12:02:49.661755+0000","last_became_peered":"2023-12-17T12:02:49.661755+0000","last_unstale":"2023-12-17T12:03:39.137640+0000","last_undegraded":"2023-12-17T12:03:39.137640+0000","last_fullsized":"2023-12-17T12:03:39.137640+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:51:16.128618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.458885+0000","last_change":"2023-12-17T12:02:50.687855+0000","last_active":"2023-12-17T12:03:27.458885+0000","last_peered":"2023-12-17T12:03:27.458885+0000","last_clean":"2023-12-17T12:03:27.458885+0000","last_became_active":"2023-12-17T12:02:50.687567+0000","last_became_peered":"2023-12-17T12:02:50.687567+0000","last_unstale":"2023-12-17T12:03:27.458885+0000","last_undegraded":"2023-12-17T12:03:27.458885+0000","last_fullsized":"2023-12-17T12:03:27.458885+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:49:51.627898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.459064+0000","last_change":"2023-12-17T12:02:49.673995+0000","last_active":"2023-12-17T12:03:27.459064+0000","last_peered":"2023-12-17T12:03:27.459064+0000","last_clean":"2023-12-17T12:03:27.459064+0000","last_became_active":"2023-12-17T12:02:49.673509+0000","last_became_peered":"2023-12-17T12:02:49.673509+0000","last_unstale":"2023-12-17T12:03:27.459064+0000","last_undegraded":"2023-12-17T12:03:27.459064+0000","last_fullsized":"2023-12-17T12:03:27.459064+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:53:19.695998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.461682+0000","last_change":"2023-12-17T12:02:50.687537+0000","last_active":"2023-12-17T12:03:27.461682+0000","last_peered":"2023-12-17T12:03:27.461682+0000","last_clean":"2023-12-17T12:03:27.461682+0000","last_became_active":"2023-12-17T12:02:50.687203+0000","last_became_peered":"2023-12-17T12:02:50.687203+0000","last_unstale":"2023-12-17T12:03:27.461682+0000","last_undegraded":"2023-12-17T12:03:27.461682+0000","last_fullsized":"2023-12-17T12:03:27.461682+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:08:27.551628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.457396+0000","last_change":"2023-12-17T12:02:49.666605+0000","last_active":"2023-12-17T12:03:27.457396+0000","last_peered":"2023-12-17T12:03:27.457396+0000","last_clean":"2023-12-17T12:03:27.457396+0000","last_became_active":"2023-12-17T12:02:49.666203+0000","last_became_peered":"2023-12-17T12:02:49.666203+0000","last_unstale":"2023-12-17T12:03:27.457396+0000","last_undegraded":"2023-12-17T12:03:27.457396+0000","last_fullsized":"2023-12-17T12:03:27.457396+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:06:19.429798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.454883+0000","last_change":"2023-12-17T12:02:50.683718+0000","last_active":"2023-12-17T12:03:27.454883+0000","last_peered":"2023-12-17T12:03:27.454883+0000","last_clean":"2023-12-17T12:03:27.454883+0000","last_became_active":"2023-12-17T12:02:50.683417+0000","last_became_peered":"2023-12-17T12:02:50.683417+0000","last_unstale":"2023-12-17T12:03:27.454883+0000","last_undegraded":"2023-12-17T12:03:27.454883+0000","last_fullsized":"2023-12-17T12:03:27.454883+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:10:10.662913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.457136+0000","last_change":"2023-12-17T12:02:49.667711+0000","last_active":"2023-12-17T12:03:27.457136+0000","last_peered":"2023-12-17T12:03:27.457136+0000","last_clean":"2023-12-17T12:03:27.457136+0000","last_became_active":"2023-12-17T12:02:49.667358+0000","last_became_peered":"2023-12-17T12:02:49.667358+0000","last_unstale":"2023-12-17T12:03:27.457136+0000","last_undegraded":"2023-12-17T12:03:27.457136+0000","last_fullsized":"2023-12-17T12:03:27.457136+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:54:38.336318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.451594+0000","last_change":"2023-12-17T12:02:50.684036+0000","last_active":"2023-12-17T12:03:27.451594+0000","last_peered":"2023-12-17T12:03:27.451594+0000","last_clean":"2023-12-17T12:03:27.451594+0000","last_became_active":"2023-12-17T12:02:50.683580+0000","last_became_peered":"2023-12-17T12:02:50.683580+0000","last_unstale":"2023-12-17T12:03:27.451594+0000","last_undegraded":"2023-12-17T12:03:27.451594+0000","last_fullsized":"2023-12-17T12:03:27.451594+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:08:40.380574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"83'6","reported_seq":70,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-17T12:03:39.059941+0000","last_change":"2023-12-17T12:02:49.664481+0000","last_active":"2023-12-17T12:03:39.059941+0000","last_peered":"2023-12-17T12:03:39.059941+0000","last_clean":"2023-12-17T12:03:39.059941+0000","last_became_active":"2023-12-17T12:02:49.659106+0000","last_became_peered":"2023-12-17T12:02:49.659106+0000","last_unstale":"2023-12-17T12:03:39.059941+0000","last_undegraded":"2023-12-17T12:03:39.059941+0000","last_fullsized":"2023-12-17T12:03:39.059941+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:41:05.093724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1011,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":49,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.455981+0000","last_change":"2023-12-17T12:02:50.677862+0000","last_active":"2023-12-17T12:03:27.455981+0000","last_peered":"2023-12-17T12:03:27.455981+0000","last_clean":"2023-12-17T12:03:27.455981+0000","last_became_active":"2023-12-17T12:02:50.677511+0000","last_became_peered":"2023-12-17T12:02:50.677511+0000","last_unstale":"2023-12-17T12:03:27.455981+0000","last_undegraded":"2023-12-17T12:03:27.455981+0000","last_fullsized":"2023-12-17T12:03:27.455981+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:16:05.792201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.450707+0000","last_change":"2023-12-17T12:02:49.654735+0000","last_active":"2023-12-17T12:03:27.450707+0000","last_peered":"2023-12-17T12:03:27.450707+0000","last_clean":"2023-12-17T12:03:27.450707+0000","last_became_active":"2023-12-17T12:02:49.654192+0000","last_became_peered":"2023-12-17T12:02:49.654192+0000","last_unstale":"2023-12-17T12:03:27.450707+0000","last_undegraded":"2023-12-17T12:03:27.450707+0000","last_fullsized":"2023-12-17T12:03:27.450707+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:37:04.500685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.451458+0000","last_change":"2023-12-17T12:02:50.676395+0000","last_active":"2023-12-17T12:03:27.451458+0000","last_peered":"2023-12-17T12:03:27.451458+0000","last_clean":"2023-12-17T12:03:27.451458+0000","last_became_active":"2023-12-17T12:02:50.675969+0000","last_became_peered":"2023-12-17T12:02:50.675969+0000","last_unstale":"2023-12-17T12:03:27.451458+0000","last_undegraded":"2023-12-17T12:03:27.451458+0000","last_fullsized":"2023-12-17T12:03:27.451458+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:36:27.541564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.454117+0000","last_change":"2023-12-17T12:02:49.660990+0000","last_active":"2023-12-17T12:03:27.454117+0000","last_peered":"2023-12-17T12:03:27.454117+0000","last_clean":"2023-12-17T12:03:27.454117+0000","last_became_active":"2023-12-17T12:02:49.660623+0000","last_became_peered":"2023-12-17T12:02:49.660623+0000","last_unstale":"2023-12-17T12:03:27.454117+0000","last_undegraded":"2023-12-17T12:03:27.454117+0000","last_fullsized":"2023-12-17T12:03:27.454117+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:59:58.462681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.457923+0000","last_change":"2023-12-17T12:02:50.677481+0000","last_active":"2023-12-17T12:03:27.457923+0000","last_peered":"2023-12-17T12:03:27.457923+0000","last_clean":"2023-12-17T12:03:27.457923+0000","last_became_active":"2023-12-17T12:02:50.677101+0000","last_became_peered":"2023-12-17T12:02:50.677101+0000","last_unstale":"2023-12-17T12:03:27.457923+0000","last_undegraded":"2023-12-17T12:03:27.457923+0000","last_fullsized":"2023-12-17T12:03:27.457923+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:47:24.777071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.451120+0000","last_change":"2023-12-17T12:02:49.662973+0000","last_active":"2023-12-17T12:03:27.451120+0000","last_peered":"2023-12-17T12:03:27.451120+0000","last_clean":"2023-12-17T12:03:27.451120+0000","last_became_active":"2023-12-17T12:02:49.662653+0000","last_became_peered":"2023-12-17T12:02:49.662653+0000","last_unstale":"2023-12-17T12:03:27.451120+0000","last_undegraded":"2023-12-17T12:03:27.451120+0000","last_fullsized":"2023-12-17T12:03:27.451120+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:01:34.858207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-17T12:03:28.462933+0000","last_change":"2023-12-17T12:03:28.462933+0000","last_active":"2023-12-17T12:03:28.462933+0000","last_peered":"2023-12-17T12:03:28.462933+0000","last_clean":"2023-12-17T12:03:28.462933+0000","last_became_active":"2023-12-17T12:03:28.462508+0000","last_became_peered":"2023-12-17T12:03:28.462508+0000","last_unstale":"2023-12-17T12:03:28.462933+0000","last_undegraded":"2023-12-17T12:03:28.462933+0000","last_fullsized":"2023-12-17T12:03:28.462933+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:06:57.808882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,6,10],"acting":[9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":102,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-17T12:03:37.056220+0000","last_change":"2023-12-17T12:02:49.656001+0000","last_active":"2023-12-17T12:03:37.056220+0000","last_peered":"2023-12-17T12:03:37.056220+0000","last_clean":"2023-12-17T12:03:37.056220+0000","last_became_active":"2023-12-17T12:02:49.655292+0000","last_became_peered":"2023-12-17T12:02:49.655292+0000","last_unstale":"2023-12-17T12:03:37.056220+0000","last_undegraded":"2023-12-17T12:03:37.056220+0000","last_fullsized":"2023-12-17T12:03:37.056220+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:41:34.836929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":83,"num_read_kb":83,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.457902+0000","last_change":"2023-12-17T12:02:50.692734+0000","last_active":"2023-12-17T12:03:27.457902+0000","last_peered":"2023-12-17T12:03:27.457902+0000","last_clean":"2023-12-17T12:03:27.457902+0000","last_became_active":"2023-12-17T12:02:50.691567+0000","last_became_peered":"2023-12-17T12:02:50.691567+0000","last_unstale":"2023-12-17T12:03:27.457902+0000","last_undegraded":"2023-12-17T12:03:27.457902+0000","last_fullsized":"2023-12-17T12:03:27.457902+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:23:39.685352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.453286+0000","last_change":"2023-12-17T12:02:49.664634+0000","last_active":"2023-12-17T12:03:27.453286+0000","last_peered":"2023-12-17T12:03:27.453286+0000","last_clean":"2023-12-17T12:03:27.453286+0000","last_became_active":"2023-12-17T12:02:49.664260+0000","last_became_peered":"2023-12-17T12:02:49.664260+0000","last_unstale":"2023-12-17T12:03:27.453286+0000","last_undegraded":"2023-12-17T12:03:27.453286+0000","last_fullsized":"2023-12-17T12:03:27.453286+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:55:06.887646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.461722+0000","last_change":"2023-12-17T12:02:50.679341+0000","last_active":"2023-12-17T12:03:27.461722+0000","last_peered":"2023-12-17T12:03:27.461722+0000","last_clean":"2023-12-17T12:03:27.461722+0000","last_became_active":"2023-12-17T12:02:50.677115+0000","last_became_peered":"2023-12-17T12:02:50.677115+0000","last_unstale":"2023-12-17T12:03:27.461722+0000","last_undegraded":"2023-12-17T12:03:27.461722+0000","last_fullsized":"2023-12-17T12:03:27.461722+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:59:09.665514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.451648+0000","last_change":"2023-12-17T12:02:49.653748+0000","last_active":"2023-12-17T12:03:27.451648+0000","last_peered":"2023-12-17T12:03:27.451648+0000","last_clean":"2023-12-17T12:03:27.451648+0000","last_became_active":"2023-12-17T12:02:49.652647+0000","last_became_peered":"2023-12-17T12:02:49.652647+0000","last_unstale":"2023-12-17T12:03:27.451648+0000","last_undegraded":"2023-12-17T12:03:27.451648+0000","last_fullsized":"2023-12-17T12:03:27.451648+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:13:40.817124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.455228+0000","last_change":"2023-12-17T12:02:50.686787+0000","last_active":"2023-12-17T12:03:27.455228+0000","last_peered":"2023-12-17T12:03:27.455228+0000","last_clean":"2023-12-17T12:03:27.455228+0000","last_became_active":"2023-12-17T12:02:50.685133+0000","last_became_peered":"2023-12-17T12:02:50.685133+0000","last_unstale":"2023-12-17T12:03:27.455228+0000","last_undegraded":"2023-12-17T12:03:27.455228+0000","last_fullsized":"2023-12-17T12:03:27.455228+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:35:17.972258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'31","reported_seq":141,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-17T12:03:37.055819+0000","last_change":"2023-12-17T12:02:49.662054+0000","last_active":"2023-12-17T12:03:37.055819+0000","last_peered":"2023-12-17T12:03:37.055819+0000","last_clean":"2023-12-17T12:03:37.055819+0000","last_became_active":"2023-12-17T12:02:49.661675+0000","last_became_peered":"2023-12-17T12:02:49.661675+0000","last_unstale":"2023-12-17T12:03:37.055819+0000","last_undegraded":"2023-12-17T12:03:37.055819+0000","last_fullsized":"2023-12-17T12:03:37.055819+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:44:32.547926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58130,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":95,"num_read_kb":104,"num_write":33,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.457225+0000","last_change":"2023-12-17T12:02:50.678514+0000","last_active":"2023-12-17T12:03:27.457225+0000","last_peered":"2023-12-17T12:03:27.457225+0000","last_clean":"2023-12-17T12:03:27.457225+0000","last_became_active":"2023-12-17T12:02:50.677739+0000","last_became_peered":"2023-12-17T12:02:50.677739+0000","last_unstale":"2023-12-17T12:03:27.457225+0000","last_undegraded":"2023-12-17T12:03:27.457225+0000","last_fullsized":"2023-12-17T12:03:27.457225+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:42:36.269803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.454380+0000","last_change":"2023-12-17T12:02:49.655037+0000","last_active":"2023-12-17T12:03:27.454380+0000","last_peered":"2023-12-17T12:03:27.454380+0000","last_clean":"2023-12-17T12:03:27.454380+0000","last_became_active":"2023-12-17T12:02:49.654263+0000","last_became_peered":"2023-12-17T12:02:49.654263+0000","last_unstale":"2023-12-17T12:03:27.454380+0000","last_undegraded":"2023-12-17T12:03:27.454380+0000","last_fullsized":"2023-12-17T12:03:27.454380+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:42:16.512434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-17T12:03:28.461238+0000","last_change":"2023-12-17T12:03:28.461238+0000","last_active":"2023-12-17T12:03:28.461238+0000","last_peered":"2023-12-17T12:03:28.461238+0000","last_clean":"2023-12-17T12:03:28.461238+0000","last_became_active":"2023-12-17T12:03:28.460869+0000","last_became_peered":"2023-12-17T12:03:28.460869+0000","last_unstale":"2023-12-17T12:03:28.461238+0000","last_undegraded":"2023-12-17T12:03:28.461238+0000","last_fullsized":"2023-12-17T12:03:28.461238+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:45:42.438201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,9],"acting":[6,7,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.451775+0000","last_change":"2023-12-17T12:02:49.660993+0000","last_active":"2023-12-17T12:03:27.451775+0000","last_peered":"2023-12-17T12:03:27.451775+0000","last_clean":"2023-12-17T12:03:27.451775+0000","last_became_active":"2023-12-17T12:02:49.658165+0000","last_became_peered":"2023-12-17T12:02:49.658165+0000","last_unstale":"2023-12-17T12:03:27.451775+0000","last_undegraded":"2023-12-17T12:03:27.451775+0000","last_fullsized":"2023-12-17T12:03:27.451775+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:22:41.721994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.454498+0000","last_change":"2023-12-17T12:02:50.679349+0000","last_active":"2023-12-17T12:03:27.454498+0000","last_peered":"2023-12-17T12:03:27.454498+0000","last_clean":"2023-12-17T12:03:27.454498+0000","last_became_active":"2023-12-17T12:02:50.678932+0000","last_became_peered":"2023-12-17T12:02:50.678932+0000","last_unstale":"2023-12-17T12:03:27.454498+0000","last_undegraded":"2023-12-17T12:03:27.454498+0000","last_fullsized":"2023-12-17T12:03:27.454498+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:05:41.517038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'6","reported_seq":64,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-17T12:03:37.113008+0000","last_change":"2023-12-17T12:02:49.656800+0000","last_active":"2023-12-17T12:03:37.113008+0000","last_peered":"2023-12-17T12:03:37.113008+0000","last_clean":"2023-12-17T12:03:37.113008+0000","last_became_active":"2023-12-17T12:02:49.656440+0000","last_became_peered":"2023-12-17T12:02:49.656440+0000","last_unstale":"2023-12-17T12:03:37.113008+0000","last_undegraded":"2023-12-17T12:03:37.113008+0000","last_fullsized":"2023-12-17T12:03:37.113008+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:04:17.951090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":977,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":44,"num_read_kb":3,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.453217+0000","last_change":"2023-12-17T12:02:50.684650+0000","last_active":"2023-12-17T12:03:27.453217+0000","last_peered":"2023-12-17T12:03:27.453217+0000","last_clean":"2023-12-17T12:03:27.453217+0000","last_became_active":"2023-12-17T12:02:50.684209+0000","last_became_peered":"2023-12-17T12:02:50.684209+0000","last_unstale":"2023-12-17T12:03:27.453217+0000","last_undegraded":"2023-12-17T12:03:27.453217+0000","last_fullsized":"2023-12-17T12:03:27.453217+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:51:15.756837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":33,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.456100+0000","last_change":"2023-12-17T12:02:49.673270+0000","last_active":"2023-12-17T12:03:27.456100+0000","last_peered":"2023-12-17T12:03:27.456100+0000","last_clean":"2023-12-17T12:03:27.456100+0000","last_became_active":"2023-12-17T12:02:49.672935+0000","last_became_peered":"2023-12-17T12:02:49.672935+0000","last_unstale":"2023-12-17T12:03:27.456100+0000","last_undegraded":"2023-12-17T12:03:27.456100+0000","last_fullsized":"2023-12-17T12:03:27.456100+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:41:00.777171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-17T12:03:28.590490+0000","last_change":"2023-12-17T12:03:28.590490+0000","last_active":"2023-12-17T12:03:28.590490+0000","last_peered":"2023-12-17T12:03:28.590490+0000","last_clean":"2023-12-17T12:03:28.590490+0000","last_became_active":"2023-12-17T12:03:28.589957+0000","last_became_peered":"2023-12-17T12:03:28.589957+0000","last_unstale":"2023-12-17T12:03:28.590490+0000","last_undegraded":"2023-12-17T12:03:28.590490+0000","last_fullsized":"2023-12-17T12:03:28.590490+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:15:52.936197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,1],"acting":[5,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.457432+0000","last_change":"2023-12-17T12:02:49.667849+0000","last_active":"2023-12-17T12:03:27.457432+0000","last_peered":"2023-12-17T12:03:27.457432+0000","last_clean":"2023-12-17T12:03:27.457432+0000","last_became_active":"2023-12-17T12:02:49.667565+0000","last_became_peered":"2023-12-17T12:02:49.667565+0000","last_unstale":"2023-12-17T12:03:27.457432+0000","last_undegraded":"2023-12-17T12:03:27.457432+0000","last_fullsized":"2023-12-17T12:03:27.457432+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:39:56.248614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.461722+0000","last_change":"2023-12-17T12:02:50.669342+0000","last_active":"2023-12-17T12:03:27.461722+0000","last_peered":"2023-12-17T12:03:27.461722+0000","last_clean":"2023-12-17T12:03:27.461722+0000","last_became_active":"2023-12-17T12:02:50.668007+0000","last_became_peered":"2023-12-17T12:02:50.668007+0000","last_unstale":"2023-12-17T12:03:27.461722+0000","last_undegraded":"2023-12-17T12:03:27.461722+0000","last_fullsized":"2023-12-17T12:03:27.461722+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:54:56.753474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":16,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.453293+0000","last_change":"2023-12-17T12:02:49.656914+0000","last_active":"2023-12-17T12:03:27.453293+0000","last_peered":"2023-12-17T12:03:27.453293+0000","last_clean":"2023-12-17T12:03:27.453293+0000","last_became_active":"2023-12-17T12:02:49.656531+0000","last_became_peered":"2023-12-17T12:02:49.656531+0000","last_unstale":"2023-12-17T12:03:27.453293+0000","last_undegraded":"2023-12-17T12:03:27.453293+0000","last_fullsized":"2023-12-17T12:03:27.453293+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:45:14.558037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.452143+0000","last_change":"2023-12-17T12:02:50.677659+0000","last_active":"2023-12-17T12:03:27.452143+0000","last_peered":"2023-12-17T12:03:27.452143+0000","last_clean":"2023-12-17T12:03:27.452143+0000","last_became_active":"2023-12-17T12:02:50.677311+0000","last_became_peered":"2023-12-17T12:02:50.677311+0000","last_unstale":"2023-12-17T12:03:27.452143+0000","last_undegraded":"2023-12-17T12:03:27.452143+0000","last_fullsized":"2023-12-17T12:03:27.452143+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:20:23.134613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'5","reported_seq":63,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-17T12:03:38.136409+0000","last_change":"2023-12-17T12:02:49.665031+0000","last_active":"2023-12-17T12:03:38.136409+0000","last_peered":"2023-12-17T12:03:38.136409+0000","last_clean":"2023-12-17T12:03:38.136409+0000","last_became_active":"2023-12-17T12:02:49.663004+0000","last_became_peered":"2023-12-17T12:02:49.663004+0000","last_unstale":"2023-12-17T12:03:38.136409+0000","last_undegraded":"2023-12-17T12:03:38.136409+0000","last_fullsized":"2023-12-17T12:03:38.136409+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:19:44.410346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":43,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.451411+0000","last_change":"2023-12-17T12:02:50.685113+0000","last_active":"2023-12-17T12:03:27.451411+0000","last_peered":"2023-12-17T12:03:27.451411+0000","last_clean":"2023-12-17T12:03:27.451411+0000","last_became_active":"2023-12-17T12:02:50.684804+0000","last_became_peered":"2023-12-17T12:02:50.684804+0000","last_unstale":"2023-12-17T12:03:27.451411+0000","last_undegraded":"2023-12-17T12:03:27.451411+0000","last_fullsized":"2023-12-17T12:03:27.451411+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:54:32.686360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.451675+0000","last_change":"2023-12-17T12:02:50.688514+0000","last_active":"2023-12-17T12:03:27.451675+0000","last_peered":"2023-12-17T12:03:27.451675+0000","last_clean":"2023-12-17T12:03:27.451675+0000","last_became_active":"2023-12-17T12:02:50.687800+0000","last_became_peered":"2023-12-17T12:02:50.687800+0000","last_unstale":"2023-12-17T12:03:27.451675+0000","last_undegraded":"2023-12-17T12:03:27.451675+0000","last_fullsized":"2023-12-17T12:03:27.451675+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:41:45.981241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":61,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-17T12:03:36.110919+0000","last_change":"2023-12-17T12:02:49.669423+0000","last_active":"2023-12-17T12:03:36.110919+0000","last_peered":"2023-12-17T12:03:36.110919+0000","last_clean":"2023-12-17T12:03:36.110919+0000","last_became_active":"2023-12-17T12:02:49.668652+0000","last_became_peered":"2023-12-17T12:02:49.668652+0000","last_unstale":"2023-12-17T12:03:36.110919+0000","last_undegraded":"2023-12-17T12:03:36.110919+0000","last_fullsized":"2023-12-17T12:03:36.110919+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:32:02.981652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":41,"num_read_kb":41,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.458311+0000","last_change":"2023-12-17T12:02:50.685913+0000","last_active":"2023-12-17T12:03:27.458311+0000","last_peered":"2023-12-17T12:03:27.458311+0000","last_clean":"2023-12-17T12:03:27.458311+0000","last_became_active":"2023-12-17T12:02:50.684652+0000","last_became_peered":"2023-12-17T12:02:50.684652+0000","last_unstale":"2023-12-17T12:03:27.458311+0000","last_undegraded":"2023-12-17T12:03:27.458311+0000","last_fullsized":"2023-12-17T12:03:27.458311+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:07:11.077987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.454926+0000","last_change":"2023-12-17T12:02:49.653594+0000","last_active":"2023-12-17T12:03:27.454926+0000","last_peered":"2023-12-17T12:03:27.454926+0000","last_clean":"2023-12-17T12:03:27.454926+0000","last_became_active":"2023-12-17T12:02:49.653183+0000","last_became_peered":"2023-12-17T12:02:49.653183+0000","last_unstale":"2023-12-17T12:03:27.454926+0000","last_undegraded":"2023-12-17T12:03:27.454926+0000","last_fullsized":"2023-12-17T12:03:27.454926+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:17:38.111876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":312,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.453388+0000","last_change":"2023-12-17T12:01:45.376881+0000","last_active":"2023-12-17T12:03:27.453388+0000","last_peered":"2023-12-17T12:03:27.453388+0000","last_clean":"2023-12-17T12:03:27.453388+0000","last_became_active":"2023-12-17T12:01:45.376453+0000","last_became_peered":"2023-12-17T12:01:45.376453+0000","last_unstale":"2023-12-17T12:03:27.453388+0000","last_undegraded":"2023-12-17T12:03:27.453388+0000","last_fullsized":"2023-12-17T12:03:27.453388+0000","mapping_epoch":73,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":74,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T11:58:44.022902+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T11:58:44.022902+0000","last_clean_scrub_stamp":"2023-12-17T11:58:44.022902+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:31:55.352161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.454010+0000","last_change":"2023-12-17T12:02:50.683902+0000","last_active":"2023-12-17T12:03:27.454010+0000","last_peered":"2023-12-17T12:03:27.454010+0000","last_clean":"2023-12-17T12:03:27.454010+0000","last_became_active":"2023-12-17T12:02:50.682977+0000","last_became_peered":"2023-12-17T12:02:50.682977+0000","last_unstale":"2023-12-17T12:03:27.454010+0000","last_undegraded":"2023-12-17T12:03:27.454010+0000","last_fullsized":"2023-12-17T12:03:27.454010+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:40:51.002822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.453751+0000","last_change":"2023-12-17T12:02:49.659631+0000","last_active":"2023-12-17T12:03:27.453751+0000","last_peered":"2023-12-17T12:03:27.453751+0000","last_clean":"2023-12-17T12:03:27.453751+0000","last_became_active":"2023-12-17T12:02:49.658336+0000","last_became_peered":"2023-12-17T12:02:49.658336+0000","last_unstale":"2023-12-17T12:03:27.453751+0000","last_undegraded":"2023-12-17T12:03:27.453751+0000","last_fullsized":"2023-12-17T12:03:27.453751+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:05:27.210484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.457480+0000","last_change":"2023-12-17T12:02:49.675201+0000","last_active":"2023-12-17T12:03:27.457480+0000","last_peered":"2023-12-17T12:03:27.457480+0000","last_clean":"2023-12-17T12:03:27.457480+0000","last_became_active":"2023-12-17T12:02:49.674759+0000","last_became_peered":"2023-12-17T12:02:49.674759+0000","last_unstale":"2023-12-17T12:03:27.457480+0000","last_undegraded":"2023-12-17T12:03:27.457480+0000","last_fullsized":"2023-12-17T12:03:27.457480+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:20:04.166073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.454280+0000","last_change":"2023-12-17T12:02:50.687776+0000","last_active":"2023-12-17T12:03:27.454280+0000","last_peered":"2023-12-17T12:03:27.454280+0000","last_clean":"2023-12-17T12:03:27.454280+0000","last_became_active":"2023-12-17T12:02:50.687428+0000","last_became_peered":"2023-12-17T12:02:50.687428+0000","last_unstale":"2023-12-17T12:03:27.454280+0000","last_undegraded":"2023-12-17T12:03:27.454280+0000","last_fullsized":"2023-12-17T12:03:27.454280+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:59:33.970025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'10","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.453245+0000","last_change":"2023-12-17T12:02:49.655786+0000","last_active":"2023-12-17T12:03:27.453245+0000","last_peered":"2023-12-17T12:03:27.453245+0000","last_clean":"2023-12-17T12:03:27.453245+0000","last_became_active":"2023-12-17T12:02:49.655141+0000","last_became_peered":"2023-12-17T12:02:49.655141+0000","last_unstale":"2023-12-17T12:03:27.453245+0000","last_undegraded":"2023-12-17T12:03:27.453245+0000","last_fullsized":"2023-12-17T12:03:27.453245+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:53:08.992755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.458813+0000","last_change":"2023-12-17T12:02:50.677999+0000","last_active":"2023-12-17T12:03:27.458813+0000","last_peered":"2023-12-17T12:03:27.458813+0000","last_clean":"2023-12-17T12:03:27.458813+0000","last_became_active":"2023-12-17T12:02:50.677631+0000","last_became_peered":"2023-12-17T12:02:50.677631+0000","last_unstale":"2023-12-17T12:03:27.458813+0000","last_undegraded":"2023-12-17T12:03:27.458813+0000","last_fullsized":"2023-12-17T12:03:27.458813+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:07:16.006293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.455829+0000","last_change":"2023-12-17T12:02:49.654073+0000","last_active":"2023-12-17T12:03:27.455829+0000","last_peered":"2023-12-17T12:03:27.455829+0000","last_clean":"2023-12-17T12:03:27.455829+0000","last_became_active":"2023-12-17T12:02:49.653064+0000","last_became_peered":"2023-12-17T12:02:49.653064+0000","last_unstale":"2023-12-17T12:03:27.455829+0000","last_undegraded":"2023-12-17T12:03:27.455829+0000","last_fullsized":"2023-12-17T12:03:27.455829+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:48:53.075054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.461623+0000","last_change":"2023-12-17T12:02:50.675577+0000","last_active":"2023-12-17T12:03:27.461623+0000","last_peered":"2023-12-17T12:03:27.461623+0000","last_clean":"2023-12-17T12:03:27.461623+0000","last_became_active":"2023-12-17T12:02:50.675142+0000","last_became_peered":"2023-12-17T12:02:50.675142+0000","last_unstale":"2023-12-17T12:03:27.461623+0000","last_undegraded":"2023-12-17T12:03:27.461623+0000","last_fullsized":"2023-12-17T12:03:27.461623+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:38:38.865207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-17T12:03:28.487658+0000","last_change":"2023-12-17T12:03:28.487658+0000","last_active":"2023-12-17T12:03:28.487658+0000","last_peered":"2023-12-17T12:03:28.487658+0000","last_clean":"2023-12-17T12:03:28.487658+0000","last_became_active":"2023-12-17T12:03:28.484258+0000","last_became_peered":"2023-12-17T12:03:28.484258+0000","last_unstale":"2023-12-17T12:03:28.487658+0000","last_undegraded":"2023-12-17T12:03:28.487658+0000","last_fullsized":"2023-12-17T12:03:28.487658+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:48:25.919813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.456230+0000","last_change":"2023-12-17T12:02:50.677089+0000","last_active":"2023-12-17T12:03:27.456230+0000","last_peered":"2023-12-17T12:03:27.456230+0000","last_clean":"2023-12-17T12:03:27.456230+0000","last_became_active":"2023-12-17T12:02:50.676405+0000","last_became_peered":"2023-12-17T12:02:50.676405+0000","last_unstale":"2023-12-17T12:03:27.456230+0000","last_undegraded":"2023-12-17T12:03:27.456230+0000","last_fullsized":"2023-12-17T12:03:27.456230+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:32:55.011141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":22,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.458554+0000","last_change":"2023-12-17T12:02:49.659949+0000","last_active":"2023-12-17T12:03:27.458554+0000","last_peered":"2023-12-17T12:03:27.458554+0000","last_clean":"2023-12-17T12:03:27.458554+0000","last_became_active":"2023-12-17T12:02:49.659552+0000","last_became_peered":"2023-12-17T12:02:49.659552+0000","last_unstale":"2023-12-17T12:03:27.458554+0000","last_undegraded":"2023-12-17T12:03:27.458554+0000","last_fullsized":"2023-12-17T12:03:27.458554+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:39:26.912670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.461559+0000","last_change":"2023-12-17T12:02:50.680666+0000","last_active":"2023-12-17T12:03:27.461559+0000","last_peered":"2023-12-17T12:03:27.461559+0000","last_clean":"2023-12-17T12:03:27.461559+0000","last_became_active":"2023-12-17T12:02:50.680288+0000","last_became_peered":"2023-12-17T12:02:50.680288+0000","last_unstale":"2023-12-17T12:03:27.461559+0000","last_undegraded":"2023-12-17T12:03:27.461559+0000","last_fullsized":"2023-12-17T12:03:27.461559+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:52:36.966423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":18,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.454357+0000","last_change":"2023-12-17T12:02:49.655780+0000","last_active":"2023-12-17T12:03:27.454357+0000","last_peered":"2023-12-17T12:03:27.454357+0000","last_clean":"2023-12-17T12:03:27.454357+0000","last_became_active":"2023-12-17T12:02:49.655455+0000","last_became_peered":"2023-12-17T12:02:49.655455+0000","last_unstale":"2023-12-17T12:03:27.454357+0000","last_undegraded":"2023-12-17T12:03:27.454357+0000","last_fullsized":"2023-12-17T12:03:27.454357+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:14:42.145280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.458696+0000","last_change":"2023-12-17T12:02:50.682874+0000","last_active":"2023-12-17T12:03:27.458696+0000","last_peered":"2023-12-17T12:03:27.458696+0000","last_clean":"2023-12-17T12:03:27.458696+0000","last_became_active":"2023-12-17T12:02:50.682521+0000","last_became_peered":"2023-12-17T12:02:50.682521+0000","last_unstale":"2023-12-17T12:03:27.458696+0000","last_undegraded":"2023-12-17T12:03:27.458696+0000","last_fullsized":"2023-12-17T12:03:27.458696+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T15:51:21.609286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.456868+0000","last_change":"2023-12-17T12:02:49.666401+0000","last_active":"2023-12-17T12:03:27.456868+0000","last_peered":"2023-12-17T12:03:27.456868+0000","last_clean":"2023-12-17T12:03:27.456868+0000","last_became_active":"2023-12-17T12:02:49.663964+0000","last_became_peered":"2023-12-17T12:02:49.663964+0000","last_unstale":"2023-12-17T12:03:27.456868+0000","last_undegraded":"2023-12-17T12:03:27.456868+0000","last_fullsized":"2023-12-17T12:03:27.456868+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:07:45.806809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.454427+0000","last_change":"2023-12-17T12:02:50.689647+0000","last_active":"2023-12-17T12:03:27.454427+0000","last_peered":"2023-12-17T12:03:27.454427+0000","last_clean":"2023-12-17T12:03:27.454427+0000","last_became_active":"2023-12-17T12:02:50.686507+0000","last_became_peered":"2023-12-17T12:02:50.686507+0000","last_unstale":"2023-12-17T12:03:27.454427+0000","last_undegraded":"2023-12-17T12:03:27.454427+0000","last_fullsized":"2023-12-17T12:03:27.454427+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:44:33.359008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'5","reported_seq":63,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-17T12:03:37.121381+0000","last_change":"2023-12-17T12:02:49.661156+0000","last_active":"2023-12-17T12:03:37.121381+0000","last_peered":"2023-12-17T12:03:37.121381+0000","last_clean":"2023-12-17T12:03:37.121381+0000","last_became_active":"2023-12-17T12:02:49.660277+0000","last_became_peered":"2023-12-17T12:02:49.660277+0000","last_unstale":"2023-12-17T12:03:37.121381+0000","last_undegraded":"2023-12-17T12:03:37.121381+0000","last_fullsized":"2023-12-17T12:03:37.121381+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T19:58:57.108942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":43,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.454357+0000","last_change":"2023-12-17T12:02:50.684018+0000","last_active":"2023-12-17T12:03:27.454357+0000","last_peered":"2023-12-17T12:03:27.454357+0000","last_clean":"2023-12-17T12:03:27.454357+0000","last_became_active":"2023-12-17T12:02:50.683381+0000","last_became_peered":"2023-12-17T12:02:50.683381+0000","last_unstale":"2023-12-17T12:03:27.454357+0000","last_undegraded":"2023-12-17T12:03:27.454357+0000","last_fullsized":"2023-12-17T12:03:27.454357+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:13:45.847989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":19,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.451522+0000","last_change":"2023-12-17T12:02:49.651097+0000","last_active":"2023-12-17T12:03:27.451522+0000","last_peered":"2023-12-17T12:03:27.451522+0000","last_clean":"2023-12-17T12:03:27.451522+0000","last_became_active":"2023-12-17T12:02:49.650677+0000","last_became_peered":"2023-12-17T12:02:49.650677+0000","last_unstale":"2023-12-17T12:03:27.451522+0000","last_undegraded":"2023-12-17T12:03:27.451522+0000","last_fullsized":"2023-12-17T12:03:27.451522+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:43:51.383835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":15,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.453445+0000","last_change":"2023-12-17T12:02:50.680988+0000","last_active":"2023-12-17T12:03:27.453445+0000","last_peered":"2023-12-17T12:03:27.453445+0000","last_clean":"2023-12-17T12:03:27.453445+0000","last_became_active":"2023-12-17T12:02:50.680254+0000","last_became_peered":"2023-12-17T12:02:50.680254+0000","last_unstale":"2023-12-17T12:03:27.453445+0000","last_undegraded":"2023-12-17T12:03:27.453445+0000","last_fullsized":"2023-12-17T12:03:27.453445+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:18:12.341302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.455014+0000","last_change":"2023-12-17T12:02:49.670420+0000","last_active":"2023-12-17T12:03:27.455014+0000","last_peered":"2023-12-17T12:03:27.455014+0000","last_clean":"2023-12-17T12:03:27.455014+0000","last_became_active":"2023-12-17T12:02:49.668729+0000","last_became_peered":"2023-12-17T12:02:49.668729+0000","last_unstale":"2023-12-17T12:03:27.455014+0000","last_undegraded":"2023-12-17T12:03:27.455014+0000","last_fullsized":"2023-12-17T12:03:27.455014+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:48.571269+0000","last_clean_scrub_stamp":"2023-12-17T12:02:48.571269+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:07:14.206167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.454955+0000","last_change":"2023-12-17T12:02:50.681966+0000","last_active":"2023-12-17T12:03:27.454955+0000","last_peered":"2023-12-17T12:03:27.454955+0000","last_clean":"2023-12-17T12:03:27.454955+0000","last_became_active":"2023-12-17T12:02:50.681628+0000","last_became_peered":"2023-12-17T12:02:50.681628+0000","last_unstale":"2023-12-17T12:03:27.454955+0000","last_undegraded":"2023-12-17T12:03:27.454955+0000","last_fullsized":"2023-12-17T12:03:27.454955+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:11:59.882145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.461553+0000","last_change":"2023-12-17T12:02:50.686865+0000","last_active":"2023-12-17T12:03:27.461553+0000","last_peered":"2023-12-17T12:03:27.461553+0000","last_clean":"2023-12-17T12:03:27.461553+0000","last_became_active":"2023-12-17T12:02:50.684800+0000","last_became_peered":"2023-12-17T12:02:50.684800+0000","last_unstale":"2023-12-17T12:03:27.461553+0000","last_undegraded":"2023-12-17T12:03:27.461553+0000","last_fullsized":"2023-12-17T12:03:27.461553+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:14:27.121624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-17T12:03:28.463257+0000","last_change":"2023-12-17T12:03:28.463257+0000","last_active":"2023-12-17T12:03:28.463257+0000","last_peered":"2023-12-17T12:03:28.463257+0000","last_clean":"2023-12-17T12:03:28.463257+0000","last_became_active":"2023-12-17T12:03:28.462830+0000","last_became_peered":"2023-12-17T12:03:28.462830+0000","last_unstale":"2023-12-17T12:03:28.463257+0000","last_undegraded":"2023-12-17T12:03:28.463257+0000","last_fullsized":"2023-12-17T12:03:28.463257+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:37:30.051602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,6],"acting":[2,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.454223+0000","last_change":"2023-12-17T12:02:50.690916+0000","last_active":"2023-12-17T12:03:27.454223+0000","last_peered":"2023-12-17T12:03:27.454223+0000","last_clean":"2023-12-17T12:03:27.454223+0000","last_became_active":"2023-12-17T12:02:50.690551+0000","last_became_peered":"2023-12-17T12:02:50.690551+0000","last_unstale":"2023-12-17T12:03:27.454223+0000","last_undegraded":"2023-12-17T12:03:27.454223+0000","last_fullsized":"2023-12-17T12:03:27.454223+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:08:42.166489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.461878+0000","last_change":"2023-12-17T12:02:50.680813+0000","last_active":"2023-12-17T12:03:27.461878+0000","last_peered":"2023-12-17T12:03:27.461878+0000","last_clean":"2023-12-17T12:03:27.461878+0000","last_became_active":"2023-12-17T12:02:50.680501+0000","last_became_peered":"2023-12-17T12:02:50.680501+0000","last_unstale":"2023-12-17T12:03:27.461878+0000","last_undegraded":"2023-12-17T12:03:27.461878+0000","last_fullsized":"2023-12-17T12:03:27.461878+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T20:11:50.421163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.454413+0000","last_change":"2023-12-17T12:02:50.678160+0000","last_active":"2023-12-17T12:03:27.454413+0000","last_peered":"2023-12-17T12:03:27.454413+0000","last_clean":"2023-12-17T12:03:27.454413+0000","last_became_active":"2023-12-17T12:02:50.677801+0000","last_became_peered":"2023-12-17T12:02:50.677801+0000","last_unstale":"2023-12-17T12:03:27.454413+0000","last_undegraded":"2023-12-17T12:03:27.454413+0000","last_fullsized":"2023-12-17T12:03:27.454413+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T18:23:50.851920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.461816+0000","last_change":"2023-12-17T12:02:50.671312+0000","last_active":"2023-12-17T12:03:27.461816+0000","last_peered":"2023-12-17T12:03:27.461816+0000","last_clean":"2023-12-17T12:03:27.461816+0000","last_became_active":"2023-12-17T12:02:50.670331+0000","last_became_peered":"2023-12-17T12:02:50.670331+0000","last_unstale":"2023-12-17T12:03:27.461816+0000","last_undegraded":"2023-12-17T12:03:27.461816+0000","last_fullsized":"2023-12-17T12:03:27.461816+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T22:53:35.185205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-12-17T12:03:28.589968+0000","last_change":"2023-12-17T12:03:28.589968+0000","last_active":"2023-12-17T12:03:28.589968+0000","last_peered":"2023-12-17T12:03:28.589968+0000","last_clean":"2023-12-17T12:03:28.589968+0000","last_became_active":"2023-12-17T12:03:28.589119+0000","last_became_peered":"2023-12-17T12:03:28.589119+0000","last_unstale":"2023-12-17T12:03:28.589968+0000","last_undegraded":"2023-12-17T12:03:28.589968+0000","last_fullsized":"2023-12-17T12:03:28.589968+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T17:10:15.036823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,9],"acting":[2,8,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.458790+0000","last_change":"2023-12-17T12:02:50.692248+0000","last_active":"2023-12-17T12:03:27.458790+0000","last_peered":"2023-12-17T12:03:27.458790+0000","last_clean":"2023-12-17T12:03:27.458790+0000","last_became_active":"2023-12-17T12:02:50.691902+0000","last_became_peered":"2023-12-17T12:02:50.691902+0000","last_unstale":"2023-12-17T12:03:27.458790+0000","last_undegraded":"2023-12-17T12:03:27.458790+0000","last_fullsized":"2023-12-17T12:03:27.458790+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T14:00:43.992500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.451045+0000","last_change":"2023-12-17T12:02:50.677912+0000","last_active":"2023-12-17T12:03:27.451045+0000","last_peered":"2023-12-17T12:03:27.451045+0000","last_clean":"2023-12-17T12:03:27.451045+0000","last_became_active":"2023-12-17T12:02:50.676818+0000","last_became_peered":"2023-12-17T12:02:50.676818+0000","last_unstale":"2023-12-17T12:03:27.451045+0000","last_undegraded":"2023-12-17T12:03:27.451045+0000","last_fullsized":"2023-12-17T12:03:27.451045+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T13:16:53.103771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.458368+0000","last_change":"2023-12-17T12:02:50.684966+0000","last_active":"2023-12-17T12:03:27.458368+0000","last_peered":"2023-12-17T12:03:27.458368+0000","last_clean":"2023-12-17T12:03:27.458368+0000","last_became_active":"2023-12-17T12:02:50.684622+0000","last_became_peered":"2023-12-17T12:02:50.684622+0000","last_unstale":"2023-12-17T12:03:27.458368+0000","last_undegraded":"2023-12-17T12:03:27.458368+0000","last_fullsized":"2023-12-17T12:03:27.458368+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T16:58:41.810005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.457056+0000","last_change":"2023-12-17T12:02:50.683939+0000","last_active":"2023-12-17T12:03:27.457056+0000","last_peered":"2023-12-17T12:03:27.457056+0000","last_clean":"2023-12-17T12:03:27.457056+0000","last_became_active":"2023-12-17T12:02:50.682306+0000","last_became_peered":"2023-12-17T12:02:50.682306+0000","last_unstale":"2023-12-17T12:03:27.457056+0000","last_undegraded":"2023-12-17T12:03:27.457056+0000","last_fullsized":"2023-12-17T12:03:27.457056+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T23:02:24.342403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.455099+0000","last_change":"2023-12-17T12:02:50.684219+0000","last_active":"2023-12-17T12:03:27.455099+0000","last_peered":"2023-12-17T12:03:27.455099+0000","last_clean":"2023-12-17T12:03:27.455099+0000","last_became_active":"2023-12-17T12:02:50.681446+0000","last_became_peered":"2023-12-17T12:02:50.681446+0000","last_unstale":"2023-12-17T12:03:27.455099+0000","last_undegraded":"2023-12-17T12:03:27.455099+0000","last_fullsized":"2023-12-17T12:03:27.455099+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T21:14:09.223818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":14,"reported_epoch":84,"state":"active+clean","last_fresh":"2023-12-17T12:03:27.461667+0000","last_change":"2023-12-17T12:02:50.669333+0000","last_active":"2023-12-17T12:03:27.461667+0000","last_peered":"2023-12-17T12:03:27.461667+0000","last_clean":"2023-12-17T12:03:27.461667+0000","last_became_active":"2023-12-17T12:02:50.668958+0000","last_became_peered":"2023-12-17T12:02:50.668958+0000","last_unstale":"2023-12-17T12:03:27.461667+0000","last_undegraded":"2023-12-17T12:03:27.461667+0000","last_fullsized":"2023-12-17T12:03:27.461667+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-17T12:02:49.638070+0000","last_clean_scrub_stamp":"2023-12-17T12:02:49.638070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-18T12:34:37.234282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":393216,"data_stored":4132576,"data_compressed":248082,"data_compressed_allocated":315392,"data_compressed_original":4079616,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65330,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":462,"num_read_kb":301,"num_write":235,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565248,"data_stored":195990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":205,"ondisk_log_size":205,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":78,"seq":335007449110,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":925696,"data_stored":446043,"data_compressed":5821,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 12:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.5880000000000001,"5min":2.5880000000000001,"15min":2.5880000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"last":0.53000000000000003}]},{"osd":1,"last update":"Sun Dec 17 12:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.80400000000000005}]},{"osd":2,"last update":"Sun Dec 17 12:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.90800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":4,"last update":"Sun Dec 17 12:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":2.3849999999999998,"5min":2.3849999999999998,"15min":2.3849999999999998},"last":0.89000000000000001}]},{"osd":5,"last update":"Sun Dec 17 12:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.70999999999999996}]},{"osd":6,"last update":"Sun Dec 17 12:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.2,"5min":1.2,"15min":1.2},"last":0.751},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.85299999999999998}]},{"osd":7,"last update":"Sun Dec 17 12:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.872},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":2.5339999999999998,"5min":2.5339999999999998,"15min":2.5339999999999998},"last":1.0369999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98199999999999998}]},{"osd":9,"last update":"Sun Dec 17 12:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.876,"5min":0.876,"15min":0.876},"min":{"1min":0.71899999999999997,"5min":0.71899999999999997,"15min":0.71899999999999997},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":1.0009999999999999}]},{"osd":10,"last update":"Sun Dec 17 12:03:06 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":2.472,"5min":2.472,"15min":2.472},"last":1.0720000000000001},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":1.4750000000000001,"5min":1.4750000000000001,"15min":1.4750000000000001},"last":1.083}]}]},{"osd":10,"up_from":70,"seq":300647710747,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28072,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717080,"statfs":{"total":95995035648,"available":95966289920,"internally_reserved":0,"allocated":1077248,"data_stored":1095266,"data_compressed":41965,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":1,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.47499999999999998}]},{"osd":2,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"last":1.026},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.59599999999999997}]},{"osd":3,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.083,"5min":1.083,"15min":1.083},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":0.75800000000000001}]},{"osd":4,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.24,"5min":1.24,"15min":1.24},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.343,"5min":1.343,"15min":1.343},"last":0.78700000000000003}]},{"osd":5,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.298,"5min":1.298,"15min":1.298},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.4239999999999999,"5min":1.4239999999999999,"15min":1.4239999999999999},"last":0.63600000000000001}]},{"osd":6,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.3620000000000001,"5min":1.3620000000000001,"15min":1.3620000000000001},"last":1.083}]},{"osd":7,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":1.111}]},{"osd":8,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"max":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"last":0.82899999999999996},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.4299999999999999,"5min":1.4299999999999999,"15min":1.4299999999999999},"last":1.1399999999999999}]},{"osd":9,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.92000000000000004},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.0680000000000001,"15min":1.0680000000000001},"min":{"1min":0.749,"5min":0.749,"15min":0.749},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":1.165}]},{"osd":11,"last update":"Sun Dec 17 12:03:08 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.458,"5min":1.458,"15min":1.458},"last":0.88800000000000001},{"interface":"front","average":{"1min":0.999,"5min":0.999,"15min":0.999},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.96899999999999997}]}]},{"osd":9,"up_from":65,"seq":279172874270,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":445973,"data_compressed":5821,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1599,"internal_metadata":27654593},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 12:03:21 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.55200000000000005,"15min":0.56499999999999995},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.66100000000000003,"5min":1.069,"15min":1.069},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.59199999999999997,"15min":0.60399999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.72699999999999998,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.52400000000000002}]},{"osd":1,"last update":"Sun Dec 17 12:03:21 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.71299999999999997,"15min":0.72499999999999998},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.86799999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.94599999999999995},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.746,"15min":0.754},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.84999999999999998,"5min":1.147,"15min":1.147},"last":0.60699999999999998}]},{"osd":2,"last update":"Sun Dec 17 12:03:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.84199999999999997,"15min":0.85899999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":1.0169999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.80400000000000005,"15min":0.82599999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.92300000000000004,"5min":1.413,"15min":1.413},"last":0.82499999999999996}]},{"osd":3,"last update":"Sun Dec 17 12:03:21 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.74199999999999999,"15min":0.76200000000000001},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.98299999999999998,"5min":1.0640000000000001,"15min":1.0640000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.71399999999999997,"15min":0.73599999999999999},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.96099999999999997,"5min":1.484,"15min":1.484},"last":0.76000000000000001}]},{"osd":4,"last update":"Sun Dec 17 12:03:21 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.88200000000000001,"15min":0.90600000000000003},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.96099999999999997,"5min":1.5700000000000001,"15min":1.5700000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.90900000000000003,"15min":0.93500000000000005},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":0.98599999999999999,"5min":1.8120000000000001,"15min":1.8120000000000001},"last":0.72099999999999997}]},{"osd":5,"last update":"Sun Dec 17 12:03:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78700000000000003,"5min":0.93899999999999995,"15min":0.96499999999999997},"min":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":1.0920000000000001,"5min":1.341,"15min":1.341},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.88300000000000001,"15min":0.90500000000000003},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":0.89200000000000002,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.98999999999999999}]},{"osd":6,"last update":"Sun Dec 17 12:03:21 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.94699999999999995,"15min":0.97699999999999998},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.143,"5min":1.444,"15min":1.444},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.88,"15min":0.90100000000000002},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.05,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":1.0189999999999999}]},{"osd":7,"last update":"Sun Dec 17 12:03:21 2023","interfaces":[{"interface":"back","average":{"1min":0.91600000000000004,"5min":0.92700000000000005,"15min":0.92900000000000005},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.873},{"interface":"front","average":{"1min":0.90700000000000003,"5min":1.046,"15min":1.069},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.1910000000000001,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.95999999999999996}]},{"osd":8,"last update":"Sun Dec 17 12:03:21 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":1.0469999999999999,"15min":1.073},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.238,"5min":1.605,"15min":1.605},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.95799999999999996,"15min":0.97399999999999998},"min":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"max":{"1min":1.2010000000000001,"5min":1.274,"15min":1.274},"last":0.80600000000000005}]},{"osd":10,"last update":"Sun Dec 17 12:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":1.0800000000000001},{"interface":"front","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.92200000000000004}]}]},{"osd":8,"up_from":58,"seq":249108103203,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":942080,"data_stored":446020,"data_compressed":5821,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 12:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.71599999999999997,"15min":0.72199999999999998},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.96699999999999997,"5min":1.093,"15min":1.093},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.73299999999999998,"15min":0.745},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.81699999999999995}]},{"osd":1,"last update":"Sun Dec 17 12:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.749,"15min":0.74299999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.169,"5min":1.169,"15min":1.169},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.67700000000000005,"15min":0.67300000000000004},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.55500000000000005}]},{"osd":2,"last update":"Sun Dec 17 12:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.60199999999999998,"15min":0.60099999999999998},"min":{"1min":0.38,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.995,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.63300000000000001,"15min":0.63200000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.53000000000000003}]},{"osd":3,"last update":"Sun Dec 17 12:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.76900000000000002,"15min":0.77900000000000003},"min":{"1min":0.55200000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.0449999999999999,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.82099999999999995,"15min":0.82599999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.76300000000000001}]},{"osd":4,"last update":"Sun Dec 17 12:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.751,"15min":0.753},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.95699999999999996,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.876,"5min":0.84199999999999997,"15min":0.83599999999999997},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.3049999999999999,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.91400000000000003}]},{"osd":5,"last update":"Sun Dec 17 12:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.73499999999999999,"15min":0.74199999999999999},"min":{"1min":0.40699999999999997,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.0589999999999999,"5min":1.163,"15min":1.163},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.71099999999999997,"15min":0.72099999999999997},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.876,"5min":1.135,"15min":1.135},"last":0.74299999999999999}]},{"osd":6,"last update":"Sun Dec 17 12:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.88500000000000001,"15min":0.89300000000000002},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.2450000000000001,"5min":1.28,"15min":1.28},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.88,"5min":0.91100000000000003,"15min":0.91600000000000004},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.109,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.93700000000000006}]},{"osd":7,"last update":"Sun Dec 17 12:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":0.91900000000000004,"15min":0.91400000000000003},"min":{"1min":0.61599999999999999,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.218,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":1.028},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.871,"15min":0.86499999999999999},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.224,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":0.88200000000000001}]},{"osd":9,"last update":"Sun Dec 17 12:03:26 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.86399999999999999,"15min":0.86199999999999999},"min":{"1min":0.65400000000000003,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.127,"5min":1.1870000000000001,"15min":1.1870000000000001},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.93200000000000005,"15min":0.92700000000000005},"min":{"1min":0.67800000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.1779999999999999,"5min":1.304,"15min":1.304},"last":0.99099999999999999}]},{"osd":10,"last update":"Sun Dec 17 12:02:43 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"min":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"last":1.0409999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0109999999999999}]}]},{"osd":7,"up_from":50,"seq":214748364840,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28000,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717152,"statfs":{"total":95995035648,"available":95966363648,"internally_reserved":0,"allocated":999424,"data_stored":1039262,"data_compressed":41965,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.627,"15min":0.61899999999999999},"min":{"1min":0.47999999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.61499999999999999,"15min":0.60799999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91500000000000004,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.67500000000000004}]},{"osd":1,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.48399999999999999,"15min":0.47599999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56699999999999995,"15min":0.56499999999999995},"min":{"1min":0.38300000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.83399999999999996,"5min":1.056,"15min":1.056},"last":1.01}]},{"osd":2,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":0.80100000000000005,"15min":0.76200000000000001},"min":{"1min":0.54800000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":5.8949999999999996,"5min":5.8949999999999996,"15min":5.8949999999999996},"last":0.71399999999999997},{"interface":"front","average":{"1min":1.024,"5min":0.77900000000000003,"15min":0.73799999999999999},"min":{"1min":0.52100000000000002,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":5.9210000000000003,"5min":5.9210000000000003,"15min":5.9210000000000003},"last":0.67400000000000004}]},{"osd":3,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.66600000000000004,"15min":0.66200000000000003},"min":{"1min":0.53400000000000003,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.84699999999999998,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.995},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.70499999999999996,"15min":0.70099999999999996},"min":{"1min":0.46700000000000003,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.96099999999999997}]},{"osd":4,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"min":{"1min":0.437,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.96899999999999997,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.63500000000000001,"15min":0.626},"min":{"1min":0.45900000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.61299999999999999}]},{"osd":5,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80500000000000005,"15min":0.80400000000000005},"min":{"1min":0.63700000000000001,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":1.093,"5min":1.093,"15min":1.093},"last":0.87},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.98499999999999999,"5min":1.022,"15min":1.022},"last":0.91800000000000004}]},{"osd":6,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.79900000000000004,"15min":0.79300000000000004},"min":{"1min":0.60399999999999998,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.036,"5min":1.125,"15min":1.125},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.79300000000000004,"15min":0.78300000000000003},"min":{"1min":0.66800000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.98099999999999998}]},{"osd":8,"last update":"Sun Dec 17 12:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.84299999999999997,"15min":0.84299999999999997},"min":{"1min":0.54900000000000004,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":1.0509999999999999},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.84699999999999998,"15min":0.84499999999999997},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"last":0.82899999999999996}]},{"osd":9,"last update":"Sun Dec 17 12:03:25 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.86299999999999999,"15min":0.86699999999999999},"min":{"1min":0.59099999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.048,"5min":1.129,"15min":1.129},"last":1.0269999999999999},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.83799999999999997,"15min":0.83999999999999997},"min":{"1min":0.64000000000000001,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":0.98099999999999998,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":1.038}]},{"osd":10,"last update":"Sun Dec 17 12:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.94099999999999995},{"interface":"front","average":{"1min":0.86799999999999999,"5min":0.86799999999999999,"15min":0.86799999999999999},"min":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.76300000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85599999999999998}]}]},{"osd":6,"up_from":45,"seq":193273528364,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":929792,"data_stored":445423,"data_compressed":5821,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 12:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.48899999999999999,"15min":0.48499999999999999},"min":{"1min":0.33300000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.69599999999999995,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.51300000000000001,"15min":0.51700000000000002},"min":{"1min":0.41899999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.629,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.41599999999999998}]},{"osd":1,"last update":"Sun Dec 17 12:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.67200000000000004,"15min":0.66800000000000004},"min":{"1min":0.48099999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.70099999999999996,"15min":0.69299999999999995},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":2.0030000000000001,"5min":2.0030000000000001,"15min":2.0030000000000001},"last":0.77600000000000002}]},{"osd":2,"last update":"Sun Dec 17 12:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70799999999999996,"15min":0.70699999999999996},"min":{"1min":0.56999999999999995,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.89400000000000002,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.71199999999999997,"15min":0.69299999999999995},"min":{"1min":0.54600000000000004,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.4790000000000001,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.60199999999999998}]},{"osd":3,"last update":"Sun Dec 17 12:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.629,"15min":0.63},"min":{"1min":0.38,"5min":0.374,"15min":0.374},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.69299999999999995,"15min":0.69099999999999995},"min":{"1min":0.435,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":0.49399999999999999}]},{"osd":4,"last update":"Sun Dec 17 12:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.76500000000000001,"15min":0.77600000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.179,"5min":1.179,"15min":1.179},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.80300000000000005,"15min":0.81299999999999994},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":1.6319999999999999,"5min":1.6319999999999999,"15min":1.6319999999999999},"last":0.79300000000000004}]},{"osd":5,"last update":"Sun Dec 17 12:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.84599999999999997,"15min":0.84599999999999997},"min":{"1min":0.56100000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.9359999999999999,"5min":1.9359999999999999,"15min":1.9359999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.85299999999999998,"15min":0.85599999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0549999999999999,"5min":1.3520000000000001,"15min":1.3520000000000001},"last":0.63600000000000001}]},{"osd":7,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.1639999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.89000000000000001,"15min":0.89800000000000002},"min":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":1.0960000000000001,"5min":1.3280000000000001,"15min":1.3280000000000001},"last":0.90500000000000003}]},{"osd":8,"last update":"Sun Dec 17 12:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.90800000000000003,"15min":0.92000000000000004},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.046,"5min":1.238,"15min":1.238},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.90400000000000003,"15min":0.91200000000000003},"min":{"1min":0.68000000000000005,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.0029999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.72999999999999998}]},{"osd":9,"last update":"Sun Dec 17 12:03:21 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.84599999999999997,"15min":0.84399999999999997},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.95099999999999996,"15min":0.95499999999999996},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":2.1819999999999999,"5min":2.1819999999999999,"15min":2.1819999999999999},"last":0.754}]},{"osd":10,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.1910000000000001,"5min":1.1910000000000001,"15min":1.1910000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":1.097,"5min":1.097,"15min":1.097},"last":0.84099999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":995328,"data_stored":504733,"data_compressed":5821,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 12:03:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64800000000000002,"5min":0.67300000000000004,"15min":0.64400000000000002},"min":{"1min":0.38100000000000001,"5min":0.312,"15min":0.312},"max":{"1min":0.86099999999999999,"5min":4.7089999999999996,"15min":4.7089999999999996},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.64800000000000002,"15min":0.61399999999999999},"min":{"1min":0.41899999999999998,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.93300000000000005,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.66400000000000003}]},{"osd":2,"last update":"Sun Dec 17 12:02:45 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.68000000000000005,"15min":0.60299999999999998},"min":{"1min":0.53800000000000003,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.139,"5min":3.8809999999999998,"15min":3.8809999999999998},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.69499999999999995,"15min":0.60399999999999998},"min":{"1min":0.59299999999999997,"5min":0.312,"15min":0.312},"max":{"1min":1.0369999999999999,"5min":4.7270000000000003,"15min":4.7270000000000003},"last":1.147}]},{"osd":3,"last update":"Sun Dec 17 12:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.66600000000000004,"15min":0.61399999999999999},"min":{"1min":0.46400000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.96299999999999997,"5min":3.9510000000000001,"15min":3.9510000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.70399999999999996,"15min":0.64400000000000002},"min":{"1min":0.51000000000000001,"5min":0.374,"15min":0.374},"max":{"1min":1.028,"5min":3.8639999999999999,"15min":3.8639999999999999},"last":1.02}]},{"osd":4,"last update":"Sun Dec 17 12:03:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.56200000000000006,"15min":0.499},"min":{"1min":0.41699999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.0249999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.55400000000000005,"15min":0.49099999999999999},"min":{"1min":0.504,"5min":0.307,"15min":0.307},"max":{"1min":1.0589999999999999,"5min":1.099,"15min":1.099},"last":0.61499999999999999}]},{"osd":5,"last update":"Sun Dec 17 12:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.71699999999999997,"15min":0.70099999999999996},"min":{"1min":0.52000000000000002,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.1060000000000001,"5min":1.196,"15min":1.196},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.85799999999999998,"15min":0.872},"min":{"1min":0.64000000000000001,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":1.157,"5min":4.7619999999999996,"15min":4.7619999999999996},"last":1.111}]},{"osd":6,"last update":"Sun Dec 17 12:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.78800000000000003,"15min":0.80600000000000005},"min":{"1min":0.56699999999999995,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.98199999999999998,"5min":3.895,"15min":3.895},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.86499999999999999,"15min":0.88500000000000001},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.0800000000000001,"5min":3.9260000000000002,"15min":3.9260000000000002},"last":0.77900000000000003}]},{"osd":7,"last update":"Sun Dec 17 12:03:37 2023","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.79800000000000004,"15min":0.76100000000000001},"min":{"1min":0.52700000000000002,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.165,"5min":1.3,"15min":1.3},"last":1.0740000000000001},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.72499999999999998,"15min":0.70699999999999996},"min":{"1min":0.46999999999999997,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0349999999999999,"5min":1.175,"15min":1.175},"last":0.80500000000000005}]},{"osd":8,"last update":"Sun Dec 17 12:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.871,"15min":0.86699999999999999},"min":{"1min":0.58599999999999997,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.151,"5min":1.2470000000000001,"15min":1.2470000000000001},"last":0.98099999999999998},{"interface":"front","average":{"1min":0.93799999999999994,"5min":0.92500000000000004,"15min":0.92300000000000004},"min":{"1min":0.71299999999999997,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.27,"5min":1.3300000000000001,"15min":1.3300000000000001},"last":1.228}]},{"osd":9,"last update":"Sun Dec 17 12:03:23 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.84799999999999998,"15min":0.84399999999999997},"min":{"1min":0.60199999999999998,"5min":0.57599999999999996,"15min":0.57599999999999996},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.95599999999999996},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.94899999999999995,"15min":0.94499999999999995},"min":{"1min":0.72599999999999998,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.252,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.91700000000000004}]},{"osd":10,"last update":"Sun Dec 17 12:02:45 2023","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"last":1.1879999999999999},{"interface":"front","average":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.873}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]}]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":446756,"data_compressed":5821,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun Dec 17 12:03:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.64100000000000001,"15min":0.57599999999999996},"min":{"1min":0.42699999999999999,"5min":0.375,"15min":0.375},"max":{"1min":2.0190000000000001,"5min":2.0190000000000001,"15min":2.0190000000000001},"last":0.623},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.62,"15min":0.58199999999999996},"min":{"1min":0.51900000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"last":0.58799999999999997}]},{"osd":2,"last update":"Sun Dec 17 12:02:46 2023","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.65700000000000003,"15min":0.621},"min":{"1min":0.52400000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.74099999999999999,"15min":0.65300000000000002},"min":{"1min":0.49099999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.998,"5min":6.9859999999999998,"15min":6.9859999999999998},"last":0.82599999999999996}]},{"osd":3,"last update":"Sun Dec 17 12:01:08 2023","interfaces":[{"interface":"back","average":{"1min":0.47399999999999998,"5min":0.46100000000000002,"15min":0.45900000000000002},"min":{"1min":0.34000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.72899999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.47399999999999998,"15min":0.46800000000000003},"min":{"1min":0.374,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.67300000000000004,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.46500000000000002}]},{"osd":4,"last update":"Sun Dec 17 12:03:39 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.70999999999999996,"15min":0.64100000000000001},"min":{"1min":0.53300000000000003,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":2.052,"5min":2.052,"15min":2.052},"last":0.745},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.67900000000000005,"15min":0.63600000000000001},"min":{"1min":0.53600000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.5980000000000001,"5min":1.5980000000000001,"15min":1.5980000000000001},"last":0.67400000000000004}]},{"osd":5,"last update":"Sun Dec 17 12:02:59 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.72899999999999998,"15min":0.71099999999999997},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0189999999999999,"5min":1.0609999999999999,"15min":1.0609999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.73999999999999999,"15min":0.71599999999999997},"min":{"1min":0.58199999999999996,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.95799999999999996,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.70099999999999996}]},{"osd":6,"last update":"Sun Dec 17 12:03:17 2023","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.68400000000000005,"15min":0.63500000000000001},"min":{"1min":0.45600000000000002,"5min":0.434,"15min":0.434},"max":{"1min":2.3820000000000001,"5min":2.3820000000000001,"15min":2.3820000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.72699999999999998,"15min":0.67900000000000005},"min":{"1min":0.502,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":0.495}]},{"osd":7,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.77500000000000002,"15min":0.77200000000000002},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.1619999999999999,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.81899999999999995,"15min":0.80800000000000005},"min":{"1min":0.69399999999999995,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.72699999999999998}]},{"osd":8,"last update":"Sun Dec 17 12:02:59 2023","interfaces":[{"interface":"back","average":{"1min":0.86199999999999999,"5min":0.89300000000000002,"15min":0.89800000000000002},"min":{"1min":0.67100000000000004,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.0529999999999999,"5min":1.2350000000000001,"15min":1.2350000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.92400000000000004,"15min":0.92800000000000005},"min":{"1min":0.76400000000000001,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0209999999999999,"5min":1.486,"15min":1.486},"last":0.85899999999999999}]},{"osd":9,"last update":"Sun Dec 17 12:03:23 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.92300000000000004,"15min":0.93100000000000005},"min":{"1min":0.54900000000000004,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.999,"15min":1.0069999999999999},"min":{"1min":0.54200000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.9370000000000001,"5min":1.9370000000000001,"15min":1.9370000000000001},"last":0.78900000000000003}]},{"osd":10,"last update":"Sun Dec 17 12:02:46 2023","interfaces":[{"interface":"back","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.5209999999999999,"5min":1.5209999999999999,"15min":1.5209999999999999},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.78300000000000003}]},{"osd":11,"last update":"Sun Dec 17 12:03:04 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":1.1319999999999999,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.89900000000000002}]}]},{"osd":2,"up_from":18,"seq":77309411391,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1011712,"data_stored":505069,"data_compressed":5821,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 12:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.63800000000000001,"15min":0.60399999999999998},"min":{"1min":0.38400000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.62},{"interface":"front","average":{"1min":0.62,"5min":0.60999999999999999,"15min":0.59499999999999997},"min":{"1min":0.442,"5min":0.377,"15min":0.377},"max":{"1min":0.84199999999999997,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.86699999999999999}]},{"osd":1,"last update":"Sun Dec 17 12:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.63100000000000001,"15min":0.61799999999999999},"min":{"1min":0.50600000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82399999999999995,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.63700000000000001,"15min":0.60699999999999998},"min":{"1min":0.48899999999999999,"5min":0.373,"15min":0.373},"max":{"1min":0.81799999999999995,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.89300000000000002}]},{"osd":3,"last update":"Sun Dec 17 12:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.68600000000000005,"15min":0.65700000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.70899999999999996,"5min":0.66700000000000004,"15min":0.65500000000000003},"min":{"1min":0.42099999999999999,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.66000000000000003}]},{"osd":4,"last update":"Sun Dec 17 12:02:33 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64300000000000002,"15min":0.63200000000000001},"min":{"1min":0.46000000000000002,"5min":0.439,"15min":0.439},"max":{"1min":0.76700000000000002,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.68200000000000005,"15min":0.64600000000000002},"min":{"1min":0.52600000000000002,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.95999999999999996,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.94999999999999996}]},{"osd":5,"last update":"Sun Dec 17 12:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.56000000000000005,"15min":0.53400000000000003},"min":{"1min":0.36099999999999999,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.625,"15min":0.60899999999999999},"min":{"1min":0.41799999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.97499999999999998,"5min":1.0089999999999999,"15min":1.0089999999999999},"last":0.78900000000000003}]},{"osd":6,"last update":"Sun Dec 17 12:03:15 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.81000000000000005,"15min":0.79200000000000004},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.296,"5min":1.296,"15min":1.296},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.79100000000000004,"5min":0.75600000000000001,"15min":0.73799999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"last":0.93300000000000005}]},{"osd":7,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.75600000000000001,"15min":0.76200000000000001},"min":{"1min":0.53700000000000003,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":0.86499999999999999,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.62},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.72599999999999998,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.0549999999999999,"5min":1.212,"15min":1.212},"last":0.54200000000000004}]},{"osd":8,"last update":"Sun Dec 17 12:03:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.76400000000000001,"15min":0.76800000000000002},"min":{"1min":0.53400000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.014,"5min":1.03,"15min":1.03},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.751,"15min":0.76500000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.75}]},{"osd":9,"last update":"Sun Dec 17 12:03:27 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.92300000000000004,"15min":0.91900000000000004},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":1.0029999999999999},{"interface":"front","average":{"1min":0.90300000000000002,"5min":0.873,"15min":0.86799999999999999},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":1.038}]},{"osd":10,"last update":"Sun Dec 17 12:02:44 2023","interfaces":[{"interface":"back","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.748,"5min":0.748,"15min":0.748},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":1.0549999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":1.0720000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0980000000000001}]}]},{"osd":3,"up_from":25,"seq":107374182458,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":946176,"data_stored":445246,"data_compressed":5821,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 12:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.45200000000000001,"15min":0.41999999999999998},"min":{"1min":0.36099999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.81299999999999994,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.47799999999999998,"15min":0.44},"min":{"1min":0.35799999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.51800000000000002}]},{"osd":1,"last update":"Sun Dec 17 12:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.69199999999999995,"15min":0.63},"min":{"1min":0.58099999999999996,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.999},{"interface":"front","average":{"1min":0.746,"5min":0.68500000000000005,"15min":0.64000000000000001},"min":{"1min":0.53900000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.97999999999999998,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.67800000000000005}]},{"osd":2,"last update":"Sun Dec 17 12:03:13 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.626,"15min":0.61799999999999999},"min":{"1min":0.442,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.69199999999999995,"15min":0.64800000000000002},"min":{"1min":0.48999999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.143,"5min":1.27,"15min":1.27},"last":0.871}]},{"osd":4,"last update":"Sun Dec 17 12:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.70299999999999996,"15min":0.66200000000000003},"min":{"1min":0.61499999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.0409999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.74199999999999999,"15min":0.68300000000000005},"min":{"1min":0.68600000000000005,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":1.004,"5min":1.115,"15min":1.115},"last":1.077}]},{"osd":5,"last update":"Sun Dec 17 12:02:58 2023","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.72199999999999998,"15min":0.69799999999999995},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.70699999999999996,"15min":0.68899999999999995},"min":{"1min":0.49099999999999999,"5min":0.441,"15min":0.441},"max":{"1min":1.1279999999999999,"5min":1.137,"15min":1.137},"last":0.60399999999999998}]},{"osd":6,"last update":"Sun Dec 17 12:03:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58799999999999997,"15min":0.57399999999999995},"min":{"1min":0.40100000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.78000000000000003,"5min":1.141,"15min":1.141},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.72199999999999998,"15min":0.68100000000000005},"min":{"1min":0.46600000000000003,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.3,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.80400000000000005}]},{"osd":7,"last update":"Sun Dec 17 12:02:45 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.66100000000000003,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.0209999999999999,"5min":1.1679999999999999,"15min":1.1679999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.91500000000000004,"15min":0.90600000000000003},"min":{"1min":0.70499999999999996,"5min":0.622,"15min":0.622},"max":{"1min":1.345,"5min":1.395,"15min":1.395},"last":0.95899999999999996}]},{"osd":8,"last update":"Sun Dec 17 12:01:57 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":1.0289999999999999},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.92800000000000005}]},{"osd":9,"last update":"Sun Dec 17 12:03:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.88700000000000001,"15min":0.91500000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.1599999999999999,"5min":1.3,"15min":1.3},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.91900000000000004,"5min":0.98299999999999998,"15min":0.99299999999999999},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.3740000000000001,"5min":1.456,"15min":1.456},"last":1.0369999999999999}]},{"osd":10,"last update":"Sun Dec 17 12:02:45 2023","interfaces":[{"interface":"back","average":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.274,"5min":1.274,"15min":1.274},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.85399999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78400000000000003}]}]},{"osd":4,"up_from":33,"seq":141733920821,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":933888,"data_stored":445940,"data_compressed":5821,"data_compressed_allocated":8192,"data_compressed_original":16384,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 12:02:30 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.57199999999999995,"15min":0.54300000000000004},"min":{"1min":0.48999999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.96899999999999997,"15min":1.103},"min":{"1min":0.46899999999999997,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":1.294,"5min":13.124000000000001,"15min":13.124000000000001},"last":0.52400000000000002}]},{"osd":1,"last update":"Sun Dec 17 12:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.502,"15min":0.44900000000000001},"min":{"1min":0.377,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.501,"15min":0.45700000000000002},"min":{"1min":0.39100000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.498}]},{"osd":2,"last update":"Sun Dec 17 12:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.70699999999999996,"15min":0.65500000000000003},"min":{"1min":0.504,"5min":0.435,"15min":0.435},"max":{"1min":0.98899999999999999,"5min":1.0760000000000001,"15min":1.0760000000000001},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.71499999999999997,"15min":0.67000000000000004},"min":{"1min":0.51600000000000001,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.1160000000000001,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.68500000000000005}]},{"osd":3,"last update":"Sun Dec 17 12:03:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.66400000000000003,"15min":0.59999999999999998},"min":{"1min":0.50800000000000001,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.73199999999999998,"5min":0.68500000000000005,"15min":0.61499999999999999},"min":{"1min":0.56499999999999995,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.96499999999999997,"5min":1.121,"15min":1.121},"last":0.66200000000000003}]},{"osd":5,"last update":"Sun Dec 17 12:02:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.69199999999999995,"15min":0.64800000000000002},"min":{"1min":0.54900000000000004,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.1970000000000001,"5min":1.21,"15min":1.21},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.72699999999999998,"15min":0.69899999999999995},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.0509999999999999,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":0.63600000000000001}]},{"osd":6,"last update":"Sun Dec 17 12:03:18 2023","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.76600000000000001,"15min":0.75900000000000001},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.1499999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.78400000000000003,"15min":0.78200000000000003},"min":{"1min":0.61199999999999999,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":0.97799999999999998,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.70499999999999996}]},{"osd":7,"last update":"Sun Dec 17 12:02:37 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.752,"15min":0.746},"min":{"1min":0.52400000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.77500000000000002,"15min":0.76500000000000001},"min":{"1min":0.48399999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.462,"5min":1.462,"15min":1.462},"last":0.75900000000000001}]},{"osd":8,"last update":"Sun Dec 17 12:03:00 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.3520000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.86799999999999999},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.90000000000000002,"15min":0.90800000000000003},"min":{"1min":0.60999999999999999,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":1.1619999999999999,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":0.83699999999999997}]},{"osd":9,"last update":"Sun Dec 17 12:03:25 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.93200000000000005,"15min":0.93999999999999995},"min":{"1min":0.628,"5min":0.628,"15min":0.628},"max":{"1min":1.2869999999999999,"5min":1.425,"15min":1.425},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.91400000000000003,"15min":0.91700000000000004},"min":{"1min":0.67300000000000004,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.123,"5min":1.274,"15min":1.274},"last":0.90800000000000003}]},{"osd":10,"last update":"Sun Dec 17 12:02:42 2023","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.752},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.96199999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]}]},{"osd":5,"up_from":38,"seq":163208757297,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28008,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717144,"statfs":{"total":95995035648,"available":95966355456,"internally_reserved":0,"allocated":1007616,"data_stored":1038220,"data_compressed":41965,"data_compressed_allocated":53248,"data_compressed_original":606208,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Dec 17 12:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.65000000000000002,"15min":0.58699999999999997},"min":{"1min":0.36599999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.871,"5min":7.077,"15min":7.077},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59499999999999997,"15min":0.58899999999999997},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"last":0.72099999999999997}]},{"osd":1,"last update":"Sun Dec 17 12:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.65500000000000003,"15min":0.63100000000000001},"min":{"1min":0.54200000000000004,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.65700000000000003,"15min":0.63400000000000001},"min":{"1min":0.46899999999999997,"5min":0.441,"15min":0.441},"max":{"1min":0.91200000000000003,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.86299999999999999}]},{"osd":2,"last update":"Sun Dec 17 12:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.49199999999999999,"15min":0.48499999999999999},"min":{"1min":0.34100000000000003,"5min":0.307,"15min":0.307},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53500000000000003,"15min":0.54200000000000004},"min":{"1min":0.35799999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.78600000000000003,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.73499999999999999}]},{"osd":3,"last update":"Sun Dec 17 12:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.64400000000000002,"15min":0.63800000000000001},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.85699999999999998,"5min":1.026,"15min":1.026},"last":0.62},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.67100000000000004,"15min":0.64700000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0700000000000001,"5min":1.548,"15min":1.548},"last":0.60399999999999998}]},{"osd":4,"last update":"Sun Dec 17 12:02:57 2023","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.72799999999999998,"15min":0.70899999999999996},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95499999999999996,"5min":0.95499999999999996,"15min":0.95499999999999996},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.73199999999999998,"15min":0.72999999999999998},"min":{"1min":0.496,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.96099999999999997,"5min":1.345,"15min":1.345},"last":0.93799999999999994}]},{"osd":6,"last update":"Sun Dec 17 12:03:23 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.70999999999999996,"15min":0.69499999999999995},"min":{"1min":0.54700000000000004,"5min":0.504,"15min":0.504},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.76300000000000001,"15min":0.73699999999999999},"min":{"1min":0.68100000000000005,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.84199999999999997}]},{"osd":7,"last update":"Sun Dec 17 12:02:41 2023","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76100000000000001,"15min":0.75900000000000001},"min":{"1min":0.49199999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.90400000000000003},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.90100000000000002,"15min":0.91500000000000004},"min":{"1min":0.54500000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.034,"5min":3.4620000000000002,"15min":3.4620000000000002},"last":0.88600000000000001}]},{"osd":8,"last update":"Sun Dec 17 12:03:02 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.73799999999999999,"15min":0.72499999999999998},"min":{"1min":0.46100000000000002,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.73599999999999999,"15min":0.72399999999999998},"min":{"1min":0.48399999999999999,"5min":0.436,"15min":0.436},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":1.0389999999999999}]},{"osd":9,"last update":"Sun Dec 17 12:03:23 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.78500000000000003,"15min":0.78300000000000003},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0529999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.996},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.88500000000000001,"15min":0.88},"min":{"1min":0.52300000000000002,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.2889999999999999,"5min":1.2889999999999999,"15min":1.2889999999999999},"last":0.97099999999999997}]},{"osd":10,"last update":"Sun Dec 17 12:02:47 2023","interfaces":[{"interface":"back","average":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.98699999999999999},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":1.022}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34502,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34502,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34502,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36144,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36144,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36144,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36144,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":59882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":60491,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":60255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-17T12:03:42.307 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-12-17T12:03:42.307 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-17T12:03:42.307 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-12-17T12:03:42.307 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- ceph health --format=json 2023-12-17T12:03:42.734 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:03:42.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:42 smithi008 ceph-mon[36830]: pgmap v292: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2023-12-17T12:03:42.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:42 smithi100 ceph-mon[41266]: pgmap v292: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2023-12-17T12:03:42.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:42 smithi186 ceph-mon[41182]: pgmap v292: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 0 B/s, 0 objects/s recovering 2023-12-17T12:03:43.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.882+0000 7f941bbef700 1 -- 172.21.15.8:0/3191105261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9414102040 msgr2=0x7f941410e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:43.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.882+0000 7f941bbef700 1 --2- 172.21.15.8:0/3191105261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9414102040 0x7f941410e430 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f940c00b0a0 tx=0x7f940c00b3b0 comp rx=0 tx=0).stop 2023-12-17T12:03:43.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.882+0000 7f941bbef700 1 -- 172.21.15.8:0/3191105261 shutdown_connections 2023-12-17T12:03:43.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.882+0000 7f941bbef700 1 --2- 172.21.15.8:0/3191105261 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9414102040 0x7f941410e430 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:43.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.882+0000 7f941bbef700 1 --2- 172.21.15.8:0/3191105261 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f94141076f0 0x7f9414107ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:43.885 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.882+0000 7f941bbef700 1 --2- 172.21.15.8:0/3191105261 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9414101680 0x7f9414101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:43.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.882+0000 7f941bbef700 1 -- 172.21.15.8:0/3191105261 >> 172.21.15.8:0/3191105261 conn(0x7f94140787c0 msgr2=0x7f9414078bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:43.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.882+0000 7f941bbef700 1 -- 172.21.15.8:0/3191105261 shutdown_connections 2023-12-17T12:03:43.886 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.882+0000 7f941bbef700 1 -- 172.21.15.8:0/3191105261 wait complete. 2023-12-17T12:03:43.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.883+0000 7f941bbef700 1 Processor -- start 2023-12-17T12:03:43.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.884+0000 7f941bbef700 1 -- start start 2023-12-17T12:03:43.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.884+0000 7f941bbef700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9414101680 0x7f941419f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:43.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.884+0000 7f941bbef700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9414102040 0x7f941419feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:43.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.884+0000 7f941bbef700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94141076f0 0x7f9414199ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:43.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.884+0000 7f941bbef700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941419a110 con 0x7f94141076f0 2023-12-17T12:03:43.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.884+0000 7f941bbef700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941419a280 con 0x7f9414102040 2023-12-17T12:03:43.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.884+0000 7f941bbef700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941419a440 con 0x7f9414101680 2023-12-17T12:03:43.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.884+0000 7f941a18c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94141076f0 0x7f9414199ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:43.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.884+0000 7f941a18c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94141076f0 0x7f9414199ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57240/0 (socket says 172.21.15.8:57240) 2023-12-17T12:03:43.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.884+0000 7f941a18c700 1 -- 172.21.15.8:0/1255230085 learned_addr learned my addr 172.21.15.8:0/1255230085 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:43.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.884+0000 7f941998b700 1 --2- 172.21.15.8:0/1255230085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9414101680 0x7f941419f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:43.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.884+0000 7f941918a700 1 --2- 172.21.15.8:0/1255230085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9414102040 0x7f941419feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:43.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.885+0000 7f941a18c700 1 -- 172.21.15.8:0/1255230085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9414101680 msgr2=0x7f941419f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:43.888 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.885+0000 7f941a18c700 1 --2- 172.21.15.8:0/1255230085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9414101680 0x7f941419f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:43.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.885+0000 7f941a18c700 1 -- 172.21.15.8:0/1255230085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9414102040 msgr2=0x7f941419feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:43.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.885+0000 7f941a18c700 1 --2- 172.21.15.8:0/1255230085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9414102040 0x7f941419feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:43.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.885+0000 7f941a18c700 1 -- 172.21.15.8:0/1255230085 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f940c009d00 con 0x7f94141076f0 2023-12-17T12:03:43.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.885+0000 7f941998b700 1 --2- 172.21.15.8:0/1255230085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9414101680 0x7f941419f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T12:03:43.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.885+0000 7f941a18c700 1 --2- 172.21.15.8:0/1255230085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94141076f0 0x7f9414199ab0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f940c007930 tx=0x7f940c007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:43.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.885+0000 7f940affd700 1 -- 172.21.15.8:0/1255230085 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c00e040 con 0x7f94141076f0 2023-12-17T12:03:43.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.885+0000 7f940affd700 1 -- 172.21.15.8:0/1255230085 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f940c004c50 con 0x7f94141076f0 2023-12-17T12:03:43.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.885+0000 7f941bbef700 1 -- 172.21.15.8:0/1255230085 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f941419a6c0 con 0x7f94141076f0 2023-12-17T12:03:43.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.885+0000 7f940affd700 1 -- 172.21.15.8:0/1255230085 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c0052a0 con 0x7f94141076f0 2023-12-17T12:03:43.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.885+0000 7f941bbef700 1 -- 172.21.15.8:0/1255230085 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94141a6960 con 0x7f94141076f0 2023-12-17T12:03:43.889 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.886+0000 7f941bbef700 1 -- 172.21.15.8:0/1255230085 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9414102d10 con 0x7f94141076f0 2023-12-17T12:03:43.891 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.888+0000 7f940affd700 1 -- 172.21.15.8:0/1255230085 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f940c01b970 con 0x7f94141076f0 2023-12-17T12:03:43.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.890+0000 7f940affd700 1 --2- 172.21.15.8:0/1255230085 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f94000a1510 0x7f94000a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:43.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.890+0000 7f940affd700 1 -- 172.21.15.8:0/1255230085 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f940c0ce5a0 con 0x7f94141076f0 2023-12-17T12:03:43.892 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.890+0000 7f941998b700 1 --2- 172.21.15.8:0/1255230085 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f94000a1510 0x7f94000a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:43.893 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.891+0000 7f941998b700 1 --2- 172.21.15.8:0/1255230085 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f94000a1510 0x7f94000a39d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9410005e10 tx=0x7f9410005d60 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:43.896 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:43.894+0000 7f940affd700 1 -- 172.21.15.8:0/1255230085 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f940c097ab0 con 0x7f94141076f0 2023-12-17T12:03:43.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:43 smithi100 ceph-mon[41266]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-17T12:03:43.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:43 smithi186 ceph-mon[41182]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-17T12:03:43.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:43 smithi008 ceph-mon[36830]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-12-17T12:03:44.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.147+0000 7f941bbef700 1 -- 172.21.15.8:0/1255230085 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f941404f290 con 0x7f94141076f0 2023-12-17T12:03:44.150 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.148+0000 7f940affd700 1 -- 172.21.15.8:0/1255230085 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f940c09b0d0 con 0x7f94141076f0 2023-12-17T12:03:44.150 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:03:44.150 INFO:teuthology.orchestra.run.smithi008.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-17T12:03:44.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.150+0000 7f941bbef700 1 -- 172.21.15.8:0/1255230085 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f94000a1510 msgr2=0x7f94000a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:44.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.150+0000 7f941bbef700 1 --2- 172.21.15.8:0/1255230085 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f94000a1510 0x7f94000a39d0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9410005e10 tx=0x7f9410005d60 comp rx=0 tx=0).stop 2023-12-17T12:03:44.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.150+0000 7f941bbef700 1 -- 172.21.15.8:0/1255230085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94141076f0 msgr2=0x7f9414199ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:44.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.150+0000 7f941bbef700 1 --2- 172.21.15.8:0/1255230085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94141076f0 0x7f9414199ab0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f940c007930 tx=0x7f940c007a10 comp rx=0 tx=0).stop 2023-12-17T12:03:44.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.150+0000 7f941bbef700 1 -- 172.21.15.8:0/1255230085 shutdown_connections 2023-12-17T12:03:44.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.150+0000 7f941bbef700 1 --2- 172.21.15.8:0/1255230085 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f94000a1510 0x7f94000a39d0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:44.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.150+0000 7f941bbef700 1 --2- 172.21.15.8:0/1255230085 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f94141076f0 0x7f9414199ab0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:44.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.150+0000 7f941bbef700 1 --2- 172.21.15.8:0/1255230085 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9414101680 0x7f941419f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:44.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.150+0000 7f941bbef700 1 --2- 172.21.15.8:0/1255230085 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9414102040 0x7f941419feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:44.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.150+0000 7f941bbef700 1 -- 172.21.15.8:0/1255230085 >> 172.21.15.8:0/1255230085 conn(0x7f94140787c0 msgr2=0x7f94141000f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:44.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.150+0000 7f941bbef700 1 -- 172.21.15.8:0/1255230085 shutdown_connections 2023-12-17T12:03:44.153 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.150+0000 7f941bbef700 1 -- 172.21.15.8:0/1255230085 wait complete. 2023-12-17T12:03:44.561 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-12-17T12:03:44.561 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T12:03:44.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.767+0000 7eff9e9ff700 1 -- 172.21.15.8:0/1263802190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff98101430 msgr2=0x7eff98101850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:44.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.767+0000 7eff9e9ff700 1 --2- 172.21.15.8:0/1263802190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff98101430 0x7eff98101850 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7eff880099c0 tx=0x7eff88009cd0 comp rx=0 tx=0).stop 2023-12-17T12:03:44.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.767+0000 7eff9e9ff700 1 -- 172.21.15.8:0/1263802190 shutdown_connections 2023-12-17T12:03:44.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.767+0000 7eff9e9ff700 1 --2- 172.21.15.8:0/1263802190 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff98102fc0 0x7eff98109870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:44.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.767+0000 7eff9e9ff700 1 --2- 172.21.15.8:0/1263802190 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff98101430 0x7eff98101850 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:44.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.767+0000 7eff9e9ff700 1 --2- 172.21.15.8:0/1263802190 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff98102620 0x7eff98102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:44.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.767+0000 7eff9e9ff700 1 -- 172.21.15.8:0/1263802190 >> 172.21.15.8:0/1263802190 conn(0x7eff980fc980 msgr2=0x7eff980fede0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:44.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.767+0000 7eff9e9ff700 1 -- 172.21.15.8:0/1263802190 shutdown_connections 2023-12-17T12:03:44.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.767+0000 7eff9e9ff700 1 -- 172.21.15.8:0/1263802190 wait complete. 2023-12-17T12:03:44.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.768+0000 7eff9e9ff700 1 Processor -- start 2023-12-17T12:03:44.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.768+0000 7eff9e9ff700 1 -- start start 2023-12-17T12:03:44.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.768+0000 7eff9e9ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff98101430 0x7eff98199500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:44.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.768+0000 7eff9e9ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff98102620 0x7eff98199a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:44.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.768+0000 7eff9e9ff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff98102fc0 0x7eff981a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:44.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.768+0000 7eff9e9ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff981a1030 con 0x7eff98101430 2023-12-17T12:03:44.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.768+0000 7eff9e9ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff981a1170 con 0x7eff98102620 2023-12-17T12:03:44.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.768+0000 7eff9e9ff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff981a1300 con 0x7eff98102fc0 2023-12-17T12:03:44.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.768+0000 7eff97fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff98101430 0x7eff98199500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:44.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.768+0000 7eff97fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff98101430 0x7eff98199500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57256/0 (socket says 172.21.15.8:57256) 2023-12-17T12:03:44.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.768+0000 7eff97fff700 1 -- 172.21.15.8:0/1356476878 learned_addr learned my addr 172.21.15.8:0/1356476878 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:44.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.769+0000 7eff977fe700 1 --2- 172.21.15.8:0/1356476878 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff98102620 0x7eff98199a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:44.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.769+0000 7eff9cf9c700 1 --2- 172.21.15.8:0/1356476878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff98102fc0 0x7eff981a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:44.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.769+0000 7eff97fff700 1 -- 172.21.15.8:0/1356476878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff98102fc0 msgr2=0x7eff981a0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:44.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.769+0000 7eff97fff700 1 --2- 172.21.15.8:0/1356476878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff98102fc0 0x7eff981a0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:44.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.769+0000 7eff97fff700 1 -- 172.21.15.8:0/1356476878 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff98102620 msgr2=0x7eff98199a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:44.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.769+0000 7eff97fff700 1 --2- 172.21.15.8:0/1356476878 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff98102620 0x7eff98199a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:44.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.769+0000 7eff97fff700 1 -- 172.21.15.8:0/1356476878 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff880095f0 con 0x7eff98101430 2023-12-17T12:03:44.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.769+0000 7eff97fff700 1 --2- 172.21.15.8:0/1356476878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff98101430 0x7eff98199500 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7eff88009f50 tx=0x7eff88003b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:44.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.769+0000 7eff957fa700 1 -- 172.21.15.8:0/1356476878 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8801d070 con 0x7eff98101430 2023-12-17T12:03:44.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.769+0000 7eff957fa700 1 -- 172.21.15.8:0/1356476878 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7eff8800bda0 con 0x7eff98101430 2023-12-17T12:03:44.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.769+0000 7eff957fa700 1 -- 172.21.15.8:0/1356476878 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff88022dc0 con 0x7eff98101430 2023-12-17T12:03:44.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.769+0000 7eff9e9ff700 1 -- 172.21.15.8:0/1356476878 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff981a1580 con 0x7eff98101430 2023-12-17T12:03:44.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.770+0000 7eff9e9ff700 1 -- 172.21.15.8:0/1356476878 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff981a19a0 con 0x7eff98101430 2023-12-17T12:03:44.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.771+0000 7eff9e9ff700 1 -- 172.21.15.8:0/1356476878 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff980681c0 con 0x7eff98101430 2023-12-17T12:03:44.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.772+0000 7eff957fa700 1 -- 172.21.15.8:0/1356476878 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7eff88004000 con 0x7eff98101430 2023-12-17T12:03:44.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.774+0000 7eff957fa700 1 --2- 172.21.15.8:0/1356476878 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7eff800a1590 0x7eff800a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:44.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.774+0000 7eff957fa700 1 -- 172.21.15.8:0/1356476878 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7eff880ce360 con 0x7eff98101430 2023-12-17T12:03:44.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.774+0000 7eff977fe700 1 --2- 172.21.15.8:0/1356476878 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7eff800a1590 0x7eff800a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:44.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.775+0000 7eff977fe700 1 --2- 172.21.15.8:0/1356476878 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7eff800a1590 0x7eff800a3a50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7eff8c00bbd0 tx=0x7eff8c00b5b0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:44.780 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.777+0000 7eff957fa700 1 -- 172.21.15.8:0/1356476878 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7eff88097870 con 0x7eff98101430 2023-12-17T12:03:44.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:44 smithi100 ceph-mon[41266]: pgmap v293: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-12-17T12:03:44.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:44 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/1255230085' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-17T12:03:44.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:44 smithi186 ceph-mon[41182]: pgmap v293: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-12-17T12:03:44.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:44 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/1255230085' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-17T12:03:44.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.992+0000 7eff9e9ff700 1 -- 172.21.15.8:0/1356476878 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7eff9810cb50 con 0x7eff98101430 2023-12-17T12:03:44.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:44 smithi008 ceph-mon[36830]: pgmap v293: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-12-17T12:03:44.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:44 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/1255230085' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-12-17T12:03:44.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.994+0000 7eff957fa700 1 -- 172.21.15.8:0/1356476878 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22518 (secure 0 0 0) 0x7eff8809ae90 con 0x7eff98101430 2023-12-17T12:03:44.997 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:03:44.997 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":85,"fsid":"f43f508a-9cd2-11ee-95a5-87774f69a715","created":"2023-12-17T11:55:30.666634+0000","modified":"2023-12-17T12:03:28.446977+0000","last_up_change":"2023-12-17T12:02:04.656573+0000","last_in_change":"2023-12-17T12:01:45.526832+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:58:43.972745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-17T12:02:48.278153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-17T12:02:49.637968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1f8acaf-a47b-4b74-a78d-e0b6be49a10e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6803","nonce":297519189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6805","nonce":297519189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6809","nonce":297519189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6807","nonce":297519189}]},"public_addr":"172.21.15.8:6803/297519189","cluster_addr":"172.21.15.8:6805/297519189","heartbeat_back_addr":"172.21.15.8:6809/297519189","heartbeat_front_addr":"172.21.15.8:6807/297519189","state":["exists","up"]},{"osd":1,"uuid":"d7138889-77de-43ba-b36b-7628f6f66bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6801","nonce":2496516573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6803","nonce":2496516573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6807","nonce":2496516573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6805","nonce":2496516573}]},"public_addr":"172.21.15.100:6801/2496516573","cluster_addr":"172.21.15.100:6803/2496516573","heartbeat_back_addr":"172.21.15.100:6807/2496516573","heartbeat_front_addr":"172.21.15.100:6805/2496516573","state":["exists","up"]},{"osd":2,"uuid":"ff452a6b-a11e-47be-9eaf-ec1001b51447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6801","nonce":2454925270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6803","nonce":2454925270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6807","nonce":2454925270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6805","nonce":2454925270}]},"public_addr":"172.21.15.186:6801/2454925270","cluster_addr":"172.21.15.186:6803/2454925270","heartbeat_back_addr":"172.21.15.186:6807/2454925270","heartbeat_front_addr":"172.21.15.186:6805/2454925270","state":["exists","up"]},{"osd":3,"uuid":"d19ab765-df7b-48c7-9012-8a3ac7d81aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6811","nonce":1141622701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6813","nonce":1141622701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6817","nonce":1141622701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6815","nonce":1141622701}]},"public_addr":"172.21.15.8:6811/1141622701","cluster_addr":"172.21.15.8:6813/1141622701","heartbeat_back_addr":"172.21.15.8:6817/1141622701","heartbeat_front_addr":"172.21.15.8:6815/1141622701","state":["exists","up"]},{"osd":4,"uuid":"8ecc3a01-f19a-40a7-93a2-8870116afe6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6809","nonce":1902152516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6811","nonce":1902152516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6815","nonce":1902152516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6813","nonce":1902152516}]},"public_addr":"172.21.15.100:6809/1902152516","cluster_addr":"172.21.15.100:6811/1902152516","heartbeat_back_addr":"172.21.15.100:6815/1902152516","heartbeat_front_addr":"172.21.15.100:6813/1902152516","state":["exists","up"]},{"osd":5,"uuid":"ac057cc9-2a27-4216-a7ae-fc60d9796eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6809","nonce":648349934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6811","nonce":648349934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6815","nonce":648349934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6813","nonce":648349934}]},"public_addr":"172.21.15.186:6809/648349934","cluster_addr":"172.21.15.186:6811/648349934","heartbeat_back_addr":"172.21.15.186:6815/648349934","heartbeat_front_addr":"172.21.15.186:6813/648349934","state":["exists","up"]},{"osd":6,"uuid":"bb5325e0-fe12-4bbc-96a9-86c228106a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6819","nonce":3266909294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6821","nonce":3266909294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6825","nonce":3266909294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6823","nonce":3266909294}]},"public_addr":"172.21.15.8:6819/3266909294","cluster_addr":"172.21.15.8:6821/3266909294","heartbeat_back_addr":"172.21.15.8:6825/3266909294","heartbeat_front_addr":"172.21.15.8:6823/3266909294","state":["exists","up"]},{"osd":7,"uuid":"48939d99-29dd-436b-b9f1-fdfe1ee26315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6817","nonce":1631494583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6819","nonce":1631494583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6823","nonce":1631494583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6821","nonce":1631494583}]},"public_addr":"172.21.15.100:6817/1631494583","cluster_addr":"172.21.15.100:6819/1631494583","heartbeat_back_addr":"172.21.15.100:6823/1631494583","heartbeat_front_addr":"172.21.15.100:6821/1631494583","state":["exists","up"]},{"osd":8,"uuid":"e3414f7f-7665-406f-89ec-79cbb3d3e274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6817","nonce":3569004799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6819","nonce":3569004799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6823","nonce":3569004799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6821","nonce":3569004799}]},"public_addr":"172.21.15.186:6817/3569004799","cluster_addr":"172.21.15.186:6819/3569004799","heartbeat_back_addr":"172.21.15.186:6823/3569004799","heartbeat_front_addr":"172.21.15.186:6821/3569004799","state":["exists","up"]},{"osd":9,"uuid":"b04f519d-6e44-4158-b6e1-aa4d64be3404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6827","nonce":3980647643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6829","nonce":3980647643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6833","nonce":3980647643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6831","nonce":3980647643}]},"public_addr":"172.21.15.8:6827/3980647643","cluster_addr":"172.21.15.8:6829/3980647643","heartbeat_back_addr":"172.21.15.8:6833/3980647643","heartbeat_front_addr":"172.21.15.8:6831/3980647643","state":["exists","up"]},{"osd":10,"uuid":"779fde04-620b-4b44-bd35-39be1470eec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6825","nonce":34112410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6827","nonce":34112410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6831","nonce":34112410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6829","nonce":34112410}]},"public_addr":"172.21.15.100:6825/34112410","cluster_addr":"172.21.15.100:6827/34112410","heartbeat_back_addr":"172.21.15.100:6831/34112410","heartbeat_front_addr":"172.21.15.100:6829/34112410","state":["exists","up"]},{"osd":11,"uuid":"6bbcb42f-aa99-44e4-9c3f-d818423eb5b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6825","nonce":3779371472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6827","nonce":3779371472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6831","nonce":3779371472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6829","nonce":3779371472}]},"public_addr":"172.21.15.186:6825/3779371472","cluster_addr":"172.21.15.186:6827/3779371472","heartbeat_back_addr":"172.21.15.186:6831/3779371472","heartbeat_front_addr":"172.21.15.186:6829/3779371472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:57:56.955667+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:58:18.433916+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:58:40.589590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:59:03.635858+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:59:25.544564+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:59:48.171593+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:00:10.876885+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:00:32.920759+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:00:55.273330+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:01:18.131720+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:01:40.259620+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:02:02.776536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.19","mappings":[{"from":3,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":6}]},{"pgid":"3.26","mappings":[{"from":1,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/4074020814":"2023-12-18T11:56:27.362306+0000","172.21.15.8:6801/222068650":"2023-12-18T11:56:27.362306+0000","172.21.15.8:6801/4187398661":"2023-12-18T11:56:00.731492+0000","172.21.15.8:6800/222068650":"2023-12-18T11:56:27.362306+0000","172.21.15.8:6800/4187398661":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/2964092603":"2023-12-18T11:56:27.362306+0000","172.21.15.8:0/35186087":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/1429868241":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/174719729":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/2106317618":"2023-12-18T11:56:27.362306+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T12:03:44.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.997+0000 7eff9e9ff700 1 -- 172.21.15.8:0/1356476878 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7eff800a1590 msgr2=0x7eff800a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:44.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.997+0000 7eff9e9ff700 1 --2- 172.21.15.8:0/1356476878 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7eff800a1590 0x7eff800a3a50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7eff8c00bbd0 tx=0x7eff8c00b5b0 comp rx=0 tx=0).stop 2023-12-17T12:03:44.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.997+0000 7eff9e9ff700 1 -- 172.21.15.8:0/1356476878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff98101430 msgr2=0x7eff98199500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:45.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.997+0000 7eff9e9ff700 1 --2- 172.21.15.8:0/1356476878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff98101430 0x7eff98199500 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7eff88009f50 tx=0x7eff88003b00 comp rx=0 tx=0).stop 2023-12-17T12:03:45.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.997+0000 7eff9e9ff700 1 -- 172.21.15.8:0/1356476878 shutdown_connections 2023-12-17T12:03:45.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.997+0000 7eff9e9ff700 1 --2- 172.21.15.8:0/1356476878 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7eff800a1590 0x7eff800a3a50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.997+0000 7eff9e9ff700 1 --2- 172.21.15.8:0/1356476878 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7eff98102fc0 0x7eff981a0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.997+0000 7eff9e9ff700 1 --2- 172.21.15.8:0/1356476878 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7eff98101430 0x7eff98199500 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.997+0000 7eff9e9ff700 1 --2- 172.21.15.8:0/1356476878 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7eff98102620 0x7eff98199a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.997+0000 7eff9e9ff700 1 -- 172.21.15.8:0/1356476878 >> 172.21.15.8:0/1356476878 conn(0x7eff980fc980 msgr2=0x7eff98073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:45.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.997+0000 7eff9e9ff700 1 -- 172.21.15.8:0/1356476878 shutdown_connections 2023-12-17T12:03:45.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:44.997+0000 7eff9e9ff700 1 -- 172.21.15.8:0/1356476878 wait complete. 2023-12-17T12:03:45.019 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-17T11:58:43.972745+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-17T12:02:48.278153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-17T12:02:49.637968+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-17T12:03:45.019 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-17T12:03:45.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.224+0000 7f4f321ff700 1 -- 172.21.15.8:0/4051816524 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f2c102790 msgr2=0x7f4f2c102bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:45.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.224+0000 7f4f321ff700 1 --2- 172.21.15.8:0/4051816524 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f2c102790 0x7f4f2c102bf0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4f200099c0 tx=0x7f4f20009cd0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.224+0000 7f4f321ff700 1 -- 172.21.15.8:0/4051816524 shutdown_connections 2023-12-17T12:03:45.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.224+0000 7f4f321ff700 1 --2- 172.21.15.8:0/4051816524 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4f2c103130 0x7f4f2c1099e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.224+0000 7f4f321ff700 1 --2- 172.21.15.8:0/4051816524 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f2c1015a0 0x7f4f2c1019c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.224+0000 7f4f321ff700 1 --2- 172.21.15.8:0/4051816524 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f2c102790 0x7f4f2c102bf0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.224+0000 7f4f321ff700 1 -- 172.21.15.8:0/4051816524 >> 172.21.15.8:0/4051816524 conn(0x7f4f2c0fcb10 msgr2=0x7f4f2c0fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:45.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.225+0000 7f4f321ff700 1 -- 172.21.15.8:0/4051816524 shutdown_connections 2023-12-17T12:03:45.227 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.225+0000 7f4f321ff700 1 -- 172.21.15.8:0/4051816524 wait complete. 2023-12-17T12:03:45.229 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.225+0000 7f4f321ff700 1 Processor -- start 2023-12-17T12:03:45.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.226+0000 7f4f321ff700 1 -- start start 2023-12-17T12:03:45.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.226+0000 7f4f321ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f2c1015a0 0x7f4f2c199660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:45.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.226+0000 7f4f321ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f2c102790 0x7f4f2c199ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:45.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.226+0000 7f4f321ff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4f2c103130 0x7f4f2c1a0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:45.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.226+0000 7f4f321ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c1a1190 con 0x7f4f2c102790 2023-12-17T12:03:45.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.226+0000 7f4f321ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c1a12d0 con 0x7f4f2c1015a0 2023-12-17T12:03:45.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.226+0000 7f4f321ff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c1a1460 con 0x7f4f2c103130 2023-12-17T12:03:45.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.226+0000 7f4f2affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f2c102790 0x7f4f2c199ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:45.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.226+0000 7f4f2affd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f2c102790 0x7f4f2c199ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57284/0 (socket says 172.21.15.8:57284) 2023-12-17T12:03:45.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.226+0000 7f4f2affd700 1 -- 172.21.15.8:0/3775490462 learned_addr learned my addr 172.21.15.8:0/3775490462 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:45.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.227+0000 7f4f2b7fe700 1 --2- 172.21.15.8:0/3775490462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f2c1015a0 0x7f4f2c199660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:45.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.227+0000 7f4f2bfff700 1 --2- 172.21.15.8:0/3775490462 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4f2c103130 0x7f4f2c1a0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:45.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.227+0000 7f4f2affd700 1 -- 172.21.15.8:0/3775490462 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4f2c103130 msgr2=0x7f4f2c1a0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:45.230 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.227+0000 7f4f2affd700 1 --2- 172.21.15.8:0/3775490462 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4f2c103130 0x7f4f2c1a0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.227+0000 7f4f2affd700 1 -- 172.21.15.8:0/3775490462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f2c1015a0 msgr2=0x7f4f2c199660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:45.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.227+0000 7f4f2affd700 1 --2- 172.21.15.8:0/3775490462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f2c1015a0 0x7f4f2c199660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.227+0000 7f4f2affd700 1 -- 172.21.15.8:0/3775490462 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f200095f0 con 0x7f4f2c102790 2023-12-17T12:03:45.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.227+0000 7f4f2b7fe700 1 --2- 172.21.15.8:0/3775490462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f2c1015a0 0x7f4f2c199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T12:03:45.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.227+0000 7f4f2affd700 1 --2- 172.21.15.8:0/3775490462 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f2c102790 0x7f4f2c199ba0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009990 tx=0x7f4f2000fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:45.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.227+0000 7f4f28ff9700 1 -- 172.21.15.8:0/3775490462 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2001d070 con 0x7f4f2c102790 2023-12-17T12:03:45.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.227+0000 7f4f321ff700 1 -- 172.21.15.8:0/3775490462 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f2c1a16e0 con 0x7f4f2c102790 2023-12-17T12:03:45.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.227+0000 7f4f28ff9700 1 -- 172.21.15.8:0/3775490462 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f2000bd10 con 0x7f4f2c102790 2023-12-17T12:03:45.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.227+0000 7f4f28ff9700 1 -- 172.21.15.8:0/3775490462 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f20017650 con 0x7f4f2c102790 2023-12-17T12:03:45.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.227+0000 7f4f321ff700 1 -- 172.21.15.8:0/3775490462 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f2c1a1b10 con 0x7f4f2c102790 2023-12-17T12:03:45.231 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.228+0000 7f4f321ff700 1 -- 172.21.15.8:0/3775490462 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f2c068310 con 0x7f4f2c102790 2023-12-17T12:03:45.232 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.230+0000 7f4f28ff9700 1 -- 172.21.15.8:0/3775490462 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f4f20022470 con 0x7f4f2c102790 2023-12-17T12:03:45.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.232+0000 7f4f28ff9700 1 --2- 172.21.15.8:0/3775490462 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4f140a1510 0x7f4f140a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:45.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.232+0000 7f4f28ff9700 1 -- 172.21.15.8:0/3775490462 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f4f200ce1c0 con 0x7f4f2c102790 2023-12-17T12:03:45.234 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.232+0000 7f4f2b7fe700 1 --2- 172.21.15.8:0/3775490462 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4f140a1510 0x7f4f140a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:45.235 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.233+0000 7f4f2b7fe700 1 --2- 172.21.15.8:0/3775490462 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4f140a1510 0x7f4f140a39d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c005950 tx=0x7f4f1c0058e0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:45.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.236+0000 7f4f28ff9700 1 -- 172.21.15.8:0/3775490462 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4f200976d0 con 0x7f4f2c102790 2023-12-17T12:03:45.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.448+0000 7f4f321ff700 1 -- 172.21.15.8:0/3775490462 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4f2c1a1dd0 con 0x7f4f2c102790 2023-12-17T12:03:45.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.449+0000 7f4f28ff9700 1 -- 172.21.15.8:0/3775490462 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4f2009acf0 con 0x7f4f2c102790 2023-12-17T12:03:45.451 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-12-17T12:03:45.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.451+0000 7f4f321ff700 1 -- 172.21.15.8:0/3775490462 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4f140a1510 msgr2=0x7f4f140a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:45.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.451+0000 7f4f321ff700 1 --2- 172.21.15.8:0/3775490462 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4f140a1510 0x7f4f140a39d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c005950 tx=0x7f4f1c0058e0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.451+0000 7f4f321ff700 1 -- 172.21.15.8:0/3775490462 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f2c102790 msgr2=0x7f4f2c199ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:45.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.451+0000 7f4f321ff700 1 --2- 172.21.15.8:0/3775490462 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f2c102790 0x7f4f2c199ba0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009990 tx=0x7f4f2000fab0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.451+0000 7f4f321ff700 1 -- 172.21.15.8:0/3775490462 shutdown_connections 2023-12-17T12:03:45.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.451+0000 7f4f321ff700 1 --2- 172.21.15.8:0/3775490462 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f4f140a1510 0x7f4f140a39d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.451+0000 7f4f321ff700 1 --2- 172.21.15.8:0/3775490462 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4f2c103130 0x7f4f2c1a0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.451+0000 7f4f321ff700 1 --2- 172.21.15.8:0/3775490462 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4f2c1015a0 0x7f4f2c199660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.451+0000 7f4f321ff700 1 --2- 172.21.15.8:0/3775490462 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4f2c102790 0x7f4f2c199ba0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.451+0000 7f4f321ff700 1 -- 172.21.15.8:0/3775490462 >> 172.21.15.8:0/3775490462 conn(0x7f4f2c0fcb10 msgr2=0x7f4f2c107fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:45.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.451+0000 7f4f321ff700 1 -- 172.21.15.8:0/3775490462 shutdown_connections 2023-12-17T12:03:45.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.452+0000 7f4f321ff700 1 -- 172.21.15.8:0/3775490462 wait complete. 2023-12-17T12:03:45.473 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-17T12:03:45.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.678+0000 7f456d5ff700 1 -- 172.21.15.8:0/2888399533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45681015a0 msgr2=0x7f45681019c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:45.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.678+0000 7f456d5ff700 1 --2- 172.21.15.8:0/2888399533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45681015a0 0x7f45681019c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f45580099c0 tx=0x7f4558009cd0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.679+0000 7f456d5ff700 1 -- 172.21.15.8:0/2888399533 shutdown_connections 2023-12-17T12:03:45.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.679+0000 7f456d5ff700 1 --2- 172.21.15.8:0/2888399533 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4568103130 0x7f45681099e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.679+0000 7f456d5ff700 1 --2- 172.21.15.8:0/2888399533 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45681015a0 0x7f45681019c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.679+0000 7f456d5ff700 1 --2- 172.21.15.8:0/2888399533 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4568102790 0x7f4568102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.679+0000 7f456d5ff700 1 -- 172.21.15.8:0/2888399533 >> 172.21.15.8:0/2888399533 conn(0x7f45680fcb10 msgr2=0x7f45680fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:45.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.679+0000 7f456d5ff700 1 -- 172.21.15.8:0/2888399533 shutdown_connections 2023-12-17T12:03:45.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.679+0000 7f456d5ff700 1 -- 172.21.15.8:0/2888399533 wait complete. 2023-12-17T12:03:45.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.680+0000 7f456d5ff700 1 Processor -- start 2023-12-17T12:03:45.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.680+0000 7f456d5ff700 1 -- start start 2023-12-17T12:03:45.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.680+0000 7f456d5ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45681015a0 0x7f4568199750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:45.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.680+0000 7f456d5ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4568102790 0x7f4568199c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:45.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.680+0000 7f456d5ff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4568103130 0x7f45681a0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:45.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.680+0000 7f456d5ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45681a1230 con 0x7f45681015a0 2023-12-17T12:03:45.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.680+0000 7f456d5ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45681a1370 con 0x7f4568102790 2023-12-17T12:03:45.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.680+0000 7f456d5ff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45681a1500 con 0x7f4568103130 2023-12-17T12:03:45.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.680+0000 7f4566ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45681015a0 0x7f4568199750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:45.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.680+0000 7f4566ffd700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45681015a0 0x7f4568199750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57304/0 (socket says 172.21.15.8:57304) 2023-12-17T12:03:45.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.680+0000 7f4566ffd700 1 -- 172.21.15.8:0/3063103417 learned_addr learned my addr 172.21.15.8:0/3063103417 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:45.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.681+0000 7f45667fc700 1 --2- 172.21.15.8:0/3063103417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4568102790 0x7f4568199c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:45.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.681+0000 7f45677fe700 1 --2- 172.21.15.8:0/3063103417 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4568103130 0x7f45681a0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:45.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.681+0000 7f4566ffd700 1 -- 172.21.15.8:0/3063103417 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4568103130 msgr2=0x7f45681a0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:45.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.681+0000 7f4566ffd700 1 --2- 172.21.15.8:0/3063103417 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4568103130 0x7f45681a0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.681+0000 7f4566ffd700 1 -- 172.21.15.8:0/3063103417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4568102790 msgr2=0x7f4568199c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:45.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.681+0000 7f4566ffd700 1 --2- 172.21.15.8:0/3063103417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4568102790 0x7f4568199c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.681+0000 7f4566ffd700 1 -- 172.21.15.8:0/3063103417 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45580095f0 con 0x7f45681015a0 2023-12-17T12:03:45.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.681+0000 7f45677fe700 1 --2- 172.21.15.8:0/3063103417 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4568103130 0x7f45681a0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T12:03:45.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.681+0000 7f4566ffd700 1 --2- 172.21.15.8:0/3063103417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45681015a0 0x7f4568199750 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4558009f50 tx=0x7f4558003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:45.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.681+0000 7f454ffff700 1 -- 172.21.15.8:0/3063103417 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455801d070 con 0x7f45681015a0 2023-12-17T12:03:45.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.681+0000 7f454ffff700 1 -- 172.21.15.8:0/3063103417 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f455800bda0 con 0x7f45681015a0 2023-12-17T12:03:45.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.681+0000 7f456d5ff700 1 -- 172.21.15.8:0/3063103417 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45681a1780 con 0x7f45681015a0 2023-12-17T12:03:45.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.681+0000 7f454ffff700 1 -- 172.21.15.8:0/3063103417 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4558022d60 con 0x7f45681015a0 2023-12-17T12:03:45.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.682+0000 7f456d5ff700 1 -- 172.21.15.8:0/3063103417 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45681a1ba0 con 0x7f45681015a0 2023-12-17T12:03:45.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.683+0000 7f456d5ff700 1 -- 172.21.15.8:0/3063103417 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4568068310 con 0x7f45681015a0 2023-12-17T12:03:45.687 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.685+0000 7f454ffff700 1 -- 172.21.15.8:0/3063103417 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f4558022500 con 0x7f45681015a0 2023-12-17T12:03:45.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.686+0000 7f454ffff700 1 --2- 172.21.15.8:0/3063103417 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f45500a1510 0x7f45500a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:45.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.686+0000 7f454ffff700 1 -- 172.21.15.8:0/3063103417 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f45580ce180 con 0x7f45681015a0 2023-12-17T12:03:45.688 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.686+0000 7f45667fc700 1 --2- 172.21.15.8:0/3063103417 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f45500a1510 0x7f45500a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:45.689 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.687+0000 7f45667fc700 1 --2- 172.21.15.8:0/3063103417 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f45500a1510 0x7f45500a39d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f455c007c60 tx=0x7f455c0073d0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:45.692 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.690+0000 7f454ffff700 1 -- 172.21.15.8:0/3063103417 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4558097690 con 0x7f45681015a0 2023-12-17T12:03:45.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.900+0000 7f456d5ff700 1 -- 172.21.15.8:0/3063103417 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f45681a1dc0 con 0x7f45681015a0 2023-12-17T12:03:45.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.900+0000 7f454ffff700 1 -- 172.21.15.8:0/3063103417 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7f455809acb0 con 0x7f45681015a0 2023-12-17T12:03:45.903 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-12-17T12:03:45.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.903+0000 7f456d5ff700 1 -- 172.21.15.8:0/3063103417 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f45500a1510 msgr2=0x7f45500a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:45.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.903+0000 7f456d5ff700 1 --2- 172.21.15.8:0/3063103417 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f45500a1510 0x7f45500a39d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f455c007c60 tx=0x7f455c0073d0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.903+0000 7f456d5ff700 1 -- 172.21.15.8:0/3063103417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45681015a0 msgr2=0x7f4568199750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:45.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.903+0000 7f456d5ff700 1 --2- 172.21.15.8:0/3063103417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45681015a0 0x7f4568199750 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4558009f50 tx=0x7f4558003a50 comp rx=0 tx=0).stop 2023-12-17T12:03:45.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.903+0000 7f456d5ff700 1 -- 172.21.15.8:0/3063103417 shutdown_connections 2023-12-17T12:03:45.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.903+0000 7f456d5ff700 1 --2- 172.21.15.8:0/3063103417 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f45500a1510 0x7f45500a39d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.903+0000 7f456d5ff700 1 --2- 172.21.15.8:0/3063103417 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4568103130 0x7f45681a0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.903+0000 7f456d5ff700 1 --2- 172.21.15.8:0/3063103417 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f45681015a0 0x7f4568199750 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.903+0000 7f456d5ff700 1 --2- 172.21.15.8:0/3063103417 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4568102790 0x7f4568199c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:45.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.903+0000 7f456d5ff700 1 -- 172.21.15.8:0/3063103417 >> 172.21.15.8:0/3063103417 conn(0x7f45680fcb10 msgr2=0x7f4568107f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:45.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.903+0000 7f456d5ff700 1 -- 172.21.15.8:0/3063103417 shutdown_connections 2023-12-17T12:03:45.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:45.903+0000 7f456d5ff700 1 -- 172.21.15.8:0/3063103417 wait complete. 2023-12-17T12:03:45.924 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-17T12:03:46.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.131+0000 7f7bacfff700 1 -- 172.21.15.8:0/79748066 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ba81015a0 msgr2=0x7f7ba81019c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:46.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.131+0000 7f7bacfff700 1 --2- 172.21.15.8:0/79748066 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ba81015a0 0x7f7ba81019c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7b980099c0 tx=0x7f7b98009cd0 comp rx=0 tx=0).stop 2023-12-17T12:03:46.134 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.131+0000 7f7bacfff700 1 -- 172.21.15.8:0/79748066 shutdown_connections 2023-12-17T12:03:46.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.131+0000 7f7bacfff700 1 --2- 172.21.15.8:0/79748066 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7ba8103130 0x7f7ba81099e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:46.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.131+0000 7f7bacfff700 1 --2- 172.21.15.8:0/79748066 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ba81015a0 0x7f7ba81019c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:46.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.131+0000 7f7bacfff700 1 --2- 172.21.15.8:0/79748066 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ba8102790 0x7f7ba8102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:46.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.131+0000 7f7bacfff700 1 -- 172.21.15.8:0/79748066 >> 172.21.15.8:0/79748066 conn(0x7f7ba80fcb10 msgr2=0x7f7ba80fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:46.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.131+0000 7f7bacfff700 1 -- 172.21.15.8:0/79748066 shutdown_connections 2023-12-17T12:03:46.135 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.131+0000 7f7bacfff700 1 -- 172.21.15.8:0/79748066 wait complete. 2023-12-17T12:03:46.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.132+0000 7f7bacfff700 1 Processor -- start 2023-12-17T12:03:46.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.133+0000 7f7bacfff700 1 -- start start 2023-12-17T12:03:46.137 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.133+0000 7f7bacfff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7ba81015a0 0x7f7ba8075330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:46.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.133+0000 7f7bacfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ba8102790 0x7f7ba80739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:46.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.133+0000 7f7bacfff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ba8103130 0x7f7ba8073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:46.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.133+0000 7f7bacfff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba80746a0 con 0x7f7ba8102790 2023-12-17T12:03:46.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.133+0000 7f7bacfff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba8074810 con 0x7f7ba8103130 2023-12-17T12:03:46.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.133+0000 7f7bacfff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba81a14f0 con 0x7f7ba81015a0 2023-12-17T12:03:46.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.133+0000 7f7b9ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ba8102790 0x7f7ba80739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:46.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.133+0000 7f7b9ffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ba8102790 0x7f7ba80739c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57322/0 (socket says 172.21.15.8:57322) 2023-12-17T12:03:46.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.133+0000 7f7b9ffff700 1 -- 172.21.15.8:0/3421263867 learned_addr learned my addr 172.21.15.8:0/3421263867 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:46.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.133+0000 7f7ba659c700 1 --2- 172.21.15.8:0/3421263867 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7ba81015a0 0x7f7ba8075330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:46.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.133+0000 7f7ba6d9d700 1 --2- 172.21.15.8:0/3421263867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ba8103130 0x7f7ba8073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:46.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.134+0000 7f7ba659c700 1 -- 172.21.15.8:0/3421263867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ba8103130 msgr2=0x7f7ba8073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:46.138 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.134+0000 7f7ba659c700 1 --2- 172.21.15.8:0/3421263867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ba8103130 0x7f7ba8073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:46.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.134+0000 7f7ba659c700 1 -- 172.21.15.8:0/3421263867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ba8102790 msgr2=0x7f7ba80739c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:46.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.134+0000 7f7ba659c700 1 --2- 172.21.15.8:0/3421263867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ba8102790 0x7f7ba80739c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:46.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.134+0000 7f7ba659c700 1 -- 172.21.15.8:0/3421263867 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b980095f0 con 0x7f7ba81015a0 2023-12-17T12:03:46.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.134+0000 7f7b9ffff700 1 --2- 172.21.15.8:0/3421263867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ba8102790 0x7f7ba80739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T12:03:46.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.134+0000 7f7ba659c700 1 --2- 172.21.15.8:0/3421263867 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7ba81015a0 0x7f7ba8075330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7b9800b580 tx=0x7f7b98003a50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:46.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.134+0000 7f7b9f7fe700 1 -- 172.21.15.8:0/3421263867 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9801d070 con 0x7f7ba81015a0 2023-12-17T12:03:46.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.134+0000 7f7b9f7fe700 1 -- 172.21.15.8:0/3421263867 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7b9800bda0 con 0x7f7ba81015a0 2023-12-17T12:03:46.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.134+0000 7f7bacfff700 1 -- 172.21.15.8:0/3421263867 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ba81a1720 con 0x7f7ba81015a0 2023-12-17T12:03:46.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.134+0000 7f7b9f7fe700 1 -- 172.21.15.8:0/3421263867 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b98022cb0 con 0x7f7ba81015a0 2023-12-17T12:03:46.139 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.135+0000 7f7bacfff700 1 -- 172.21.15.8:0/3421263867 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ba81a1ae0 con 0x7f7ba81015a0 2023-12-17T12:03:46.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.135+0000 7f7bacfff700 1 -- 172.21.15.8:0/3421263867 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ba8108a10 con 0x7f7ba81015a0 2023-12-17T12:03:46.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.138+0000 7f7b9f7fe700 1 -- 172.21.15.8:0/3421263867 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f7b98022470 con 0x7f7ba81015a0 2023-12-17T12:03:46.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.139+0000 7f7b9f7fe700 1 --2- 172.21.15.8:0/3421263867 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f7b940a1510 0x7f7b940a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:46.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.139+0000 7f7b9f7fe700 1 -- 172.21.15.8:0/3421263867 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f7b980ceb20 con 0x7f7ba81015a0 2023-12-17T12:03:46.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.139+0000 7f7b9ffff700 1 --2- 172.21.15.8:0/3421263867 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f7b940a1510 0x7f7b940a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:46.142 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.140+0000 7f7b9ffff700 1 --2- 172.21.15.8:0/3421263867 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f7b940a1510 0x7f7b940a39d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7b9000f4d0 tx=0x7f7b90005f90 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:46.144 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.142+0000 7f7b9f7fe700 1 -- 172.21.15.8:0/3421263867 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f7b98098030 con 0x7f7ba81015a0 2023-12-17T12:03:46.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:45 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/1356476878' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:03:46.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:45 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/3775490462' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-17T12:03:46.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:45 smithi008 ceph-mon[36830]: pgmap v294: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-12-17T12:03:46.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:45 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/3063103417' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-17T12:03:46.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.353+0000 7f7bacfff700 1 -- 172.21.15.8:0/3421263867 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7ba810cd40 con 0x7f7ba81015a0 2023-12-17T12:03:46.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.354+0000 7f7b9f7fe700 1 -- 172.21.15.8:0/3421263867 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7b9809b650 con 0x7f7ba81015a0 2023-12-17T12:03:46.356 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-12-17T12:03:46.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.356+0000 7f7bacfff700 1 -- 172.21.15.8:0/3421263867 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f7b940a1510 msgr2=0x7f7b940a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:46.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.356+0000 7f7bacfff700 1 --2- 172.21.15.8:0/3421263867 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f7b940a1510 0x7f7b940a39d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7b9000f4d0 tx=0x7f7b90005f90 comp rx=0 tx=0).stop 2023-12-17T12:03:46.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.356+0000 7f7bacfff700 1 -- 172.21.15.8:0/3421263867 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7ba81015a0 msgr2=0x7f7ba8075330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:46.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.356+0000 7f7bacfff700 1 --2- 172.21.15.8:0/3421263867 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7ba81015a0 0x7f7ba8075330 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7b9800b580 tx=0x7f7b98003a50 comp rx=0 tx=0).stop 2023-12-17T12:03:46.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.356+0000 7f7bacfff700 1 -- 172.21.15.8:0/3421263867 shutdown_connections 2023-12-17T12:03:46.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.356+0000 7f7bacfff700 1 --2- 172.21.15.8:0/3421263867 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f7b940a1510 0x7f7b940a39d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:46.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.356+0000 7f7bacfff700 1 --2- 172.21.15.8:0/3421263867 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7ba8103130 0x7f7ba8073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:46.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.356+0000 7f7bacfff700 1 --2- 172.21.15.8:0/3421263867 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7ba81015a0 0x7f7ba8075330 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:46.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.356+0000 7f7bacfff700 1 --2- 172.21.15.8:0/3421263867 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7ba8102790 0x7f7ba80739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:46.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.356+0000 7f7bacfff700 1 -- 172.21.15.8:0/3421263867 >> 172.21.15.8:0/3421263867 conn(0x7f7ba80fcb10 msgr2=0x7f7ba8105b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:46.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.356+0000 7f7bacfff700 1 -- 172.21.15.8:0/3421263867 shutdown_connections 2023-12-17T12:03:46.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.356+0000 7f7bacfff700 1 -- 172.21.15.8:0/3421263867 wait complete. 2023-12-17T12:03:46.378 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-17T12:03:46.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:45 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/1356476878' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:03:46.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:45 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/3775490462' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-17T12:03:46.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:45 smithi100 ceph-mon[41266]: pgmap v294: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-12-17T12:03:46.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:45 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/3063103417' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-17T12:03:46.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:45 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/1356476878' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:03:46.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:45 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/3775490462' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-17T12:03:46.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:45 smithi186 ceph-mon[41182]: pgmap v294: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-12-17T12:03:46.476 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:45 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/3063103417' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-17T12:03:46.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.579+0000 7efd723ff700 1 -- 172.21.15.8:0/454322381 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd6c101f00 msgr2=0x7efd6c1042f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:46.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.579+0000 7efd723ff700 1 --2- 172.21.15.8:0/454322381 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd6c101f00 0x7efd6c1042f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7efd5c009990 tx=0x7efd5c009ca0 comp rx=0 tx=0).stop 2023-12-17T12:03:46.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.579+0000 7efd723ff700 1 -- 172.21.15.8:0/454322381 shutdown_connections 2023-12-17T12:03:46.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.579+0000 7efd723ff700 1 --2- 172.21.15.8:0/454322381 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efd6c107160 0x7efd6c1095d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:46.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.579+0000 7efd723ff700 1 --2- 172.21.15.8:0/454322381 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd6c101f00 0x7efd6c1042f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:46.582 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.579+0000 7efd723ff700 1 --2- 172.21.15.8:0/454322381 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd6c104830 0x7efd6c106c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:46.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.579+0000 7efd723ff700 1 -- 172.21.15.8:0/454322381 >> 172.21.15.8:0/454322381 conn(0x7efd6c0fb8f0 msgr2=0x7efd6c0fdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:46.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.579+0000 7efd723ff700 1 -- 172.21.15.8:0/454322381 shutdown_connections 2023-12-17T12:03:46.583 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.579+0000 7efd723ff700 1 -- 172.21.15.8:0/454322381 wait complete. 2023-12-17T12:03:46.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.580+0000 7efd723ff700 1 Processor -- start 2023-12-17T12:03:46.585 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.580+0000 7efd723ff700 1 -- start start 2023-12-17T12:03:46.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.581+0000 7efd723ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd6c101f00 0x7efd6c1994d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:46.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.581+0000 7efd723ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd6c104830 0x7efd6c199a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:46.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.581+0000 7efd723ff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efd6c107160 0x7efd6c1a0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:46.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.581+0000 7efd723ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c1a1000 con 0x7efd6c104830 2023-12-17T12:03:46.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.581+0000 7efd723ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c1a1140 con 0x7efd6c101f00 2023-12-17T12:03:46.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.581+0000 7efd723ff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6c1a12d0 con 0x7efd6c107160 2023-12-17T12:03:46.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.581+0000 7efd63fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd6c104830 0x7efd6c199a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:46.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.581+0000 7efd63fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd6c104830 0x7efd6c199a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57340/0 (socket says 172.21.15.8:57340) 2023-12-17T12:03:46.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.581+0000 7efd63fff700 1 -- 172.21.15.8:0/2835353418 learned_addr learned my addr 172.21.15.8:0/2835353418 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:46.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.581+0000 7efd7099c700 1 --2- 172.21.15.8:0/2835353418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efd6c107160 0x7efd6c1a0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:46.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.581+0000 7efd6bfff700 1 --2- 172.21.15.8:0/2835353418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd6c101f00 0x7efd6c1994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:46.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.581+0000 7efd63fff700 1 -- 172.21.15.8:0/2835353418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efd6c107160 msgr2=0x7efd6c1a0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:46.586 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.581+0000 7efd63fff700 1 --2- 172.21.15.8:0/2835353418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efd6c107160 0x7efd6c1a0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:46.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.581+0000 7efd63fff700 1 -- 172.21.15.8:0/2835353418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd6c101f00 msgr2=0x7efd6c1994d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:46.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.582+0000 7efd63fff700 1 --2- 172.21.15.8:0/2835353418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd6c101f00 0x7efd6c1994d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:46.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.582+0000 7efd63fff700 1 -- 172.21.15.8:0/2835353418 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd5c0095f0 con 0x7efd6c104830 2023-12-17T12:03:46.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.582+0000 7efd6bfff700 1 --2- 172.21.15.8:0/2835353418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd6c101f00 0x7efd6c1994d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T12:03:46.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.582+0000 7efd7099c700 1 --2- 172.21.15.8:0/2835353418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efd6c107160 0x7efd6c1a0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T12:03:46.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.582+0000 7efd63fff700 1 --2- 172.21.15.8:0/2835353418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd6c104830 0x7efd6c199a10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efd5400d950 tx=0x7efd5400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:46.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.582+0000 7efd69ffb700 1 -- 172.21.15.8:0/2835353418 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd54009b40 con 0x7efd6c104830 2023-12-17T12:03:46.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.582+0000 7efd69ffb700 1 -- 172.21.15.8:0/2835353418 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efd54009ca0 con 0x7efd6c104830 2023-12-17T12:03:46.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.582+0000 7efd69ffb700 1 -- 172.21.15.8:0/2835353418 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd5400f620 con 0x7efd6c104830 2023-12-17T12:03:46.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.582+0000 7efd723ff700 1 -- 172.21.15.8:0/2835353418 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd6c1a15b0 con 0x7efd6c104830 2023-12-17T12:03:46.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.582+0000 7efd723ff700 1 -- 172.21.15.8:0/2835353418 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd6c1a1a70 con 0x7efd6c104830 2023-12-17T12:03:46.587 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.583+0000 7efd723ff700 1 -- 172.21.15.8:0/2835353418 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd6c108d60 con 0x7efd6c104830 2023-12-17T12:03:46.588 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.585+0000 7efd69ffb700 1 -- 172.21.15.8:0/2835353418 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7efd54010460 con 0x7efd6c104830 2023-12-17T12:03:46.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.587+0000 7efd69ffb700 1 --2- 172.21.15.8:0/2835353418 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7efd580a1590 0x7efd580a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:46.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.587+0000 7efd69ffb700 1 -- 172.21.15.8:0/2835353418 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7efd540cd250 con 0x7efd6c104830 2023-12-17T12:03:46.589 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.587+0000 7efd6bfff700 1 --2- 172.21.15.8:0/2835353418 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7efd580a1590 0x7efd580a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:46.590 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.587+0000 7efd6bfff700 1 --2- 172.21.15.8:0/2835353418 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7efd580a1590 0x7efd580a3a50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efd5c003780 tx=0x7efd5c005fb0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:46.591 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.589+0000 7efd69ffb700 1 -- 172.21.15.8:0/2835353418 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7efd540966d0 con 0x7efd6c104830 2023-12-17T12:03:46.855 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.853+0000 7efd723ff700 1 -- 172.21.15.8:0/2835353418 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd6c068230 con 0x7efd6c104830 2023-12-17T12:03:46.856 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.854+0000 7efd69ffb700 1 -- 172.21.15.8:0/2835353418 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11347 (secure 0 0 0) 0x7efd540b1c70 con 0x7efd6c104830 2023-12-17T12:03:46.857 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:03:46.857 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2669069079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2669069079},{"type":"v1","addr":"172.21.15.8:6835","nonce":2669069079}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/4241050553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":4241050553},{"type":"v1","addr":"172.21.15.8:6837","nonce":4241050553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-17T12:02:50.176951+0000","modified":"2023-12-17T12:02:58.040005+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24569,"mds_1":24541,"mds_2":24503,"mds_3":24470,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14640":{"gid":14640,"name":"f","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/2765387309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2765387309},{"type":"v1","addr":"172.21.15.186:6835","nonce":2765387309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14679":{"gid":14679,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/487046247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":487046247},{"type":"v1","addr":"172.21.15.8:6839","nonce":487046247}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14691":{"gid":14691,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6841/338406768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":338406768},{"type":"v1","addr":"172.21.15.8:6841","nonce":338406768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24451":{"gid":24451,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.186:6833/582753561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":582753561},{"type":"v1","addr":"172.21.15.186:6833","nonce":582753561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24470":{"gid":24470,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.100:6833/305815776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":305815776},{"type":"v1","addr":"172.21.15.100:6833","nonce":305815776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24503":{"gid":24503,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6835/2140351853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2140351853},{"type":"v1","addr":"172.21.15.100:6835","nonce":2140351853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24520":{"gid":24520,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/822451724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":822451724},{"type":"v1","addr":"172.21.15.186:6837","nonce":822451724}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24530":{"gid":24530,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6837/4176831844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":4176831844},{"type":"v1","addr":"172.21.15.100:6837","nonce":4176831844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.186:6839/91602342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":91602342},{"type":"v1","addr":"172.21.15.186:6839","nonce":91602342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24569":{"gid":24569,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6839/3921737538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3921737538},{"type":"v1","addr":"172.21.15.100:6839","nonce":3921737538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-17T12:03:46.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.857+0000 7efd723ff700 1 -- 172.21.15.8:0/2835353418 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7efd580a1590 msgr2=0x7efd580a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:46.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.857+0000 7efd723ff700 1 --2- 172.21.15.8:0/2835353418 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7efd580a1590 0x7efd580a3a50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7efd5c003780 tx=0x7efd5c005fb0 comp rx=0 tx=0).stop 2023-12-17T12:03:46.859 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.857+0000 7efd723ff700 1 -- 172.21.15.8:0/2835353418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd6c104830 msgr2=0x7efd6c199a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:46.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.857+0000 7efd723ff700 1 --2- 172.21.15.8:0/2835353418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd6c104830 0x7efd6c199a10 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efd5400d950 tx=0x7efd5400dd10 comp rx=0 tx=0).stop 2023-12-17T12:03:46.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.857+0000 7efd723ff700 1 -- 172.21.15.8:0/2835353418 shutdown_connections 2023-12-17T12:03:46.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.857+0000 7efd723ff700 1 --2- 172.21.15.8:0/2835353418 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7efd580a1590 0x7efd580a3a50 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:46.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.857+0000 7efd723ff700 1 --2- 172.21.15.8:0/2835353418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efd6c107160 0x7efd6c1a0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:46.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.857+0000 7efd723ff700 1 --2- 172.21.15.8:0/2835353418 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7efd6c101f00 0x7efd6c1994d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:46.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.857+0000 7efd723ff700 1 --2- 172.21.15.8:0/2835353418 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7efd6c104830 0x7efd6c199a10 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:46.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.857+0000 7efd723ff700 1 -- 172.21.15.8:0/2835353418 >> 172.21.15.8:0/2835353418 conn(0x7efd6c0fb8f0 msgr2=0x7efd6c101600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:46.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.857+0000 7efd723ff700 1 -- 172.21.15.8:0/2835353418 shutdown_connections 2023-12-17T12:03:46.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:46.857+0000 7efd723ff700 1 -- 172.21.15.8:0/2835353418 wait complete. 2023-12-17T12:03:46.860 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 27 2023-12-17T12:03:46.879 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T12:03:47.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.083+0000 7ffbbfdff700 1 -- 172.21.15.8:0/2587465393 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffbb8074030 msgr2=0x7ffbb80744b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:47.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.083+0000 7ffbbfdff700 1 --2- 172.21.15.8:0/2587465393 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffbb8074030 0x7ffbb80744b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7ffba8009990 tx=0x7ffba8009ca0 comp rx=0 tx=0).stop 2023-12-17T12:03:47.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.083+0000 7ffbbfdff700 1 -- 172.21.15.8:0/2587465393 shutdown_connections 2023-12-17T12:03:47.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.083+0000 7ffbbfdff700 1 --2- 172.21.15.8:0/2587465393 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbb8109360 0x7ffbb810b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:47.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.083+0000 7ffbbfdff700 1 --2- 172.21.15.8:0/2587465393 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffbb8075610 0x7ffbb8073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:47.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.083+0000 7ffbbfdff700 1 --2- 172.21.15.8:0/2587465393 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffbb8074030 0x7ffbb80744b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:47.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.083+0000 7ffbbfdff700 1 -- 172.21.15.8:0/2587465393 >> 172.21.15.8:0/2587465393 conn(0x7ffbb80fca10 msgr2=0x7ffbb80fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:47.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.083+0000 7ffbbfdff700 1 -- 172.21.15.8:0/2587465393 shutdown_connections 2023-12-17T12:03:47.086 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.083+0000 7ffbbfdff700 1 -- 172.21.15.8:0/2587465393 wait complete. 2023-12-17T12:03:47.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.084+0000 7ffbbfdff700 1 Processor -- start 2023-12-17T12:03:47.087 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.085+0000 7ffbbfdff700 1 -- start start 2023-12-17T12:03:47.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.085+0000 7ffbbfdff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffbb8074030 0x7ffbb8199570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:47.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.085+0000 7ffbbfdff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbb8075610 0x7ffbb8199ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:47.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.085+0000 7ffbbfdff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffbb8109360 0x7ffbb81a0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:47.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.085+0000 7ffbbfdff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb81a10a0 con 0x7ffbb8109360 2023-12-17T12:03:47.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.085+0000 7ffbbfdff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb81a11e0 con 0x7ffbb8075610 2023-12-17T12:03:47.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.085+0000 7ffbbfdff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbb81a1370 con 0x7ffbb8074030 2023-12-17T12:03:47.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.085+0000 7ffbbe39c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffbb8109360 0x7ffbb81a0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:47.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.085+0000 7ffbbe39c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffbb8109360 0x7ffbb81a0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57366/0 (socket says 172.21.15.8:57366) 2023-12-17T12:03:47.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.085+0000 7ffbbe39c700 1 -- 172.21.15.8:0/1138943 learned_addr learned my addr 172.21.15.8:0/1138943 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:47.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.086+0000 7ffbbdb9b700 1 --2- 172.21.15.8:0/1138943 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffbb8074030 0x7ffbb8199570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:47.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.086+0000 7ffbbd39a700 1 --2- 172.21.15.8:0/1138943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbb8075610 0x7ffbb8199ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:47.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.086+0000 7ffbbe39c700 1 -- 172.21.15.8:0/1138943 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffbb8074030 msgr2=0x7ffbb8199570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:47.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.086+0000 7ffbbe39c700 1 --2- 172.21.15.8:0/1138943 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffbb8074030 0x7ffbb8199570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:47.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.086+0000 7ffbbe39c700 1 -- 172.21.15.8:0/1138943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbb8075610 msgr2=0x7ffbb8199ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:47.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.086+0000 7ffbbe39c700 1 --2- 172.21.15.8:0/1138943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbb8075610 0x7ffbb8199ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:47.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.086+0000 7ffbbe39c700 1 -- 172.21.15.8:0/1138943 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba80095f0 con 0x7ffbb8109360 2023-12-17T12:03:47.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.086+0000 7ffbbe39c700 1 --2- 172.21.15.8:0/1138943 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffbb8109360 0x7ffbb81a0ad0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0007ee0 tx=0x7ffbb000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:47.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.086+0000 7ffbaeffd700 1 -- 172.21.15.8:0/1138943 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0017070 con 0x7ffbb8109360 2023-12-17T12:03:47.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.086+0000 7ffbaeffd700 1 -- 172.21.15.8:0/1138943 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffbb000f040 con 0x7ffbb8109360 2023-12-17T12:03:47.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.086+0000 7ffbbfdff700 1 -- 172.21.15.8:0/1138943 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbb81a1650 con 0x7ffbb8109360 2023-12-17T12:03:47.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.086+0000 7ffbaeffd700 1 -- 172.21.15.8:0/1138943 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbb0005570 con 0x7ffbb8109360 2023-12-17T12:03:47.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.086+0000 7ffbbfdff700 1 -- 172.21.15.8:0/1138943 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbb81a1b60 con 0x7ffbb8109360 2023-12-17T12:03:47.090 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.087+0000 7ffbbfdff700 1 -- 172.21.15.8:0/1138943 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbb8108120 con 0x7ffbb8109360 2023-12-17T12:03:47.093 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.091+0000 7ffbaeffd700 1 -- 172.21.15.8:0/1138943 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7ffbb000db20 con 0x7ffbb8109360 2023-12-17T12:03:47.094 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.092+0000 7ffbaeffd700 1 --2- 172.21.15.8:0/1138943 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7ffba40a1590 0x7ffba40a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:47.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.093+0000 7ffbaeffd700 1 -- 172.21.15.8:0/1138943 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7ffbb00ccc40 con 0x7ffbb8109360 2023-12-17T12:03:47.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.093+0000 7ffbbdb9b700 1 --2- 172.21.15.8:0/1138943 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7ffba40a1590 0x7ffba40a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:47.095 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.093+0000 7ffbbdb9b700 1 --2- 172.21.15.8:0/1138943 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7ffba40a1590 0x7ffba40a3a50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4007c60 tx=0x7ffbb40073d0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:47.097 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.095+0000 7ffbaeffd700 1 -- 172.21.15.8:0/1138943 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ffbb00960c0 con 0x7ffbb8109360 2023-12-17T12:03:47.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:46 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/3421263867' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-17T12:03:47.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:46 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/2835353418' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:03:47.310 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.308+0000 7ffbbfdff700 1 -- 172.21.15.8:0/1138943 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffbb810ed90 con 0x7ffbb8109360 2023-12-17T12:03:47.312 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.309+0000 7ffbaeffd700 1 -- 172.21.15.8:0/1138943 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22518 (secure 0 0 0) 0x7ffbb00996e0 con 0x7ffbb8109360 2023-12-17T12:03:47.312 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:03:47.312 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":85,"fsid":"f43f508a-9cd2-11ee-95a5-87774f69a715","created":"2023-12-17T11:55:30.666634+0000","modified":"2023-12-17T12:03:28.446977+0000","last_up_change":"2023-12-17T12:02:04.656573+0000","last_in_change":"2023-12-17T12:01:45.526832+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:58:43.972745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-17T12:02:48.278153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-17T12:02:49.637968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1f8acaf-a47b-4b74-a78d-e0b6be49a10e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6803","nonce":297519189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6805","nonce":297519189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6809","nonce":297519189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6807","nonce":297519189}]},"public_addr":"172.21.15.8:6803/297519189","cluster_addr":"172.21.15.8:6805/297519189","heartbeat_back_addr":"172.21.15.8:6809/297519189","heartbeat_front_addr":"172.21.15.8:6807/297519189","state":["exists","up"]},{"osd":1,"uuid":"d7138889-77de-43ba-b36b-7628f6f66bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6801","nonce":2496516573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6803","nonce":2496516573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6807","nonce":2496516573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6805","nonce":2496516573}]},"public_addr":"172.21.15.100:6801/2496516573","cluster_addr":"172.21.15.100:6803/2496516573","heartbeat_back_addr":"172.21.15.100:6807/2496516573","heartbeat_front_addr":"172.21.15.100:6805/2496516573","state":["exists","up"]},{"osd":2,"uuid":"ff452a6b-a11e-47be-9eaf-ec1001b51447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6801","nonce":2454925270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6803","nonce":2454925270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6807","nonce":2454925270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6805","nonce":2454925270}]},"public_addr":"172.21.15.186:6801/2454925270","cluster_addr":"172.21.15.186:6803/2454925270","heartbeat_back_addr":"172.21.15.186:6807/2454925270","heartbeat_front_addr":"172.21.15.186:6805/2454925270","state":["exists","up"]},{"osd":3,"uuid":"d19ab765-df7b-48c7-9012-8a3ac7d81aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6811","nonce":1141622701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6813","nonce":1141622701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6817","nonce":1141622701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6815","nonce":1141622701}]},"public_addr":"172.21.15.8:6811/1141622701","cluster_addr":"172.21.15.8:6813/1141622701","heartbeat_back_addr":"172.21.15.8:6817/1141622701","heartbeat_front_addr":"172.21.15.8:6815/1141622701","state":["exists","up"]},{"osd":4,"uuid":"8ecc3a01-f19a-40a7-93a2-8870116afe6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6809","nonce":1902152516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6811","nonce":1902152516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6815","nonce":1902152516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6813","nonce":1902152516}]},"public_addr":"172.21.15.100:6809/1902152516","cluster_addr":"172.21.15.100:6811/1902152516","heartbeat_back_addr":"172.21.15.100:6815/1902152516","heartbeat_front_addr":"172.21.15.100:6813/1902152516","state":["exists","up"]},{"osd":5,"uuid":"ac057cc9-2a27-4216-a7ae-fc60d9796eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6809","nonce":648349934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6811","nonce":648349934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6815","nonce":648349934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6813","nonce":648349934}]},"public_addr":"172.21.15.186:6809/648349934","cluster_addr":"172.21.15.186:6811/648349934","heartbeat_back_addr":"172.21.15.186:6815/648349934","heartbeat_front_addr":"172.21.15.186:6813/648349934","state":["exists","up"]},{"osd":6,"uuid":"bb5325e0-fe12-4bbc-96a9-86c228106a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6819","nonce":3266909294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6821","nonce":3266909294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6825","nonce":3266909294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6823","nonce":3266909294}]},"public_addr":"172.21.15.8:6819/3266909294","cluster_addr":"172.21.15.8:6821/3266909294","heartbeat_back_addr":"172.21.15.8:6825/3266909294","heartbeat_front_addr":"172.21.15.8:6823/3266909294","state":["exists","up"]},{"osd":7,"uuid":"48939d99-29dd-436b-b9f1-fdfe1ee26315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6817","nonce":1631494583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6819","nonce":1631494583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6823","nonce":1631494583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6821","nonce":1631494583}]},"public_addr":"172.21.15.100:6817/1631494583","cluster_addr":"172.21.15.100:6819/1631494583","heartbeat_back_addr":"172.21.15.100:6823/1631494583","heartbeat_front_addr":"172.21.15.100:6821/1631494583","state":["exists","up"]},{"osd":8,"uuid":"e3414f7f-7665-406f-89ec-79cbb3d3e274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6817","nonce":3569004799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6819","nonce":3569004799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6823","nonce":3569004799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6821","nonce":3569004799}]},"public_addr":"172.21.15.186:6817/3569004799","cluster_addr":"172.21.15.186:6819/3569004799","heartbeat_back_addr":"172.21.15.186:6823/3569004799","heartbeat_front_addr":"172.21.15.186:6821/3569004799","state":["exists","up"]},{"osd":9,"uuid":"b04f519d-6e44-4158-b6e1-aa4d64be3404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6827","nonce":3980647643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6829","nonce":3980647643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6833","nonce":3980647643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6831","nonce":3980647643}]},"public_addr":"172.21.15.8:6827/3980647643","cluster_addr":"172.21.15.8:6829/3980647643","heartbeat_back_addr":"172.21.15.8:6833/3980647643","heartbeat_front_addr":"172.21.15.8:6831/3980647643","state":["exists","up"]},{"osd":10,"uuid":"779fde04-620b-4b44-bd35-39be1470eec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6825","nonce":34112410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6827","nonce":34112410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6831","nonce":34112410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6829","nonce":34112410}]},"public_addr":"172.21.15.100:6825/34112410","cluster_addr":"172.21.15.100:6827/34112410","heartbeat_back_addr":"172.21.15.100:6831/34112410","heartbeat_front_addr":"172.21.15.100:6829/34112410","state":["exists","up"]},{"osd":11,"uuid":"6bbcb42f-aa99-44e4-9c3f-d818423eb5b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6825","nonce":3779371472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6827","nonce":3779371472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6831","nonce":3779371472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6829","nonce":3779371472}]},"public_addr":"172.21.15.186:6825/3779371472","cluster_addr":"172.21.15.186:6827/3779371472","heartbeat_back_addr":"172.21.15.186:6831/3779371472","heartbeat_front_addr":"172.21.15.186:6829/3779371472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:57:56.955667+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:58:18.433916+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:58:40.589590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:59:03.635858+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:59:25.544564+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:59:48.171593+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:00:10.876885+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:00:32.920759+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:00:55.273330+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:01:18.131720+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:01:40.259620+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:02:02.776536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.19","mappings":[{"from":3,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":6}]},{"pgid":"3.26","mappings":[{"from":1,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/4074020814":"2023-12-18T11:56:27.362306+0000","172.21.15.8:6801/222068650":"2023-12-18T11:56:27.362306+0000","172.21.15.8:6801/4187398661":"2023-12-18T11:56:00.731492+0000","172.21.15.8:6800/222068650":"2023-12-18T11:56:27.362306+0000","172.21.15.8:6800/4187398661":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/2964092603":"2023-12-18T11:56:27.362306+0000","172.21.15.8:0/35186087":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/1429868241":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/174719729":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/2106317618":"2023-12-18T11:56:27.362306+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T12:03:47.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.312+0000 7ffbbfdff700 1 -- 172.21.15.8:0/1138943 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7ffba40a1590 msgr2=0x7ffba40a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:47.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.312+0000 7ffbbfdff700 1 --2- 172.21.15.8:0/1138943 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7ffba40a1590 0x7ffba40a3a50 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ffbb4007c60 tx=0x7ffbb40073d0 comp rx=0 tx=0).stop 2023-12-17T12:03:47.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.312+0000 7ffbbfdff700 1 -- 172.21.15.8:0/1138943 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffbb8109360 msgr2=0x7ffbb81a0ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:47.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.312+0000 7ffbbfdff700 1 --2- 172.21.15.8:0/1138943 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffbb8109360 0x7ffbb81a0ad0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7ffbb0007ee0 tx=0x7ffbb000d3b0 comp rx=0 tx=0).stop 2023-12-17T12:03:47.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.312+0000 7ffbbfdff700 1 -- 172.21.15.8:0/1138943 shutdown_connections 2023-12-17T12:03:47.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.312+0000 7ffbbfdff700 1 --2- 172.21.15.8:0/1138943 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7ffba40a1590 0x7ffba40a3a50 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:47.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.312+0000 7ffbbfdff700 1 --2- 172.21.15.8:0/1138943 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ffbb8109360 0x7ffbb81a0ad0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:47.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.312+0000 7ffbbfdff700 1 --2- 172.21.15.8:0/1138943 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffbb8074030 0x7ffbb8199570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:47.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.312+0000 7ffbbfdff700 1 --2- 172.21.15.8:0/1138943 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ffbb8075610 0x7ffbb8199ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:47.315 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.312+0000 7ffbbfdff700 1 -- 172.21.15.8:0/1138943 >> 172.21.15.8:0/1138943 conn(0x7ffbb80fca10 msgr2=0x7ffbb8105260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:47.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.312+0000 7ffbbfdff700 1 -- 172.21.15.8:0/1138943 shutdown_connections 2023-12-17T12:03:47.316 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.312+0000 7ffbbfdff700 1 -- 172.21.15.8:0/1138943 wait complete. 2023-12-17T12:03:47.334 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-17T11:58:43.972745+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-17T12:02:48.278153+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '82', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-17T12:02:49.637968+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '83', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-17T12:03:47.335 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-17T12:03:47.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:46 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/3421263867' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-17T12:03:47.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:46 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/2835353418' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:03:47.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:46 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/3421263867' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-17T12:03:47.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:46 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/2835353418' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:03:47.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.540+0000 7f8a92dff700 1 -- 172.21.15.8:0/1323631787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a8c102790 msgr2=0x7f8a8c102bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:47.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.540+0000 7f8a92dff700 1 --2- 172.21.15.8:0/1323631787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a8c102790 0x7f8a8c102bf0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8a780099c0 tx=0x7f8a78009cd0 comp rx=0 tx=0).stop 2023-12-17T12:03:47.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.540+0000 7f8a92dff700 1 -- 172.21.15.8:0/1323631787 shutdown_connections 2023-12-17T12:03:47.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.540+0000 7f8a92dff700 1 --2- 172.21.15.8:0/1323631787 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a8c103130 0x7f8a8c1099e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:47.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.540+0000 7f8a92dff700 1 --2- 172.21.15.8:0/1323631787 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8a8c1015a0 0x7f8a8c1019c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:47.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.540+0000 7f8a92dff700 1 --2- 172.21.15.8:0/1323631787 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a8c102790 0x7f8a8c102bf0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:47.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.540+0000 7f8a92dff700 1 -- 172.21.15.8:0/1323631787 >> 172.21.15.8:0/1323631787 conn(0x7f8a8c0fcb10 msgr2=0x7f8a8c0fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:47.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.540+0000 7f8a92dff700 1 -- 172.21.15.8:0/1323631787 shutdown_connections 2023-12-17T12:03:47.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.540+0000 7f8a92dff700 1 -- 172.21.15.8:0/1323631787 wait complete. 2023-12-17T12:03:47.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.541+0000 7f8a92dff700 1 Processor -- start 2023-12-17T12:03:47.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.541+0000 7f8a92dff700 1 -- start start 2023-12-17T12:03:47.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.541+0000 7f8a92dff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a8c1015a0 0x7f8a8c197470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:47.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.541+0000 7f8a92dff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8a8c102790 0x7f8a8c1979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:47.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.541+0000 7f8a92dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a8c103130 0x7f8a8c19e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:47.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.541+0000 7f8a92dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c19efa0 con 0x7f8a8c103130 2023-12-17T12:03:47.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.541+0000 7f8a92dff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c19f0e0 con 0x7f8a8c1015a0 2023-12-17T12:03:47.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.541+0000 7f8a92dff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a8c19f270 con 0x7f8a8c102790 2023-12-17T12:03:47.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.542+0000 7f8a9139c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a8c103130 0x7f8a8c19e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:47.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.542+0000 7f8a9139c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a8c103130 0x7f8a8c19e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57378/0 (socket says 172.21.15.8:57378) 2023-12-17T12:03:47.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.542+0000 7f8a9139c700 1 -- 172.21.15.8:0/703664630 learned_addr learned my addr 172.21.15.8:0/703664630 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:47.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.542+0000 7f8a90b9b700 1 --2- 172.21.15.8:0/703664630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a8c1015a0 0x7f8a8c197470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:47.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.542+0000 7f8a8bfff700 1 --2- 172.21.15.8:0/703664630 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8a8c102790 0x7f8a8c1979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:47.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.542+0000 7f8a9139c700 1 -- 172.21.15.8:0/703664630 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8a8c102790 msgr2=0x7f8a8c1979b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:47.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.542+0000 7f8a9139c700 1 --2- 172.21.15.8:0/703664630 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8a8c102790 0x7f8a8c1979b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:47.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.542+0000 7f8a9139c700 1 -- 172.21.15.8:0/703664630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a8c1015a0 msgr2=0x7f8a8c197470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:47.547 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.542+0000 7f8a9139c700 1 --2- 172.21.15.8:0/703664630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a8c1015a0 0x7f8a8c197470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:47.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.542+0000 7f8a9139c700 1 -- 172.21.15.8:0/703664630 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a780095f0 con 0x7f8a8c103130 2023-12-17T12:03:47.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.542+0000 7f8a9139c700 1 --2- 172.21.15.8:0/703664630 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a8c103130 0x7f8a8c19e9d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8a84007ee0 tx=0x7f8a8400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:47.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.542+0000 7f8a89ffb700 1 -- 172.21.15.8:0/703664630 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a84017070 con 0x7f8a8c103130 2023-12-17T12:03:47.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.542+0000 7f8a89ffb700 1 -- 172.21.15.8:0/703664630 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a8400f040 con 0x7f8a8c103130 2023-12-17T12:03:47.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.542+0000 7f8a92dff700 1 -- 172.21.15.8:0/703664630 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a8c19f550 con 0x7f8a8c103130 2023-12-17T12:03:47.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.542+0000 7f8a89ffb700 1 -- 172.21.15.8:0/703664630 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a84005710 con 0x7f8a8c103130 2023-12-17T12:03:47.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.543+0000 7f8a92dff700 1 -- 172.21.15.8:0/703664630 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a8c19fa10 con 0x7f8a8c103130 2023-12-17T12:03:47.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.544+0000 7f8a92dff700 1 -- 172.21.15.8:0/703664630 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a8c108ac0 con 0x7f8a8c103130 2023-12-17T12:03:47.548 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.545+0000 7f8a89ffb700 1 -- 172.21.15.8:0/703664630 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f8a84005870 con 0x7f8a8c103130 2023-12-17T12:03:47.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.547+0000 7f8a89ffb700 1 --2- 172.21.15.8:0/703664630 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f8a7c0a1510 0x7f8a7c0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:47.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.547+0000 7f8a89ffb700 1 -- 172.21.15.8:0/703664630 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f8a840cc720 con 0x7f8a8c103130 2023-12-17T12:03:47.549 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.547+0000 7f8a90b9b700 1 --2- 172.21.15.8:0/703664630 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f8a7c0a1510 0x7f8a7c0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:47.550 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.548+0000 7f8a90b9b700 1 --2- 172.21.15.8:0/703664630 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f8a7c0a1510 0x7f8a7c0a39d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c1025f0 tx=0x7f8a80009260 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:47.553 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.551+0000 7f8a89ffb700 1 -- 172.21.15.8:0/703664630 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f8a84095ba0 con 0x7f8a8c103130 2023-12-17T12:03:47.761 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.759+0000 7f8a92dff700 1 -- 172.21.15.8:0/703664630 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f8a8c1084a0 con 0x7f8a8c103130 2023-12-17T12:03:47.762 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.759+0000 7f8a89ffb700 1 -- 172.21.15.8:0/703664630 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8a840991c0 con 0x7f8a8c103130 2023-12-17T12:03:47.762 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 1 2023-12-17T12:03:47.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.762+0000 7f8a92dff700 1 -- 172.21.15.8:0/703664630 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f8a7c0a1510 msgr2=0x7f8a7c0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:47.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.762+0000 7f8a92dff700 1 --2- 172.21.15.8:0/703664630 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f8a7c0a1510 0x7f8a7c0a39d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c1025f0 tx=0x7f8a80009260 comp rx=0 tx=0).stop 2023-12-17T12:03:47.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.762+0000 7f8a92dff700 1 -- 172.21.15.8:0/703664630 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a8c103130 msgr2=0x7f8a8c19e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:47.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.762+0000 7f8a92dff700 1 --2- 172.21.15.8:0/703664630 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a8c103130 0x7f8a8c19e9d0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f8a84007ee0 tx=0x7f8a8400d3b0 comp rx=0 tx=0).stop 2023-12-17T12:03:47.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.762+0000 7f8a92dff700 1 -- 172.21.15.8:0/703664630 shutdown_connections 2023-12-17T12:03:47.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.762+0000 7f8a92dff700 1 --2- 172.21.15.8:0/703664630 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f8a7c0a1510 0x7f8a7c0a39d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:47.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.762+0000 7f8a92dff700 1 --2- 172.21.15.8:0/703664630 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f8a8c103130 0x7f8a8c19e9d0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:47.765 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.762+0000 7f8a92dff700 1 --2- 172.21.15.8:0/703664630 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f8a8c1015a0 0x7f8a8c197470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:47.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.762+0000 7f8a92dff700 1 --2- 172.21.15.8:0/703664630 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8a8c102790 0x7f8a8c1979b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:47.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.762+0000 7f8a92dff700 1 -- 172.21.15.8:0/703664630 >> 172.21.15.8:0/703664630 conn(0x7f8a8c0fcb10 msgr2=0x7f8a8c105c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:47.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.762+0000 7f8a92dff700 1 -- 172.21.15.8:0/703664630 shutdown_connections 2023-12-17T12:03:47.766 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.762+0000 7f8a92dff700 1 -- 172.21.15.8:0/703664630 wait complete. 2023-12-17T12:03:47.783 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-17T12:03:47.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.989+0000 7f6c891ff700 1 -- 172.21.15.8:0/3578123315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c841015a0 msgr2=0x7f6c841019c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:47.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.989+0000 7f6c891ff700 1 --2- 172.21.15.8:0/3578123315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c841015a0 0x7f6c841019c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f6c740099c0 tx=0x7f6c74009cd0 comp rx=0 tx=0).stop 2023-12-17T12:03:47.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.990+0000 7f6c891ff700 1 -- 172.21.15.8:0/3578123315 shutdown_connections 2023-12-17T12:03:47.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.990+0000 7f6c891ff700 1 --2- 172.21.15.8:0/3578123315 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c84103130 0x7f6c841099e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:47.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.990+0000 7f6c891ff700 1 --2- 172.21.15.8:0/3578123315 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c841015a0 0x7f6c841019c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:47.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.990+0000 7f6c891ff700 1 --2- 172.21.15.8:0/3578123315 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c84102790 0x7f6c84102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:47.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.990+0000 7f6c891ff700 1 -- 172.21.15.8:0/3578123315 >> 172.21.15.8:0/3578123315 conn(0x7f6c840fcb10 msgr2=0x7f6c840fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:47.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.990+0000 7f6c891ff700 1 -- 172.21.15.8:0/3578123315 shutdown_connections 2023-12-17T12:03:47.993 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.990+0000 7f6c891ff700 1 -- 172.21.15.8:0/3578123315 wait complete. 2023-12-17T12:03:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.991+0000 7f6c891ff700 1 Processor -- start 2023-12-17T12:03:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.991+0000 7f6c891ff700 1 -- start start 2023-12-17T12:03:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.991+0000 7f6c891ff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c841015a0 0x7f6c841996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.991+0000 7f6c891ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c84102790 0x7f6c84199be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.991+0000 7f6c891ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c84103130 0x7f6c841a0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:47.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.991+0000 7f6c891ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c841a11d0 con 0x7f6c84102790 2023-12-17T12:03:47.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.991+0000 7f6c891ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c841a1310 con 0x7f6c84103130 2023-12-17T12:03:47.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.991+0000 7f6c891ff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c841a14a0 con 0x7f6c841015a0 2023-12-17T12:03:47.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.991+0000 7f6c7bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c84102790 0x7f6c84199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:47.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.992+0000 7f6c7bfff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c84102790 0x7f6c84199be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57396/0 (socket says 172.21.15.8:57396) 2023-12-17T12:03:47.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.992+0000 7f6c7bfff700 1 -- 172.21.15.8:0/37193136 learned_addr learned my addr 172.21.15.8:0/37193136 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:47.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.992+0000 7f6c82d9d700 1 --2- 172.21.15.8:0/37193136 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c841015a0 0x7f6c841996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:47.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.992+0000 7f6c8359e700 1 --2- 172.21.15.8:0/37193136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c84103130 0x7f6c841a0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:47.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.992+0000 7f6c7bfff700 1 -- 172.21.15.8:0/37193136 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c841015a0 msgr2=0x7f6c841996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:47.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.992+0000 7f6c7bfff700 1 --2- 172.21.15.8:0/37193136 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c841015a0 0x7f6c841996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:47.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.992+0000 7f6c7bfff700 1 -- 172.21.15.8:0/37193136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c84103130 msgr2=0x7f6c841a0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:47.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.992+0000 7f6c7bfff700 1 --2- 172.21.15.8:0/37193136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c84103130 0x7f6c841a0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:47.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.992+0000 7f6c7bfff700 1 -- 172.21.15.8:0/37193136 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c740095f0 con 0x7f6c84102790 2023-12-17T12:03:47.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.992+0000 7f6c8359e700 1 --2- 172.21.15.8:0/37193136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c84103130 0x7f6c841a0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T12:03:47.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.992+0000 7f6c7bfff700 1 --2- 172.21.15.8:0/37193136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c84102790 0x7f6c84199be0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c00d950 tx=0x7f6c6c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:47.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.992+0000 7f6c80d99700 1 -- 172.21.15.8:0/37193136 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c009940 con 0x7f6c84102790 2023-12-17T12:03:47.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.992+0000 7f6c80d99700 1 -- 172.21.15.8:0/37193136 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6c6c010460 con 0x7f6c84102790 2023-12-17T12:03:47.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.992+0000 7f6c891ff700 1 -- 172.21.15.8:0/37193136 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c841a1780 con 0x7f6c84102790 2023-12-17T12:03:47.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.992+0000 7f6c80d99700 1 -- 172.21.15.8:0/37193136 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c6c00f620 con 0x7f6c84102790 2023-12-17T12:03:47.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.993+0000 7f6c891ff700 1 -- 172.21.15.8:0/37193136 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c841a1c90 con 0x7f6c84102790 2023-12-17T12:03:47.998 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.994+0000 7f6c891ff700 1 -- 172.21.15.8:0/37193136 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c84068310 con 0x7f6c84102790 2023-12-17T12:03:47.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.996+0000 7f6c80d99700 1 -- 172.21.15.8:0/37193136 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f6c6c0105d0 con 0x7f6c84102790 2023-12-17T12:03:47.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.997+0000 7f6c80d99700 1 --2- 172.21.15.8:0/37193136 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f6c700a1510 0x7f6c700a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:48.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.997+0000 7f6c80d99700 1 -- 172.21.15.8:0/37193136 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f6c6c0cccb0 con 0x7f6c84102790 2023-12-17T12:03:48.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.997+0000 7f6c82d9d700 1 --2- 172.21.15.8:0/37193136 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f6c700a1510 0x7f6c700a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:48.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:47.998+0000 7f6c82d9d700 1 --2- 172.21.15.8:0/37193136 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f6c700a1510 0x7f6c700a39d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6c74006010 tx=0x7f6c74003740 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:48.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.000+0000 7f6c80d99700 1 -- 172.21.15.8:0/37193136 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f6c6c096190 con 0x7f6c84102790 2023-12-17T12:03:48.215 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.213+0000 7f6c891ff700 1 -- 172.21.15.8:0/37193136 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6c841a1f50 con 0x7f6c84102790 2023-12-17T12:03:48.216 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.214+0000 7f6c80d99700 1 -- 172.21.15.8:0/37193136 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6c6c0997b0 con 0x7f6c84102790 2023-12-17T12:03:48.216 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 32 2023-12-17T12:03:48.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.216+0000 7f6c891ff700 1 -- 172.21.15.8:0/37193136 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f6c700a1510 msgr2=0x7f6c700a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:48.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.216+0000 7f6c891ff700 1 --2- 172.21.15.8:0/37193136 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f6c700a1510 0x7f6c700a39d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6c74006010 tx=0x7f6c74003740 comp rx=0 tx=0).stop 2023-12-17T12:03:48.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.216+0000 7f6c891ff700 1 -- 172.21.15.8:0/37193136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c84102790 msgr2=0x7f6c84199be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:48.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.216+0000 7f6c891ff700 1 --2- 172.21.15.8:0/37193136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c84102790 0x7f6c84199be0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c00d950 tx=0x7f6c6c00dc60 comp rx=0 tx=0).stop 2023-12-17T12:03:48.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.216+0000 7f6c891ff700 1 -- 172.21.15.8:0/37193136 shutdown_connections 2023-12-17T12:03:48.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.216+0000 7f6c891ff700 1 --2- 172.21.15.8:0/37193136 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f6c700a1510 0x7f6c700a39d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:48.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.216+0000 7f6c891ff700 1 --2- 172.21.15.8:0/37193136 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6c84103130 0x7f6c841a0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:48.219 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.216+0000 7f6c891ff700 1 --2- 172.21.15.8:0/37193136 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6c841015a0 0x7f6c841996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:48.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.216+0000 7f6c891ff700 1 --2- 172.21.15.8:0/37193136 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6c84102790 0x7f6c84199be0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:48.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.216+0000 7f6c891ff700 1 -- 172.21.15.8:0/37193136 >> 172.21.15.8:0/37193136 conn(0x7f6c840fcb10 msgr2=0x7f6c84107fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:48.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.216+0000 7f6c891ff700 1 -- 172.21.15.8:0/37193136 shutdown_connections 2023-12-17T12:03:48.220 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.216+0000 7f6c891ff700 1 -- 172.21.15.8:0/37193136 wait complete. 2023-12-17T12:03:48.236 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:48 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/1138943' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:03:48.236 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:48 smithi008 ceph-mon[36830]: pgmap v295: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-12-17T12:03:48.236 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:48 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/703664630' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-17T12:03:48.238 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-17T12:03:48.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:48 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/1138943' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:03:48.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:48 smithi100 ceph-mon[41266]: pgmap v295: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-12-17T12:03:48.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:48 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/703664630' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-17T12:03:48.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.444+0000 7f1d7bbff700 1 -- 172.21.15.8:0/4151366130 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d74107260 msgr2=0x7f1d741096d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:48.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.444+0000 7f1d7bbff700 1 --2- 172.21.15.8:0/4151366130 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d74107260 0x7f1d741096d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1d6c00b0a0 tx=0x7f1d6c00b3b0 comp rx=0 tx=0).stop 2023-12-17T12:03:48.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.444+0000 7f1d7bbff700 1 -- 172.21.15.8:0/4151366130 shutdown_connections 2023-12-17T12:03:48.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.444+0000 7f1d7bbff700 1 --2- 172.21.15.8:0/4151366130 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d74107260 0x7f1d741096d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:48.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.444+0000 7f1d7bbff700 1 --2- 172.21.15.8:0/4151366130 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d74102000 0x7f1d741043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:48.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.444+0000 7f1d7bbff700 1 --2- 172.21.15.8:0/4151366130 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d74104930 0x7f1d74106d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:48.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.444+0000 7f1d7bbff700 1 -- 172.21.15.8:0/4151366130 >> 172.21.15.8:0/4151366130 conn(0x7f1d740fb9f0 msgr2=0x7f1d740fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:48.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.444+0000 7f1d7bbff700 1 -- 172.21.15.8:0/4151366130 shutdown_connections 2023-12-17T12:03:48.447 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.444+0000 7f1d7bbff700 1 -- 172.21.15.8:0/4151366130 wait complete. 2023-12-17T12:03:48.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.445+0000 7f1d7bbff700 1 Processor -- start 2023-12-17T12:03:48.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.445+0000 7f1d7bbff700 1 -- start start 2023-12-17T12:03:48.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.445+0000 7f1d7bbff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d74102000 0x7f1d74101920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:48.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.445+0000 7f1d7bbff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d74104930 0x7f1d740fffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:48.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.445+0000 7f1d7bbff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d74107260 0x7f1d741004f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:48.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.445+0000 7f1d7bbff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d74100c90 con 0x7f1d74102000 2023-12-17T12:03:48.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.445+0000 7f1d7bbff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d74100e00 con 0x7f1d74107260 2023-12-17T12:03:48.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.445+0000 7f1d7bbff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d741a1580 con 0x7f1d74104930 2023-12-17T12:03:48.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.446+0000 7f1d7999b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d74102000 0x7f1d74101920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:48.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.446+0000 7f1d7999b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d74102000 0x7f1d74101920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57410/0 (socket says 172.21.15.8:57410) 2023-12-17T12:03:48.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.446+0000 7f1d7999b700 1 -- 172.21.15.8:0/2021602948 learned_addr learned my addr 172.21.15.8:0/2021602948 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:48.450 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.446+0000 7f1d7a19c700 1 --2- 172.21.15.8:0/2021602948 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d74107260 0x7f1d741004f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:48.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.446+0000 7f1d7919a700 1 --2- 172.21.15.8:0/2021602948 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d74104930 0x7f1d740fffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:48.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.446+0000 7f1d7999b700 1 -- 172.21.15.8:0/2021602948 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d74104930 msgr2=0x7f1d740fffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:48.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.446+0000 7f1d7999b700 1 --2- 172.21.15.8:0/2021602948 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d74104930 0x7f1d740fffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:48.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.446+0000 7f1d7999b700 1 -- 172.21.15.8:0/2021602948 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d74107260 msgr2=0x7f1d741004f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:48.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.446+0000 7f1d7999b700 1 --2- 172.21.15.8:0/2021602948 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d74107260 0x7f1d741004f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:48.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.446+0000 7f1d7999b700 1 -- 172.21.15.8:0/2021602948 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d6c009d00 con 0x7f1d74102000 2023-12-17T12:03:48.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.446+0000 7f1d7999b700 1 --2- 172.21.15.8:0/2021602948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d74102000 0x7f1d74101920 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1d7000e9a0 tx=0x7f1d7000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:48.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.447+0000 7f1d6affd700 1 -- 172.21.15.8:0/2021602948 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d70009790 con 0x7f1d74102000 2023-12-17T12:03:48.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.447+0000 7f1d6affd700 1 -- 172.21.15.8:0/2021602948 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1d7000ce40 con 0x7f1d74102000 2023-12-17T12:03:48.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.447+0000 7f1d7bbff700 1 -- 172.21.15.8:0/2021602948 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d741a1810 con 0x7f1d74102000 2023-12-17T12:03:48.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.447+0000 7f1d6affd700 1 -- 172.21.15.8:0/2021602948 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d70018420 con 0x7f1d74102000 2023-12-17T12:03:48.451 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.447+0000 7f1d7bbff700 1 -- 172.21.15.8:0/2021602948 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d741a1d70 con 0x7f1d74102000 2023-12-17T12:03:48.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.448+0000 7f1d7bbff700 1 -- 172.21.15.8:0/2021602948 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d740fd570 con 0x7f1d74102000 2023-12-17T12:03:48.452 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.450+0000 7f1d6affd700 1 -- 172.21.15.8:0/2021602948 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f1d70010430 con 0x7f1d74102000 2023-12-17T12:03:48.454 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.452+0000 7f1d6affd700 1 --2- 172.21.15.8:0/2021602948 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f1d600a1590 0x7f1d600a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:48.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.452+0000 7f1d6affd700 1 -- 172.21.15.8:0/2021602948 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f1d70014070 con 0x7f1d74102000 2023-12-17T12:03:48.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.452+0000 7f1d7919a700 1 --2- 172.21.15.8:0/2021602948 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f1d600a1590 0x7f1d600a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:48.455 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.453+0000 7f1d7919a700 1 --2- 172.21.15.8:0/2021602948 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f1d600a1590 0x7f1d600a3a50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1d64007be0 tx=0x7f1d640073d0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:48.458 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.456+0000 7f1d6affd700 1 -- 172.21.15.8:0/2021602948 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f1d700522f0 con 0x7f1d74102000 2023-12-17T12:03:48.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:48 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/1138943' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:03:48.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:48 smithi186 ceph-mon[41182]: pgmap v295: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-12-17T12:03:48.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:48 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/703664630' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-12-17T12:03:48.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.668+0000 7f1d7bbff700 1 -- 172.21.15.8:0/2021602948 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1d7410cf40 con 0x7f1d74102000 2023-12-17T12:03:48.670 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.668+0000 7f1d6affd700 1 -- 172.21.15.8:0/2021602948 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1d70096460 con 0x7f1d74102000 2023-12-17T12:03:48.671 INFO:teuthology.orchestra.run.smithi008.stdout:pg_num: 64 2023-12-17T12:03:48.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.671+0000 7f1d7bbff700 1 -- 172.21.15.8:0/2021602948 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f1d600a1590 msgr2=0x7f1d600a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:48.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.671+0000 7f1d7bbff700 1 --2- 172.21.15.8:0/2021602948 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f1d600a1590 0x7f1d600a3a50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f1d64007be0 tx=0x7f1d640073d0 comp rx=0 tx=0).stop 2023-12-17T12:03:48.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.671+0000 7f1d7bbff700 1 -- 172.21.15.8:0/2021602948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d74102000 msgr2=0x7f1d74101920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:48.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.671+0000 7f1d7bbff700 1 --2- 172.21.15.8:0/2021602948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d74102000 0x7f1d74101920 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1d7000e9a0 tx=0x7f1d7000ecb0 comp rx=0 tx=0).stop 2023-12-17T12:03:48.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.671+0000 7f1d7bbff700 1 -- 172.21.15.8:0/2021602948 shutdown_connections 2023-12-17T12:03:48.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.671+0000 7f1d7bbff700 1 --2- 172.21.15.8:0/2021602948 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f1d600a1590 0x7f1d600a3a50 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:48.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.671+0000 7f1d7bbff700 1 --2- 172.21.15.8:0/2021602948 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f1d74107260 0x7f1d741004f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:48.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.671+0000 7f1d7bbff700 1 --2- 172.21.15.8:0/2021602948 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f1d74102000 0x7f1d74101920 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:48.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.671+0000 7f1d7bbff700 1 --2- 172.21.15.8:0/2021602948 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d74104930 0x7f1d740fffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:48.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.671+0000 7f1d7bbff700 1 -- 172.21.15.8:0/2021602948 >> 172.21.15.8:0/2021602948 conn(0x7f1d740fb9f0 msgr2=0x7f1d74102a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:48.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.671+0000 7f1d7bbff700 1 -- 172.21.15.8:0/2021602948 shutdown_connections 2023-12-17T12:03:48.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.671+0000 7f1d7bbff700 1 -- 172.21.15.8:0/2021602948 wait complete. 2023-12-17T12:03:48.692 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-17T12:03:48.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.895+0000 7f3fa0dff700 1 -- 172.21.15.8:0/518242709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f9c102690 msgr2=0x7f3f9c102af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:48.898 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.895+0000 7f3fa0dff700 1 --2- 172.21.15.8:0/518242709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f9c102690 0x7f3f9c102af0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f3f900099c0 tx=0x7f3f90009cd0 comp rx=0 tx=0).stop 2023-12-17T12:03:48.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.895+0000 7f3fa0dff700 1 -- 172.21.15.8:0/518242709 shutdown_connections 2023-12-17T12:03:48.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.895+0000 7f3fa0dff700 1 --2- 172.21.15.8:0/518242709 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f9c103030 0x7f3f9c1098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:48.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.895+0000 7f3fa0dff700 1 --2- 172.21.15.8:0/518242709 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f9c1014a0 0x7f3f9c1018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:48.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.895+0000 7f3fa0dff700 1 --2- 172.21.15.8:0/518242709 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f9c102690 0x7f3f9c102af0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:48.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.895+0000 7f3fa0dff700 1 -- 172.21.15.8:0/518242709 >> 172.21.15.8:0/518242709 conn(0x7f3f9c0fca10 msgr2=0x7f3f9c0fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:48.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.895+0000 7f3fa0dff700 1 -- 172.21.15.8:0/518242709 shutdown_connections 2023-12-17T12:03:48.899 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.895+0000 7f3fa0dff700 1 -- 172.21.15.8:0/518242709 wait complete. 2023-12-17T12:03:48.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.896+0000 7f3fa0dff700 1 Processor -- start 2023-12-17T12:03:48.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.896+0000 7f3fa0dff700 1 -- start start 2023-12-17T12:03:48.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.897+0000 7f3fa0dff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f9c1014a0 0x7f3f9c197340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:48.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.897+0000 7f3fa0dff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f9c102690 0x7f3f9c197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:48.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.897+0000 7f3fa0dff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f9c103030 0x7f3f9c19e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:48.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.897+0000 7f3fa0dff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c19ee70 con 0x7f3f9c103030 2023-12-17T12:03:48.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.897+0000 7f3fa0dff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c19efb0 con 0x7f3f9c102690 2023-12-17T12:03:48.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.897+0000 7f3fa0dff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9c19f140 con 0x7f3f9c1014a0 2023-12-17T12:03:48.901 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.897+0000 7f3f9ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f9c103030 0x7f3f9c19e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:48.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.897+0000 7f3f9a59c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f9c1014a0 0x7f3f9c197340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:48.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.897+0000 7f3f9ad9d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f9c103030 0x7f3f9c19e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57434/0 (socket says 172.21.15.8:57434) 2023-12-17T12:03:48.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.897+0000 7f3f9ad9d700 1 -- 172.21.15.8:0/1187813210 learned_addr learned my addr 172.21.15.8:0/1187813210 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:48.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.897+0000 7f3f99d9b700 1 --2- 172.21.15.8:0/1187813210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f9c102690 0x7f3f9c197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:48.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.898+0000 7f3f9ad9d700 1 -- 172.21.15.8:0/1187813210 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f9c1014a0 msgr2=0x7f3f9c197340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:48.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.898+0000 7f3f9ad9d700 1 --2- 172.21.15.8:0/1187813210 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f9c1014a0 0x7f3f9c197340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:48.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.898+0000 7f3f9ad9d700 1 -- 172.21.15.8:0/1187813210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f9c102690 msgr2=0x7f3f9c197880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:48.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.898+0000 7f3f9ad9d700 1 --2- 172.21.15.8:0/1187813210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f9c102690 0x7f3f9c197880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:48.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.898+0000 7f3f9ad9d700 1 -- 172.21.15.8:0/1187813210 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f900095f0 con 0x7f3f9c103030 2023-12-17T12:03:48.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.898+0000 7f3f9ad9d700 1 --2- 172.21.15.8:0/1187813210 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f9c103030 0x7f3f9c19e8a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400ef30 tx=0x7f3f9400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:48.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.898+0000 7f3f8b7fe700 1 -- 172.21.15.8:0/1187813210 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f94018070 con 0x7f3f9c103030 2023-12-17T12:03:48.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.898+0000 7f3f8b7fe700 1 -- 172.21.15.8:0/1187813210 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f9400f040 con 0x7f3f9c103030 2023-12-17T12:03:48.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.898+0000 7f3fa0dff700 1 -- 172.21.15.8:0/1187813210 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f9c19f3c0 con 0x7f3f9c103030 2023-12-17T12:03:48.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.898+0000 7f3fa0dff700 1 -- 172.21.15.8:0/1187813210 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f9c19f880 con 0x7f3f9c103030 2023-12-17T12:03:48.902 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.899+0000 7f3f8b7fe700 1 -- 172.21.15.8:0/1187813210 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f9400cbe0 con 0x7f3f9c103030 2023-12-17T12:03:48.903 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.899+0000 7f3fa0dff700 1 -- 172.21.15.8:0/1187813210 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f9c108970 con 0x7f3f9c103030 2023-12-17T12:03:48.904 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.901+0000 7f3f8b7fe700 1 -- 172.21.15.8:0/1187813210 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f3f9400cd40 con 0x7f3f9c103030 2023-12-17T12:03:48.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.903+0000 7f3f8b7fe700 1 --2- 172.21.15.8:0/1187813210 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f3f840a1510 0x7f3f840a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:48.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.903+0000 7f3f8b7fe700 1 -- 172.21.15.8:0/1187813210 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f3f940cd3a0 con 0x7f3f9c103030 2023-12-17T12:03:48.905 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.903+0000 7f3f9a59c700 1 --2- 172.21.15.8:0/1187813210 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f3f840a1510 0x7f3f840a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:48.906 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.904+0000 7f3f9a59c700 1 --2- 172.21.15.8:0/1187813210 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f3f840a1510 0x7f3f840a39d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c1024f0 tx=0x7f3f8c009260 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:48.907 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:48.905+0000 7f3f8b7fe700 1 -- 172.21.15.8:0/1187813210 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f3f940968b0 con 0x7f3f9c103030 2023-12-17T12:03:49.171 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.169+0000 7f3fa0dff700 1 -- 172.21.15.8:0/1187813210 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3f9c068230 con 0x7f3f9c103030 2023-12-17T12:03:49.172 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.170+0000 7f3f8b7fe700 1 -- 172.21.15.8:0/1187813210 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11347 (secure 0 0 0) 0x7f3f94099ed0 con 0x7f3f9c103030 2023-12-17T12:03:49.172 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:03:49.172 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2669069079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2669069079},{"type":"v1","addr":"172.21.15.8:6835","nonce":2669069079}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/4241050553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":4241050553},{"type":"v1","addr":"172.21.15.8:6837","nonce":4241050553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-17T12:02:50.176951+0000","modified":"2023-12-17T12:02:58.040005+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24569,"mds_1":24541,"mds_2":24503,"mds_3":24470,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14640":{"gid":14640,"name":"f","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/2765387309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2765387309},{"type":"v1","addr":"172.21.15.186:6835","nonce":2765387309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14679":{"gid":14679,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/487046247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":487046247},{"type":"v1","addr":"172.21.15.8:6839","nonce":487046247}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14691":{"gid":14691,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6841/338406768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":338406768},{"type":"v1","addr":"172.21.15.8:6841","nonce":338406768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24451":{"gid":24451,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.186:6833/582753561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":582753561},{"type":"v1","addr":"172.21.15.186:6833","nonce":582753561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24470":{"gid":24470,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.100:6833/305815776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":305815776},{"type":"v1","addr":"172.21.15.100:6833","nonce":305815776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24503":{"gid":24503,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6835/2140351853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2140351853},{"type":"v1","addr":"172.21.15.100:6835","nonce":2140351853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24520":{"gid":24520,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/822451724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":822451724},{"type":"v1","addr":"172.21.15.186:6837","nonce":822451724}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24530":{"gid":24530,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6837/4176831844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":4176831844},{"type":"v1","addr":"172.21.15.100:6837","nonce":4176831844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.186:6839/91602342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":91602342},{"type":"v1","addr":"172.21.15.186:6839","nonce":91602342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24569":{"gid":24569,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6839/3921737538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3921737538},{"type":"v1","addr":"172.21.15.100:6839","nonce":3921737538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-17T12:03:49.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.172+0000 7f3fa0dff700 1 -- 172.21.15.8:0/1187813210 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f3f840a1510 msgr2=0x7f3f840a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:49.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.172+0000 7f3fa0dff700 1 --2- 172.21.15.8:0/1187813210 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f3f840a1510 0x7f3f840a39d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3f9c1024f0 tx=0x7f3f8c009260 comp rx=0 tx=0).stop 2023-12-17T12:03:49.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.172+0000 7f3fa0dff700 1 -- 172.21.15.8:0/1187813210 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f9c103030 msgr2=0x7f3f9c19e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:49.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.172+0000 7f3fa0dff700 1 --2- 172.21.15.8:0/1187813210 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f9c103030 0x7f3f9c19e8a0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3f9400ef30 tx=0x7f3f9400c3a0 comp rx=0 tx=0).stop 2023-12-17T12:03:49.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.172+0000 7f3fa0dff700 1 -- 172.21.15.8:0/1187813210 shutdown_connections 2023-12-17T12:03:49.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.172+0000 7f3fa0dff700 1 --2- 172.21.15.8:0/1187813210 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f3f840a1510 0x7f3f840a39d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:49.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.172+0000 7f3fa0dff700 1 --2- 172.21.15.8:0/1187813210 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3f9c103030 0x7f3f9c19e8a0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:49.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.172+0000 7f3fa0dff700 1 --2- 172.21.15.8:0/1187813210 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3f9c1014a0 0x7f3f9c197340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:49.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.172+0000 7f3fa0dff700 1 --2- 172.21.15.8:0/1187813210 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3f9c102690 0x7f3f9c197880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:49.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.172+0000 7f3fa0dff700 1 -- 172.21.15.8:0/1187813210 >> 172.21.15.8:0/1187813210 conn(0x7f3f9c0fca10 msgr2=0x7f3f9c105ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:49.175 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.172+0000 7f3fa0dff700 1 -- 172.21.15.8:0/1187813210 shutdown_connections 2023-12-17T12:03:49.176 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.172+0000 7f3fa0dff700 1 -- 172.21.15.8:0/1187813210 wait complete. 2023-12-17T12:03:49.176 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 27 2023-12-17T12:03:49.198 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T12:03:49.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.400+0000 7f521a5ff700 1 -- 172.21.15.8:0/2056517628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52141014a0 msgr2=0x7f52141018c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:49.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.400+0000 7f521a5ff700 1 --2- 172.21.15.8:0/2056517628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52141014a0 0x7f52141018c0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f52040099c0 tx=0x7f5204009cd0 comp rx=0 tx=0).stop 2023-12-17T12:03:49.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.400+0000 7f521a5ff700 1 -- 172.21.15.8:0/2056517628 shutdown_connections 2023-12-17T12:03:49.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.400+0000 7f521a5ff700 1 --2- 172.21.15.8:0/2056517628 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5214103030 0x7f52141098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:49.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.400+0000 7f521a5ff700 1 --2- 172.21.15.8:0/2056517628 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f52141014a0 0x7f52141018c0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:49.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.400+0000 7f521a5ff700 1 --2- 172.21.15.8:0/2056517628 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5214102690 0x7f5214102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:49.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.400+0000 7f521a5ff700 1 -- 172.21.15.8:0/2056517628 >> 172.21.15.8:0/2056517628 conn(0x7f52140fca10 msgr2=0x7f52140fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:49.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.400+0000 7f521a5ff700 1 -- 172.21.15.8:0/2056517628 shutdown_connections 2023-12-17T12:03:49.403 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.400+0000 7f521a5ff700 1 -- 172.21.15.8:0/2056517628 wait complete. 2023-12-17T12:03:49.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.401+0000 7f521a5ff700 1 Processor -- start 2023-12-17T12:03:49.405 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.401+0000 7f521a5ff700 1 -- start start 2023-12-17T12:03:49.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.401+0000 7f521a5ff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52141014a0 0x7f5214075330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:49.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.402+0000 7f521a5ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5214102690 0x7f52140739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:49.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.402+0000 7f521a5ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5214103030 0x7f5214073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:49.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.402+0000 7f521a5ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521419b230 con 0x7f5214103030 2023-12-17T12:03:49.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.402+0000 7f521a5ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5214074440 con 0x7f5214102690 2023-12-17T12:03:49.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.402+0000 7f521a5ff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5214074600 con 0x7f52141014a0 2023-12-17T12:03:49.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.402+0000 7f5218b9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5214103030 0x7f5214073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:49.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.402+0000 7f5218b9c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5214103030 0x7f5214073f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57450/0 (socket says 172.21.15.8:57450) 2023-12-17T12:03:49.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.402+0000 7f5218b9c700 1 -- 172.21.15.8:0/3372892912 learned_addr learned my addr 172.21.15.8:0/3372892912 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:49.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.402+0000 7f52137fe700 1 --2- 172.21.15.8:0/3372892912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5214102690 0x7f52140739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:49.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.402+0000 7f5213fff700 1 --2- 172.21.15.8:0/3372892912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52141014a0 0x7f5214075330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:49.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.402+0000 7f5218b9c700 1 -- 172.21.15.8:0/3372892912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52141014a0 msgr2=0x7f5214075330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:49.406 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.402+0000 7f5218b9c700 1 --2- 172.21.15.8:0/3372892912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52141014a0 0x7f5214075330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:49.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.402+0000 7f5218b9c700 1 -- 172.21.15.8:0/3372892912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5214102690 msgr2=0x7f52140739c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:49.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.402+0000 7f5218b9c700 1 --2- 172.21.15.8:0/3372892912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5214102690 0x7f52140739c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:49.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.402+0000 7f5218b9c700 1 -- 172.21.15.8:0/3372892912 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52040095f0 con 0x7f5214103030 2023-12-17T12:03:49.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.402+0000 7f5213fff700 1 --2- 172.21.15.8:0/3372892912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52141014a0 0x7f5214075330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T12:03:49.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.402+0000 7f5218b9c700 1 --2- 172.21.15.8:0/3372892912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5214103030 0x7f5214073f00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f520c007ee0 tx=0x7f520c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:49.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.403+0000 7f52117fa700 1 -- 172.21.15.8:0/3372892912 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520c017070 con 0x7f5214103030 2023-12-17T12:03:49.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.403+0000 7f52117fa700 1 -- 172.21.15.8:0/3372892912 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f520c00f040 con 0x7f5214103030 2023-12-17T12:03:49.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.403+0000 7f521a5ff700 1 -- 172.21.15.8:0/3372892912 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52141a5be0 con 0x7f5214103030 2023-12-17T12:03:49.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.403+0000 7f52117fa700 1 -- 172.21.15.8:0/3372892912 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520c005710 con 0x7f5214103030 2023-12-17T12:03:49.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.403+0000 7f521a5ff700 1 -- 172.21.15.8:0/3372892912 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52141a5fa0 con 0x7f5214103030 2023-12-17T12:03:49.407 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.404+0000 7f521a5ff700 1 -- 172.21.15.8:0/3372892912 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52141089e0 con 0x7f5214103030 2023-12-17T12:03:49.408 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.406+0000 7f52117fa700 1 -- 172.21.15.8:0/3372892912 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f520c005870 con 0x7f5214103030 2023-12-17T12:03:49.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.408+0000 7f52117fa700 1 --2- 172.21.15.8:0/3372892912 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f51fc0a1590 0x7f51fc0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:49.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.408+0000 7f52117fa700 1 -- 172.21.15.8:0/3372892912 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f520c0cc6d0 con 0x7f5214103030 2023-12-17T12:03:49.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.408+0000 7f5213fff700 1 --2- 172.21.15.8:0/3372892912 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f51fc0a1590 0x7f51fc0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:49.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.409+0000 7f5213fff700 1 --2- 172.21.15.8:0/3372892912 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f51fc0a1590 0x7f51fc0a3a50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f52040098e0 tx=0x7f520400b540 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:49.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.412+0000 7f52117fa700 1 -- 172.21.15.8:0/3372892912 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f520c095b50 con 0x7f5214103030 2023-12-17T12:03:49.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:49 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/37193136' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-17T12:03:49.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:49 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/2021602948' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-17T12:03:49.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:49 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/37193136' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-17T12:03:49.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:49 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/2021602948' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-17T12:03:49.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:49 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/37193136' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-12-17T12:03:49.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:49 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/2021602948' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-12-17T12:03:49.631 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.629+0000 7f521a5ff700 1 -- 172.21.15.8:0/3372892912 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5214068230 con 0x7f5214103030 2023-12-17T12:03:49.633 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.631+0000 7f52117fa700 1 -- 172.21.15.8:0/3372892912 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22518 (secure 0 0 0) 0x7f520c099170 con 0x7f5214103030 2023-12-17T12:03:49.634 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:03:49.634 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":85,"fsid":"f43f508a-9cd2-11ee-95a5-87774f69a715","created":"2023-12-17T11:55:30.666634+0000","modified":"2023-12-17T12:03:28.446977+0000","last_up_change":"2023-12-17T12:02:04.656573+0000","last_in_change":"2023-12-17T12:01:45.526832+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:58:43.972745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-17T12:02:48.278153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-17T12:02:49.637968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1f8acaf-a47b-4b74-a78d-e0b6be49a10e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6803","nonce":297519189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6805","nonce":297519189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6809","nonce":297519189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6807","nonce":297519189}]},"public_addr":"172.21.15.8:6803/297519189","cluster_addr":"172.21.15.8:6805/297519189","heartbeat_back_addr":"172.21.15.8:6809/297519189","heartbeat_front_addr":"172.21.15.8:6807/297519189","state":["exists","up"]},{"osd":1,"uuid":"d7138889-77de-43ba-b36b-7628f6f66bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6801","nonce":2496516573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6803","nonce":2496516573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6807","nonce":2496516573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6805","nonce":2496516573}]},"public_addr":"172.21.15.100:6801/2496516573","cluster_addr":"172.21.15.100:6803/2496516573","heartbeat_back_addr":"172.21.15.100:6807/2496516573","heartbeat_front_addr":"172.21.15.100:6805/2496516573","state":["exists","up"]},{"osd":2,"uuid":"ff452a6b-a11e-47be-9eaf-ec1001b51447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6801","nonce":2454925270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6803","nonce":2454925270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6807","nonce":2454925270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6805","nonce":2454925270}]},"public_addr":"172.21.15.186:6801/2454925270","cluster_addr":"172.21.15.186:6803/2454925270","heartbeat_back_addr":"172.21.15.186:6807/2454925270","heartbeat_front_addr":"172.21.15.186:6805/2454925270","state":["exists","up"]},{"osd":3,"uuid":"d19ab765-df7b-48c7-9012-8a3ac7d81aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6811","nonce":1141622701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6813","nonce":1141622701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6817","nonce":1141622701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6815","nonce":1141622701}]},"public_addr":"172.21.15.8:6811/1141622701","cluster_addr":"172.21.15.8:6813/1141622701","heartbeat_back_addr":"172.21.15.8:6817/1141622701","heartbeat_front_addr":"172.21.15.8:6815/1141622701","state":["exists","up"]},{"osd":4,"uuid":"8ecc3a01-f19a-40a7-93a2-8870116afe6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6809","nonce":1902152516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6811","nonce":1902152516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6815","nonce":1902152516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6813","nonce":1902152516}]},"public_addr":"172.21.15.100:6809/1902152516","cluster_addr":"172.21.15.100:6811/1902152516","heartbeat_back_addr":"172.21.15.100:6815/1902152516","heartbeat_front_addr":"172.21.15.100:6813/1902152516","state":["exists","up"]},{"osd":5,"uuid":"ac057cc9-2a27-4216-a7ae-fc60d9796eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6809","nonce":648349934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6811","nonce":648349934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6815","nonce":648349934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6813","nonce":648349934}]},"public_addr":"172.21.15.186:6809/648349934","cluster_addr":"172.21.15.186:6811/648349934","heartbeat_back_addr":"172.21.15.186:6815/648349934","heartbeat_front_addr":"172.21.15.186:6813/648349934","state":["exists","up"]},{"osd":6,"uuid":"bb5325e0-fe12-4bbc-96a9-86c228106a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6819","nonce":3266909294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6821","nonce":3266909294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6825","nonce":3266909294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6823","nonce":3266909294}]},"public_addr":"172.21.15.8:6819/3266909294","cluster_addr":"172.21.15.8:6821/3266909294","heartbeat_back_addr":"172.21.15.8:6825/3266909294","heartbeat_front_addr":"172.21.15.8:6823/3266909294","state":["exists","up"]},{"osd":7,"uuid":"48939d99-29dd-436b-b9f1-fdfe1ee26315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6817","nonce":1631494583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6819","nonce":1631494583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6823","nonce":1631494583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6821","nonce":1631494583}]},"public_addr":"172.21.15.100:6817/1631494583","cluster_addr":"172.21.15.100:6819/1631494583","heartbeat_back_addr":"172.21.15.100:6823/1631494583","heartbeat_front_addr":"172.21.15.100:6821/1631494583","state":["exists","up"]},{"osd":8,"uuid":"e3414f7f-7665-406f-89ec-79cbb3d3e274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6817","nonce":3569004799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6819","nonce":3569004799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6823","nonce":3569004799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6821","nonce":3569004799}]},"public_addr":"172.21.15.186:6817/3569004799","cluster_addr":"172.21.15.186:6819/3569004799","heartbeat_back_addr":"172.21.15.186:6823/3569004799","heartbeat_front_addr":"172.21.15.186:6821/3569004799","state":["exists","up"]},{"osd":9,"uuid":"b04f519d-6e44-4158-b6e1-aa4d64be3404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6827","nonce":3980647643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6829","nonce":3980647643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6833","nonce":3980647643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6831","nonce":3980647643}]},"public_addr":"172.21.15.8:6827/3980647643","cluster_addr":"172.21.15.8:6829/3980647643","heartbeat_back_addr":"172.21.15.8:6833/3980647643","heartbeat_front_addr":"172.21.15.8:6831/3980647643","state":["exists","up"]},{"osd":10,"uuid":"779fde04-620b-4b44-bd35-39be1470eec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6825","nonce":34112410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6827","nonce":34112410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6831","nonce":34112410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6829","nonce":34112410}]},"public_addr":"172.21.15.100:6825/34112410","cluster_addr":"172.21.15.100:6827/34112410","heartbeat_back_addr":"172.21.15.100:6831/34112410","heartbeat_front_addr":"172.21.15.100:6829/34112410","state":["exists","up"]},{"osd":11,"uuid":"6bbcb42f-aa99-44e4-9c3f-d818423eb5b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6825","nonce":3779371472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6827","nonce":3779371472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6831","nonce":3779371472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6829","nonce":3779371472}]},"public_addr":"172.21.15.186:6825/3779371472","cluster_addr":"172.21.15.186:6827/3779371472","heartbeat_back_addr":"172.21.15.186:6831/3779371472","heartbeat_front_addr":"172.21.15.186:6829/3779371472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:57:56.955667+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:58:18.433916+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:58:40.589590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:59:03.635858+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:59:25.544564+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:59:48.171593+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:00:10.876885+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:00:32.920759+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:00:55.273330+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:01:18.131720+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:01:40.259620+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:02:02.776536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.19","mappings":[{"from":3,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":6}]},{"pgid":"3.26","mappings":[{"from":1,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/4074020814":"2023-12-18T11:56:27.362306+0000","172.21.15.8:6801/222068650":"2023-12-18T11:56:27.362306+0000","172.21.15.8:6801/4187398661":"2023-12-18T11:56:00.731492+0000","172.21.15.8:6800/222068650":"2023-12-18T11:56:27.362306+0000","172.21.15.8:6800/4187398661":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/2964092603":"2023-12-18T11:56:27.362306+0000","172.21.15.8:0/35186087":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/1429868241":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/174719729":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/2106317618":"2023-12-18T11:56:27.362306+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T12:03:49.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.633+0000 7f521a5ff700 1 -- 172.21.15.8:0/3372892912 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f51fc0a1590 msgr2=0x7f51fc0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:49.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.633+0000 7f521a5ff700 1 --2- 172.21.15.8:0/3372892912 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f51fc0a1590 0x7f51fc0a3a50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f52040098e0 tx=0x7f520400b540 comp rx=0 tx=0).stop 2023-12-17T12:03:49.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.633+0000 7f521a5ff700 1 -- 172.21.15.8:0/3372892912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5214103030 msgr2=0x7f5214073f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:49.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.633+0000 7f521a5ff700 1 --2- 172.21.15.8:0/3372892912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5214103030 0x7f5214073f00 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f520c007ee0 tx=0x7f520c00d3b0 comp rx=0 tx=0).stop 2023-12-17T12:03:49.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.633+0000 7f521a5ff700 1 -- 172.21.15.8:0/3372892912 shutdown_connections 2023-12-17T12:03:49.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.633+0000 7f521a5ff700 1 --2- 172.21.15.8:0/3372892912 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f51fc0a1590 0x7f51fc0a3a50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:49.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.633+0000 7f521a5ff700 1 --2- 172.21.15.8:0/3372892912 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5214103030 0x7f5214073f00 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:49.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.633+0000 7f521a5ff700 1 --2- 172.21.15.8:0/3372892912 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f52141014a0 0x7f5214075330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:49.636 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.633+0000 7f521a5ff700 1 --2- 172.21.15.8:0/3372892912 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5214102690 0x7f52140739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:49.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.633+0000 7f521a5ff700 1 -- 172.21.15.8:0/3372892912 >> 172.21.15.8:0/3372892912 conn(0x7f52140fca10 msgr2=0x7f5214105b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:49.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.634+0000 7f521a5ff700 1 -- 172.21.15.8:0/3372892912 shutdown_connections 2023-12-17T12:03:49.637 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.634+0000 7f521a5ff700 1 -- 172.21.15.8:0/3372892912 wait complete. 2023-12-17T12:03:49.655 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-17T12:03:49.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.858+0000 7f5f20fff700 1 -- 172.21.15.8:0/887205594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f1c102690 msgr2=0x7f5f1c102af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:49.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.858+0000 7f5f20fff700 1 --2- 172.21.15.8:0/887205594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f1c102690 0x7f5f1c102af0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5f040099c0 tx=0x7f5f04009cd0 comp rx=0 tx=0).stop 2023-12-17T12:03:49.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.858+0000 7f5f20fff700 1 -- 172.21.15.8:0/887205594 shutdown_connections 2023-12-17T12:03:49.860 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.858+0000 7f5f20fff700 1 --2- 172.21.15.8:0/887205594 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f1c103030 0x7f5f1c1098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:49.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.858+0000 7f5f20fff700 1 --2- 172.21.15.8:0/887205594 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f1c1014a0 0x7f5f1c1018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:49.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.858+0000 7f5f20fff700 1 --2- 172.21.15.8:0/887205594 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f1c102690 0x7f5f1c102af0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:49.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.858+0000 7f5f20fff700 1 -- 172.21.15.8:0/887205594 >> 172.21.15.8:0/887205594 conn(0x7f5f1c0fca10 msgr2=0x7f5f1c0fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:49.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.858+0000 7f5f20fff700 1 -- 172.21.15.8:0/887205594 shutdown_connections 2023-12-17T12:03:49.861 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.858+0000 7f5f20fff700 1 -- 172.21.15.8:0/887205594 wait complete. 2023-12-17T12:03:49.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.859+0000 7f5f20fff700 1 Processor -- start 2023-12-17T12:03:49.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.859+0000 7f5f20fff700 1 -- start start 2023-12-17T12:03:49.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.859+0000 7f5f20fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f1c1014a0 0x7f5f1c199560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:49.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.859+0000 7f5f20fff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f1c102690 0x7f5f1c199aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:49.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.859+0000 7f5f20fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f1c103030 0x7f5f1c1a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:49.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.859+0000 7f5f20fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c1a1090 con 0x7f5f1c1014a0 2023-12-17T12:03:49.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.859+0000 7f5f20fff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c1a11d0 con 0x7f5f1c103030 2023-12-17T12:03:49.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.859+0000 7f5f20fff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1c1a1360 con 0x7f5f1c102690 2023-12-17T12:03:49.863 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.859+0000 7f5f1a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f1c1014a0 0x7f5f1c199560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:49.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.859+0000 7f5f1a59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f1c1014a0 0x7f5f1c199560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57458/0 (socket says 172.21.15.8:57458) 2023-12-17T12:03:49.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.859+0000 7f5f1a59c700 1 -- 172.21.15.8:0/373606118 learned_addr learned my addr 172.21.15.8:0/373606118 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:49.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.860+0000 7f5f1ad9d700 1 --2- 172.21.15.8:0/373606118 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f1c103030 0x7f5f1c1a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:49.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.860+0000 7f5f13fff700 1 --2- 172.21.15.8:0/373606118 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f1c102690 0x7f5f1c199aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:49.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.860+0000 7f5f1a59c700 1 -- 172.21.15.8:0/373606118 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f1c102690 msgr2=0x7f5f1c199aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:49.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.860+0000 7f5f1a59c700 1 --2- 172.21.15.8:0/373606118 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f1c102690 0x7f5f1c199aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:49.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.860+0000 7f5f1a59c700 1 -- 172.21.15.8:0/373606118 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f1c103030 msgr2=0x7f5f1c1a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:49.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.860+0000 7f5f1a59c700 1 --2- 172.21.15.8:0/373606118 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f1c103030 0x7f5f1c1a0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:49.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.860+0000 7f5f1a59c700 1 -- 172.21.15.8:0/373606118 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f040095f0 con 0x7f5f1c1014a0 2023-12-17T12:03:49.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.860+0000 7f5f1a59c700 1 --2- 172.21.15.8:0/373606118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f1c1014a0 0x7f5f1c199560 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c00e970 tx=0x7f5f0c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:49.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.860+0000 7f5f137fe700 1 -- 172.21.15.8:0/373606118 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c009790 con 0x7f5f1c1014a0 2023-12-17T12:03:49.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.860+0000 7f5f137fe700 1 -- 172.21.15.8:0/373606118 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5f0c00c7e0 con 0x7f5f1c1014a0 2023-12-17T12:03:49.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.860+0000 7f5f20fff700 1 -- 172.21.15.8:0/373606118 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f1c1a1640 con 0x7f5f1c1014a0 2023-12-17T12:03:49.864 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.860+0000 7f5f137fe700 1 -- 172.21.15.8:0/373606118 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c003bd0 con 0x7f5f1c1014a0 2023-12-17T12:03:49.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.861+0000 7f5f20fff700 1 -- 172.21.15.8:0/373606118 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f1c1a1b50 con 0x7f5f1c1014a0 2023-12-17T12:03:49.865 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.861+0000 7f5f20fff700 1 -- 172.21.15.8:0/373606118 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f1c068230 con 0x7f5f1c1014a0 2023-12-17T12:03:49.866 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.863+0000 7f5f137fe700 1 -- 172.21.15.8:0/373606118 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f5f0c00c950 con 0x7f5f1c1014a0 2023-12-17T12:03:49.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.865+0000 7f5f137fe700 1 --2- 172.21.15.8:0/373606118 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f5f080a1510 0x7f5f080a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:49.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.865+0000 7f5f137fe700 1 -- 172.21.15.8:0/373606118 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f5f0c014070 con 0x7f5f1c1014a0 2023-12-17T12:03:49.867 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.865+0000 7f5f13fff700 1 --2- 172.21.15.8:0/373606118 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f5f080a1510 0x7f5f080a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:49.868 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.866+0000 7f5f13fff700 1 --2- 172.21.15.8:0/373606118 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f5f080a1510 0x7f5f080a39d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5f04009990 tx=0x7f5f04003680 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:49.871 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:49.868+0000 7f5f137fe700 1 -- 172.21.15.8:0/373606118 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f5f0c096530 con 0x7f5f1c1014a0 2023-12-17T12:03:50.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.133+0000 7f5f20fff700 1 -- 172.21.15.8:0/373606118 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f1c10cbc0 con 0x7f5f1c1014a0 2023-12-17T12:03:50.136 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.134+0000 7f5f137fe700 1 -- 172.21.15.8:0/373606118 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11347 (secure 0 0 0) 0x7f5f0c099b50 con 0x7f5f1c1014a0 2023-12-17T12:03:50.137 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:03:50.137 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2669069079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2669069079},{"type":"v1","addr":"172.21.15.8:6835","nonce":2669069079}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/4241050553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":4241050553},{"type":"v1","addr":"172.21.15.8:6837","nonce":4241050553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-17T12:02:50.176951+0000","modified":"2023-12-17T12:02:58.040005+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24569,"mds_1":24541,"mds_2":24503,"mds_3":24470,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14640":{"gid":14640,"name":"f","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/2765387309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2765387309},{"type":"v1","addr":"172.21.15.186:6835","nonce":2765387309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14679":{"gid":14679,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/487046247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":487046247},{"type":"v1","addr":"172.21.15.8:6839","nonce":487046247}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14691":{"gid":14691,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6841/338406768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":338406768},{"type":"v1","addr":"172.21.15.8:6841","nonce":338406768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24451":{"gid":24451,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.186:6833/582753561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":582753561},{"type":"v1","addr":"172.21.15.186:6833","nonce":582753561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24470":{"gid":24470,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.100:6833/305815776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":305815776},{"type":"v1","addr":"172.21.15.100:6833","nonce":305815776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24503":{"gid":24503,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6835/2140351853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2140351853},{"type":"v1","addr":"172.21.15.100:6835","nonce":2140351853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24520":{"gid":24520,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/822451724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":822451724},{"type":"v1","addr":"172.21.15.186:6837","nonce":822451724}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24530":{"gid":24530,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6837/4176831844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":4176831844},{"type":"v1","addr":"172.21.15.100:6837","nonce":4176831844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.186:6839/91602342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":91602342},{"type":"v1","addr":"172.21.15.186:6839","nonce":91602342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24569":{"gid":24569,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6839/3921737538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3921737538},{"type":"v1","addr":"172.21.15.100:6839","nonce":3921737538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-17T12:03:50.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.137+0000 7f5f20fff700 1 -- 172.21.15.8:0/373606118 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f5f080a1510 msgr2=0x7f5f080a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:50.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.137+0000 7f5f20fff700 1 --2- 172.21.15.8:0/373606118 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f5f080a1510 0x7f5f080a39d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f5f04009990 tx=0x7f5f04003680 comp rx=0 tx=0).stop 2023-12-17T12:03:50.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.137+0000 7f5f20fff700 1 -- 172.21.15.8:0/373606118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f1c1014a0 msgr2=0x7f5f1c199560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:50.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.137+0000 7f5f20fff700 1 --2- 172.21.15.8:0/373606118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f1c1014a0 0x7f5f1c199560 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c00e970 tx=0x7f5f0c00ec80 comp rx=0 tx=0).stop 2023-12-17T12:03:50.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.138+0000 7f5f20fff700 1 -- 172.21.15.8:0/373606118 shutdown_connections 2023-12-17T12:03:50.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.138+0000 7f5f20fff700 1 --2- 172.21.15.8:0/373606118 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f5f080a1510 0x7f5f080a39d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.140 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.138+0000 7f5f20fff700 1 --2- 172.21.15.8:0/373606118 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5f1c103030 0x7f5f1c1a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.138+0000 7f5f20fff700 1 --2- 172.21.15.8:0/373606118 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5f1c1014a0 0x7f5f1c199560 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.138+0000 7f5f20fff700 1 --2- 172.21.15.8:0/373606118 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5f1c102690 0x7f5f1c199aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.138+0000 7f5f20fff700 1 -- 172.21.15.8:0/373606118 >> 172.21.15.8:0/373606118 conn(0x7f5f1c0fca10 msgr2=0x7f5f1c073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:50.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.138+0000 7f5f20fff700 1 -- 172.21.15.8:0/373606118 shutdown_connections 2023-12-17T12:03:50.141 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.138+0000 7f5f20fff700 1 -- 172.21.15.8:0/373606118 wait complete. 2023-12-17T12:03:50.141 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 27 2023-12-17T12:03:50.165 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 27, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-12-17T12:02:50.176951+0000', 'modified': '2023-12-17T12:02:58.040005+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24569, 'mds_1': 24541, 'mds_2': 24503, 'mds_3': 24470, 'mds_4': 24451}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14640': {'gid': 14640, 'name': 'f', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.186:6835/2765387309', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6834', 'nonce': 2765387309}, {'type': 'v1', 'addr': '172.21.15.186:6835', 'nonce': 2765387309}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_14679': {'gid': 14679, 'name': 'g', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.8:6839/487046247', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6838', 'nonce': 487046247}, {'type': 'v1', 'addr': '172.21.15.8:6839', 'nonce': 487046247}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_14691': {'gid': 14691, 'name': 'a', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.8:6841/338406768', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.8:6840', 'nonce': 338406768}, {'type': 'v1', 'addr': '172.21.15.8:6841', 'nonce': 338406768}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24451': {'gid': 24451, 'name': 'l', 'rank': 4, 'incarnation': 25, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.186:6833/582753561', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6832', 'nonce': 582753561}, {'type': 'v1', 'addr': '172.21.15.186:6833', 'nonce': 582753561}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24470': {'gid': 24470, 'name': 'k', 'rank': 3, 'incarnation': 23, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.100:6833/305815776', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6832', 'nonce': 305815776}, {'type': 'v1', 'addr': '172.21.15.100:6833', 'nonce': 305815776}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24503': {'gid': 24503, 'name': 'e', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.100:6835/2140351853', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6834', 'nonce': 2140351853}, {'type': 'v1', 'addr': '172.21.15.100:6835', 'nonce': 2140351853}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24520': {'gid': 24520, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.186:6837/822451724', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6836', 'nonce': 822451724}, {'type': 'v1', 'addr': '172.21.15.186:6837', 'nonce': 822451724}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24530': {'gid': 24530, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.100:6837/4176831844', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6836', 'nonce': 4176831844}, {'type': 'v1', 'addr': '172.21.15.100:6837', 'nonce': 4176831844}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24541': {'gid': 24541, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.186:6839/91602342', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.186:6838', 'nonce': 91602342}, {'type': 'v1', 'addr': '172.21.15.186:6839', 'nonce': 91602342}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}, 'gid_24569': {'gid': 24569, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.100:6839/3921737538', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.100:6838', 'nonce': 3921737538}, {'type': 'v1', 'addr': '172.21.15.100:6839', 'nonce': 3921737538}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-17T12:03:50.165 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2023-12-17T12:03:50.165 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.l status 2023-12-17T12:03:50.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.373+0000 7fbcc89ff700 1 -- 172.21.15.8:0/3815236239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcc4075610 msgr2=0x7fbcc4073a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:50.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.373+0000 7fbcc89ff700 1 --2- 172.21.15.8:0/3815236239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcc4075610 0x7fbcc4073a60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbcb40098f0 tx=0x7fbcb4009c00 comp rx=0 tx=0).stop 2023-12-17T12:03:50.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.373+0000 7fbcc89ff700 1 -- 172.21.15.8:0/3815236239 shutdown_connections 2023-12-17T12:03:50.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.373+0000 7fbcc89ff700 1 --2- 172.21.15.8:0/3815236239 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbcc410db70 0x7fbcc410ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.373+0000 7fbcc89ff700 1 --2- 172.21.15.8:0/3815236239 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcc4075610 0x7fbcc4073a60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.376 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.373+0000 7fbcc89ff700 1 --2- 172.21.15.8:0/3815236239 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcc4074030 0x7fbcc40744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.373+0000 7fbcc89ff700 1 -- 172.21.15.8:0/3815236239 >> 172.21.15.8:0/3815236239 conn(0x7fbcc40fcb10 msgr2=0x7fbcc40fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:50.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.373+0000 7fbcc89ff700 1 -- 172.21.15.8:0/3815236239 shutdown_connections 2023-12-17T12:03:50.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.373+0000 7fbcc89ff700 1 -- 172.21.15.8:0/3815236239 wait complete. 2023-12-17T12:03:50.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.374+0000 7fbcc89ff700 1 Processor -- start 2023-12-17T12:03:50.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.375+0000 7fbcc89ff700 1 -- start start 2023-12-17T12:03:50.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.375+0000 7fbcc89ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcc4074030 0x7fbcc419dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.375+0000 7fbcc89ff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbcc4075610 0x7fbcc419dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.375+0000 7fbcc89ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcc410db70 0x7fbcc41a5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.375+0000 7fbcc89ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc41a55e0 con 0x7fbcc4074030 2023-12-17T12:03:50.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.375+0000 7fbcc89ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc41a5720 con 0x7fbcc410db70 2023-12-17T12:03:50.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.375+0000 7fbcc89ff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc41a58b0 con 0x7fbcc4075610 2023-12-17T12:03:50.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.375+0000 7fbcc259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcc4074030 0x7fbcc419dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.375+0000 7fbcc259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcc4074030 0x7fbcc419dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57490/0 (socket says 172.21.15.8:57490) 2023-12-17T12:03:50.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.375+0000 7fbcc259c700 1 -- 172.21.15.8:0/757945403 learned_addr learned my addr 172.21.15.8:0/757945403 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:50.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.375+0000 7fbcc1d9b700 1 --2- 172.21.15.8:0/757945403 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbcc4075610 0x7fbcc419dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.375+0000 7fbcc2d9d700 1 --2- 172.21.15.8:0/757945403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcc410db70 0x7fbcc41a5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.375+0000 7fbcc259c700 1 -- 172.21.15.8:0/757945403 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbcc4075610 msgr2=0x7fbcc419dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:50.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.375+0000 7fbcc259c700 1 --2- 172.21.15.8:0/757945403 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbcc4075610 0x7fbcc419dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.376+0000 7fbcc259c700 1 -- 172.21.15.8:0/757945403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcc410db70 msgr2=0x7fbcc41a5010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:50.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.376+0000 7fbcc259c700 1 --2- 172.21.15.8:0/757945403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcc410db70 0x7fbcc41a5010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.376+0000 7fbcc259c700 1 -- 172.21.15.8:0/757945403 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb80095f0 con 0x7fbcc4074030 2023-12-17T12:03:50.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.376+0000 7fbcc259c700 1 --2- 172.21.15.8:0/757945403 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcc4074030 0x7fbcc419dab0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4009810 tx=0x7fbcb400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:50.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.376+0000 7fbcb37fe700 1 -- 172.21.15.8:0/757945403 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb401c070 con 0x7fbcc4074030 2023-12-17T12:03:50.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.376+0000 7fbcc89ff700 1 -- 172.21.15.8:0/757945403 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcb4009520 con 0x7fbcc4074030 2023-12-17T12:03:50.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.376+0000 7fbcb37fe700 1 -- 172.21.15.8:0/757945403 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbcb400f7d0 con 0x7fbcc4074030 2023-12-17T12:03:50.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.376+0000 7fbcb37fe700 1 -- 172.21.15.8:0/757945403 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb4003970 con 0x7fbcc4074030 2023-12-17T12:03:50.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.376+0000 7fbcc89ff700 1 -- 172.21.15.8:0/757945403 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcc41a5e20 con 0x7fbcc4074030 2023-12-17T12:03:50.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.380+0000 7fbcb37fe700 1 -- 172.21.15.8:0/757945403 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7fbcb4020030 con 0x7fbcc4074030 2023-12-17T12:03:50.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.380+0000 7fbcdc260b80 1 Processor -- start 2023-12-17T12:03:50.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.381+0000 7fbcdc260b80 1 -- start start 2023-12-17T12:03:50.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.381+0000 7fbcdc260b80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fd610bb00 0x564fd610bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.381+0000 7fbcb37fe700 1 --2- 172.21.15.8:0/757945403 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fbcac0a1510 0x7fbcac0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.381+0000 7fbcdc260b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564fd610c460 0x564fd610cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.381+0000 7fbcdc260b80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564fd610d350 0x564fd610d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.381+0000 7fbcdc260b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fd6083420 con 0x564fd610c460 2023-12-17T12:03:50.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.381+0000 7fbcdc260b80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fd6065c00 con 0x564fd610bb00 2023-12-17T12:03:50.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.381+0000 7fbcdc260b80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fd6063520 con 0x564fd610d350 2023-12-17T12:03:50.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.381+0000 7fbcb37fe700 1 -- 172.21.15.8:0/757945403 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fbcb40cddd0 con 0x7fbcc4074030 2023-12-17T12:03:50.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.381+0000 7fbcc1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564fd610c460 0x564fd610cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.381+0000 7fbcc259c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fd610bb00 0x564fd610bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.381+0000 7fbcc1d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564fd610c460 0x564fd610cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57500/0 (socket says 172.21.15.8:57500) 2023-12-17T12:03:50.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.381+0000 7fbcc1d9b700 1 -- 172.21.15.8:0/1737526394 learned_addr learned my addr 172.21.15.8:0/1737526394 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:50.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.382+0000 7fbcc2d9d700 1 --2- 172.21.15.8:0/1737526394 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564fd610d350 0x564fd610d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.382+0000 7fbcc2d9d700 1 --2- 172.21.15.8:0/757945403 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fbcac0a1510 0x7fbcac0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.382+0000 7fbcc259c700 1 -- 172.21.15.8:0/1737526394 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564fd610d350 msgr2=0x564fd610d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T12:03:50.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.382+0000 7fbcc259c700 1 --2- 172.21.15.8:0/1737526394 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564fd610d350 0x564fd610d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.382+0000 7fbcc259c700 1 -- 172.21.15.8:0/1737526394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564fd610c460 msgr2=0x564fd610cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T12:03:50.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.382+0000 7fbcc259c700 1 --2- 172.21.15.8:0/1737526394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564fd610c460 0x564fd610cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.382+0000 7fbcc259c700 1 -- 172.21.15.8:0/1737526394 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564fd60c0b50 con 0x564fd610bb00 2023-12-17T12:03:50.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.382+0000 7fbcc1d9b700 1 --2- 172.21.15.8:0/1737526394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564fd610c460 0x564fd610cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T12:03:50.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.382+0000 7fbcc259c700 1 --2- 172.21.15.8:0/1737526394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fd610bb00 0x564fd610bf20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbcb40cb760 tx=0x7fbcb409aed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10c8595adfa3b82c server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:50.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.382+0000 7fbcb0ff9700 1 -- 172.21.15.8:0/1737526394 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb4021380 con 0x564fd610bb00 2023-12-17T12:03:50.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.382+0000 7fbcc2d9d700 1 --2- 172.21.15.8:0/757945403 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fbcac0a1510 0x7fbcac0a39d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x564fd610cb30 tx=0x7fbcbc00b040 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:50.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.382+0000 7fbcb0ff9700 1 -- 172.21.15.8:0/1737526394 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbcb409fe90 con 0x564fd610bb00 2023-12-17T12:03:50.386 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.382+0000 7fbcb0ff9700 1 -- 172.21.15.8:0/1737526394 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb4096df0 con 0x564fd610bb00 2023-12-17T12:03:50.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.383+0000 7fbcdc260b80 1 -- 172.21.15.8:0/1737526394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fd610bb00 msgr2=0x564fd610bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:50.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.383+0000 7fbcdc260b80 1 --2- 172.21.15.8:0/1737526394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fd610bb00 0x564fd610bf20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fbcb40cb760 tx=0x7fbcb409aed0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.383+0000 7fbcdc260b80 1 -- 172.21.15.8:0/1737526394 shutdown_connections 2023-12-17T12:03:50.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.383+0000 7fbcdc260b80 1 --2- 172.21.15.8:0/1737526394 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564fd610d350 0x564fd610d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.383+0000 7fbcdc260b80 1 --2- 172.21.15.8:0/1737526394 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fd610bb00 0x564fd610bf20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.383+0000 7fbcdc260b80 1 --2- 172.21.15.8:0/1737526394 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564fd610c460 0x564fd610cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.383+0000 7fbcdc260b80 1 -- 172.21.15.8:0/1737526394 >> 172.21.15.8:0/1737526394 conn(0x564fd6106670 msgr2=0x564fd6106a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:50.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.383+0000 7fbcdc260b80 1 -- 172.21.15.8:0/1737526394 shutdown_connections 2023-12-17T12:03:50.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.383+0000 7fbcdc260b80 1 -- 172.21.15.8:0/1737526394 wait complete. 2023-12-17T12:03:50.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.384+0000 7fbcdc260b80 1 -- start start 2023-12-17T12:03:50.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.384+0000 7fbcdc260b80 1 Processor -- start 2023-12-17T12:03:50.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.384+0000 7fbcdc260b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564fd610bb00 0x564fd61155d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.384+0000 7fbcdc260b80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fd610c460 0x564fd6115b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.384+0000 7fbcdc260b80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564fd610d350 0x564fd611cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.385+0000 7fbcdc260b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fd605ee10 con 0x564fd610bb00 2023-12-17T12:03:50.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.385+0000 7fbcdc260b80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fd5ffe000 con 0x564fd610c460 2023-12-17T12:03:50.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.385+0000 7fbcdc260b80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fd5ffdca0 con 0x564fd610d350 2023-12-17T12:03:50.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.385+0000 7fbcdc260b80 10 client.0 _ll_register_callbacks cb 0x564fd60063a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-17T12:03:50.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.385+0000 7fbcc259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564fd610bb00 0x564fd61155d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.385+0000 7fbcc1d9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fd610c460 0x564fd6115b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.385+0000 7fbcc259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564fd610bb00 0x564fd61155d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57514/0 (socket says 172.21.15.8:57514) 2023-12-17T12:03:50.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.385+0000 7fbcc259c700 1 -- 172.21.15.8:0/2587054294 learned_addr learned my addr 172.21.15.8:0/2587054294 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:50.391 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.385+0000 7fbcc2d9d700 1 --2- 172.21.15.8:0/2587054294 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564fd610d350 0x564fd611cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.385+0000 7fbcc1d9b700 1 -- 172.21.15.8:0/2587054294 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564fd610d350 msgr2=0x564fd611cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T12:03:50.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.385+0000 7fbcc1d9b700 1 --2- 172.21.15.8:0/2587054294 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564fd610d350 0x564fd611cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.385+0000 7fbcc1d9b700 1 -- 172.21.15.8:0/2587054294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564fd610bb00 msgr2=0x564fd61155d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T12:03:50.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.385+0000 7fbcc1d9b700 1 --2- 172.21.15.8:0/2587054294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564fd610bb00 0x564fd61155d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.385+0000 7fbcc1d9b700 1 -- 172.21.15.8:0/2587054294 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcb8009bd0 con 0x564fd610c460 2023-12-17T12:03:50.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.386+0000 7fbcc1d9b700 1 --2- 172.21.15.8:0/2587054294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fd610c460 0x564fd6115b10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8005fd0 tx=0x7fbcb8009d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8abb4fa473e88ce6 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:50.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.386+0000 7fbca9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2023-12-17T12:03:50.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.386+0000 7fbca9ffb700 1 -- 172.21.15.8:0/2587054294 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb8017070 con 0x564fd610c460 2023-12-17T12:03:50.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.386+0000 7fbcdc260b80 1 -- 172.21.15.8:0/2587054294 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564fd60fe470 con 0x564fd610c460 2023-12-17T12:03:50.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.386+0000 7fbca9ffb700 1 -- 172.21.15.8:0/2587054294 <== mon.2 v2:172.21.15.100:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fbcb8004030 con 0x564fd610c460 2023-12-17T12:03:50.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.386+0000 7fbca9ffb700 1 -- 172.21.15.8:0/2587054294 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbcb80041f0 con 0x564fd610c460 2023-12-17T12:03:50.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.386+0000 7fbcdc260b80 10 client.24908 fetch_fsmap learned FSMap version 27 2023-12-17T12:03:50.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.386+0000 7fbcdc260b80 1 -- 172.21.15.8:0/2587054294 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fbcc41a5e20 con 0x564fd610c460 2023-12-17T12:03:50.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.387+0000 7fbca9ffb700 1 -- 172.21.15.8:0/2587054294 <== mon.2 v2:172.21.15.100:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564fd60fe470 con 0x564fd610c460 2023-12-17T12:03:50.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.387+0000 7fbca9ffb700 1 -- 172.21.15.8:0/2587054294 <== mon.2 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbcb8025050 con 0x564fd610c460 2023-12-17T12:03:50.392 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.387+0000 7fbcdc260b80 10 client.24908 fetch_fsmap finished waiting for FSMap version 27 2023-12-17T12:03:50.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.387+0000 7fbcdc260b80 10 client.24908 resolve_mds: resolved name 'l' to daemon mds.l 2023-12-17T12:03:50.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.387+0000 7fbcdc260b80 20 client.24908 populate_metadata read hostname 'smithi008' 2023-12-17T12:03:50.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.387+0000 7fbcdc260b80 1 --2- 172.21.15.8:0/2587054294 >> [v2:172.21.15.186:6832/582753561,v1:172.21.15.186:6833/582753561] conn(0x564fd6121260 0x564fd611fd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.387+0000 7fbcdc260b80 4 client.24908 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-17T12:03:50.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.387+0000 7fbcdc260b80 1 -- 172.21.15.8:0/2587054294 --> [v2:172.21.15.186:6832/582753561,v1:172.21.15.186:6833/582753561] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564fd6057ca0 con 0x564fd6121260 2023-12-17T12:03:50.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.387+0000 7fbcc259c700 1 --2- 172.21.15.8:0/2587054294 >> [v2:172.21.15.186:6832/582753561,v1:172.21.15.186:6833/582753561] conn(0x564fd6121260 0x564fd611fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.388+0000 7fbcc259c700 1 --2- 172.21.15.8:0/2587054294 >> [v2:172.21.15.186:6832/582753561,v1:172.21.15.186:6833/582753561] conn(0x564fd6121260 0x564fd611fd50 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d66f741504a1b984 server_cookie=329a9148b907114f in_seq=0 out_seq=0 2023-12-17T12:03:50.393 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.388+0000 7fbca9ffb700 10 client.24908 ms_handle_connect on v2:172.21.15.186:6832/582753561 2023-12-17T12:03:50.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.389+0000 7fbca9ffb700 1 -- 172.21.15.8:0/2587054294 <== mds.4 v2:172.21.15.186:6832/582753561 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x564fd6057ca0 con 0x564fd6121260 2023-12-17T12:03:50.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.389+0000 7fbca9ffb700 10 client.24908 handle_command_reply: tid=0 2023-12-17T12:03:50.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.389+0000 7fbcdc260b80 1 client.24908 shutdown 2023-12-17T12:03:50.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.389+0000 7fbcdc260b80 1 -- 172.21.15.8:0/2587054294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fd610c460 msgr2=0x564fd6115b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:50.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.389+0000 7fbcdc260b80 1 --2- 172.21.15.8:0/2587054294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fd610c460 0x564fd6115b10 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8005fd0 tx=0x7fbcb8009d80 comp rx=0 tx=0).stop 2023-12-17T12:03:50.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.389+0000 7fbcdc260b80 1 -- 172.21.15.8:0/2587054294 shutdown_connections 2023-12-17T12:03:50.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.389+0000 7fbcdc260b80 1 --2- 172.21.15.8:0/2587054294 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564fd610d350 0x564fd611cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.389+0000 7fbcdc260b80 1 --2- 172.21.15.8:0/2587054294 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564fd610bb00 0x564fd61155d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.389+0000 7fbcdc260b80 1 --2- 172.21.15.8:0/2587054294 >> [v2:172.21.15.186:6832/582753561,v1:172.21.15.186:6833/582753561] conn(0x564fd6121260 0x564fd611fd50 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.394 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.389+0000 7fbcdc260b80 1 --2- 172.21.15.8:0/2587054294 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fd610c460 0x564fd6115b10 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.389+0000 7fbca9ffb700 0 client.24908 ms_handle_reset on v2:172.21.15.186:6832/582753561 2023-12-17T12:03:50.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.389+0000 7fbcdc260b80 1 -- 172.21.15.8:0/2587054294 >> 172.21.15.8:0/2587054294 conn(0x564fd6106670 msgr2=0x564fd6105b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:50.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.389+0000 7fbcdc260b80 1 -- 172.21.15.8:0/2587054294 shutdown_connections 2023-12-17T12:03:50.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.389+0000 7fbcdc260b80 1 -- 172.21.15.8:0/2587054294 wait complete. 2023-12-17T12:03:50.395 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.389+0000 7fbcdc260b80 20 client.24908 trim_cache size 0 max 16384 2023-12-17T12:03:50.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.408+0000 7fbcdc260b80 1 Processor -- start 2023-12-17T12:03:50.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.408+0000 7fbcdc260b80 1 -- start start 2023-12-17T12:03:50.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.408+0000 7fbcdc260b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564fd610bb00 0x564fd6106a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.408+0000 7fbcdc260b80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564fd610c460 0x564fd611cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.408+0000 7fbcdc260b80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fd610d350 0x564fd610f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.408+0000 7fbcdc260b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fd5edd650 con 0x564fd610bb00 2023-12-17T12:03:50.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.408+0000 7fbcdc260b80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fd60039e0 con 0x564fd610d350 2023-12-17T12:03:50.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.408+0000 7fbcdc260b80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fd610d1d0 con 0x564fd610c460 2023-12-17T12:03:50.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.409+0000 7fbcc1d9b700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564fd610c460 0x564fd611cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.409+0000 7fbcc259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564fd610bb00 0x564fd6106a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.409+0000 7fbcc2d9d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fd610d350 0x564fd610f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.409+0000 7fbcc1d9b700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564fd610c460 0x564fd611cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:54002/0 (socket says 172.21.15.8:54002) 2023-12-17T12:03:50.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.409+0000 7fbcc1d9b700 1 -- 172.21.15.8:0/2714911240 learned_addr learned my addr 172.21.15.8:0/2714911240 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:50.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.409+0000 7fbcc1d9b700 1 -- 172.21.15.8:0/2714911240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fd610d350 msgr2=0x564fd610f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T12:03:50.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.409+0000 7fbcc1d9b700 1 --2- 172.21.15.8:0/2714911240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fd610d350 0x564fd610f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.409+0000 7fbcc1d9b700 1 -- 172.21.15.8:0/2714911240 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564fd610bb00 msgr2=0x564fd6106a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T12:03:50.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.409+0000 7fbcc1d9b700 1 --2- 172.21.15.8:0/2714911240 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564fd610bb00 0x564fd6106a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.409+0000 7fbcc1d9b700 1 -- 172.21.15.8:0/2714911240 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564fd5e87b10 con 0x564fd610c460 2023-12-17T12:03:50.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.409+0000 7fbcc259c700 1 --2- 172.21.15.8:0/2714911240 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564fd610bb00 0x564fd6106a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T12:03:50.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.409+0000 7fbcc1d9b700 1 --2- 172.21.15.8:0/2714911240 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564fd610c460 0x564fd611cb10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbcb80036a0 tx=0x7fbcb800f6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7bb29470239ced server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:50.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.410+0000 7fbcb17fa700 1 -- 172.21.15.8:0/2714911240 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb802b020 con 0x564fd610c460 2023-12-17T12:03:50.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.410+0000 7fbcb17fa700 1 -- 172.21.15.8:0/2714911240 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbcb800fc90 con 0x564fd610c460 2023-12-17T12:03:50.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.410+0000 7fbcb17fa700 1 -- 172.21.15.8:0/2714911240 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb8017040 con 0x564fd610c460 2023-12-17T12:03:50.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.411+0000 7fbcdc260b80 1 -- 172.21.15.8:0/2714911240 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564fd610c460 msgr2=0x564fd611cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:50.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.411+0000 7fbcdc260b80 1 --2- 172.21.15.8:0/2714911240 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564fd610c460 0x564fd611cb10 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbcb80036a0 tx=0x7fbcb800f6a0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.411+0000 7fbcdc260b80 1 -- 172.21.15.8:0/2714911240 shutdown_connections 2023-12-17T12:03:50.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.411+0000 7fbcdc260b80 1 --2- 172.21.15.8:0/2714911240 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fd610d350 0x564fd610f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.411+0000 7fbcdc260b80 1 --2- 172.21.15.8:0/2714911240 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564fd610bb00 0x564fd6106a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.411+0000 7fbcdc260b80 1 --2- 172.21.15.8:0/2714911240 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564fd610c460 0x564fd611cb10 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.411+0000 7fbcdc260b80 1 -- 172.21.15.8:0/2714911240 >> 172.21.15.8:0/2714911240 conn(0x564fd6106670 msgr2=0x564fd6113980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:50.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.411+0000 7fbcdc260b80 1 -- 172.21.15.8:0/2714911240 shutdown_connections 2023-12-17T12:03:50.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.411+0000 7fbcdc260b80 1 -- 172.21.15.8:0/2714911240 wait complete. 2023-12-17T12:03:50.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.412+0000 7fbcdc260b80 1 -- start start 2023-12-17T12:03:50.415 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.412+0000 7fbcdc260b80 1 Processor -- start 2023-12-17T12:03:50.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:50 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/1187813210' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:03:50.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:50 smithi100 ceph-mon[41266]: pgmap v296: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-12-17T12:03:50.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:50 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/3372892912' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:03:50.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.412+0000 7fbcdc260b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564fd610bb00 0x564fd6119aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.412+0000 7fbcdc260b80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fd610c460 0x564fd611bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.412+0000 7fbcdc260b80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564fd610d350 0x564fd611c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.412+0000 7fbcdc260b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fd611cb50 con 0x564fd610bb00 2023-12-17T12:03:50.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.412+0000 7fbcdc260b80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fd611ccc0 con 0x564fd610c460 2023-12-17T12:03:50.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.412+0000 7fbcdc260b80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x564fd611ce80 con 0x564fd610d350 2023-12-17T12:03:50.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.412+0000 7fbcdc260b80 10 client.0 _ll_register_callbacks cb 0x564fd60063a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-17T12:03:50.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.413+0000 7fbcc259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564fd610bb00 0x564fd6119aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.413+0000 7fbcc2d9d700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564fd610d350 0x564fd611c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.413+0000 7fbcc259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564fd610bb00 0x564fd6119aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57524/0 (socket says 172.21.15.8:57524) 2023-12-17T12:03:50.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.413+0000 7fbcc259c700 1 -- 172.21.15.8:0/3645321817 learned_addr learned my addr 172.21.15.8:0/3645321817 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:50.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.413+0000 7fbcc2d9d700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564fd610d350 0x564fd611c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:54014/0 (socket says 172.21.15.8:54014) 2023-12-17T12:03:50.419 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.413+0000 7fbcc1d9b700 1 --2- 172.21.15.8:0/3645321817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fd610c460 0x564fd611bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.413+0000 7fbcc259c700 1 -- 172.21.15.8:0/3645321817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564fd610d350 msgr2=0x564fd611c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T12:03:50.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.413+0000 7fbcc259c700 1 --2- 172.21.15.8:0/3645321817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564fd610d350 0x564fd611c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.413+0000 7fbcc259c700 1 -- 172.21.15.8:0/3645321817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fd610c460 msgr2=0x564fd611bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T12:03:50.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.413+0000 7fbcc259c700 1 --2- 172.21.15.8:0/3645321817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fd610c460 0x564fd611bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.413+0000 7fbcc259c700 1 -- 172.21.15.8:0/3645321817 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564fd60c0b50 con 0x564fd610bb00 2023-12-17T12:03:50.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.413+0000 7fbcc259c700 1 --2- 172.21.15.8:0/3645321817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564fd610bb00 0x564fd6119aa0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4097a70 tx=0x7fbcb4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d471919987a93f server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:50.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.413+0000 7fbca9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-12-17T12:03:50.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.413+0000 7fbca9ffb700 1 -- 172.21.15.8:0/3645321817 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb409b700 con 0x564fd610bb00 2023-12-17T12:03:50.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.413+0000 7fbca9ffb700 1 -- 172.21.15.8:0/3645321817 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fbcb4096df0 con 0x564fd610bb00 2023-12-17T12:03:50.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.414+0000 7fbcdc260b80 1 -- 172.21.15.8:0/3645321817 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbcb409fe90 con 0x564fd610bb00 2023-12-17T12:03:50.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.414+0000 7fbca9ffb700 1 -- 172.21.15.8:0/3645321817 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbcb409b000 con 0x564fd610bb00 2023-12-17T12:03:50.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.414+0000 7fbcdc260b80 10 client.15108 fetch_fsmap learned FSMap version 27 2023-12-17T12:03:50.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.414+0000 7fbcdc260b80 1 -- 172.21.15.8:0/3645321817 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fbcc41a5e20 con 0x564fd610bb00 2023-12-17T12:03:50.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.414+0000 7fbca9ffb700 1 -- 172.21.15.8:0/3645321817 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbcb409fe90 con 0x564fd610bb00 2023-12-17T12:03:50.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.414+0000 7fbca9ffb700 1 -- 172.21.15.8:0/3645321817 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fbcb4097710 con 0x564fd610bb00 2023-12-17T12:03:50.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.414+0000 7fbcdc260b80 10 client.15108 fetch_fsmap finished waiting for FSMap version 27 2023-12-17T12:03:50.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.414+0000 7fbcdc260b80 10 client.15108 resolve_mds: resolved name 'l' to daemon mds.l 2023-12-17T12:03:50.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.414+0000 7fbcdc260b80 20 client.15108 populate_metadata read hostname 'smithi008' 2023-12-17T12:03:50.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.414+0000 7fbcdc260b80 1 --2- 172.21.15.8:0/3645321817 >> [v2:172.21.15.186:6832/582753561,v1:172.21.15.186:6833/582753561] conn(0x564fd617c090 0x564fd61784d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.414+0000 7fbcdc260b80 4 client.15108 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-17T12:03:50.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.414+0000 7fbcdc260b80 1 -- 172.21.15.8:0/3645321817 --> [v2:172.21.15.186:6832/582753561,v1:172.21.15.186:6833/582753561] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564fd60579c0 con 0x564fd617c090 2023-12-17T12:03:50.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.415+0000 7fbcc1d9b700 1 --2- 172.21.15.8:0/3645321817 >> [v2:172.21.15.186:6832/582753561,v1:172.21.15.186:6833/582753561] conn(0x564fd617c090 0x564fd61784d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.415+0000 7fbcc1d9b700 1 --2- 172.21.15.8:0/3645321817 >> [v2:172.21.15.186:6832/582753561,v1:172.21.15.186:6833/582753561] conn(0x564fd617c090 0x564fd61784d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=244c0eb369828145 server_cookie=c56a02be502eaa in_seq=0 out_seq=0 2023-12-17T12:03:50.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.415+0000 7fbca9ffb700 10 client.15108 ms_handle_connect on v2:172.21.15.186:6832/582753561 2023-12-17T12:03:50.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.416+0000 7fbca9ffb700 1 -- 172.21.15.8:0/3645321817 <== mds.4 v2:172.21.15.186:6832/582753561 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x564fd60579c0 con 0x564fd617c090 2023-12-17T12:03:50.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.416+0000 7fbca9ffb700 10 client.15108 handle_command_reply: tid=0 2023-12-17T12:03:50.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.416+0000 7fbcdc260b80 1 client.15108 shutdown 2023-12-17T12:03:50.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.416+0000 7fbcdc260b80 1 -- 172.21.15.8:0/3645321817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564fd610bb00 msgr2=0x564fd6119aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:50.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.416+0000 7fbcdc260b80 1 --2- 172.21.15.8:0/3645321817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564fd610bb00 0x564fd6119aa0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4097a70 tx=0x7fbcb4009260 comp rx=0 tx=0).stop 2023-12-17T12:03:50.421 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.416+0000 7fbcdc260b80 1 -- 172.21.15.8:0/3645321817 shutdown_connections 2023-12-17T12:03:50.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.416+0000 7fbcdc260b80 1 --2- 172.21.15.8:0/3645321817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x564fd610d350 0x564fd611c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.416+0000 7fbcdc260b80 1 --2- 172.21.15.8:0/3645321817 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x564fd610bb00 0x564fd6119aa0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.416+0000 7fbcdc260b80 1 --2- 172.21.15.8:0/3645321817 >> [v2:172.21.15.186:6832/582753561,v1:172.21.15.186:6833/582753561] conn(0x564fd617c090 0x564fd61784d0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.416+0000 7fbcdc260b80 1 --2- 172.21.15.8:0/3645321817 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x564fd610c460 0x564fd611bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.416+0000 7fbcdc260b80 1 -- 172.21.15.8:0/3645321817 >> 172.21.15.8:0/3645321817 conn(0x564fd6106670 msgr2=0x564fd6113940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:50.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.416+0000 7fbca9ffb700 0 client.15108 ms_handle_reset on v2:172.21.15.186:6832/582753561 2023-12-17T12:03:50.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.416+0000 7fbcdc260b80 1 -- 172.21.15.8:0/3645321817 shutdown_connections 2023-12-17T12:03:50.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.416+0000 7fbcdc260b80 1 -- 172.21.15.8:0/3645321817 wait complete. 2023-12-17T12:03:50.422 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.416+0000 7fbcdc260b80 20 client.15108 trim_cache size 0 max 16384 2023-12-17T12:03:50.422 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-12-17T12:03:50.422 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "f43f508a-9cd2-11ee-95a5-87774f69a715", 2023-12-17T12:03:50.422 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 4, 2023-12-17T12:03:50.423 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 24451, 2023-12-17T12:03:50.423 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-12-17T12:03:50.423 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-12-17T12:03:50.423 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-12-17T12:03:50.423 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 53.398937594000003, 2023-12-17T12:03:50.423 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 27, 2023-12-17T12:03:50.423 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 85, 2023-12-17T12:03:50.423 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 83, 2023-12-17T12:03:50.423 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 94.774902573000006 2023-12-17T12:03:50.423 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-12-17T12:03:50.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.417+0000 7fbcc89ff700 1 -- 172.21.15.8:0/757945403 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fbcac0a1510 msgr2=0x7fbcac0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:50.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.417+0000 7fbcc89ff700 1 --2- 172.21.15.8:0/757945403 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fbcac0a1510 0x7fbcac0a39d0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x564fd610cb30 tx=0x7fbcbc00b040 comp rx=0 tx=0).stop 2023-12-17T12:03:50.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.417+0000 7fbcc89ff700 1 -- 172.21.15.8:0/757945403 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcc4074030 msgr2=0x7fbcc419dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:50.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.417+0000 7fbcc89ff700 1 --2- 172.21.15.8:0/757945403 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcc4074030 0x7fbcc419dab0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbcb4009810 tx=0x7fbcb400b790 comp rx=0 tx=0).stop 2023-12-17T12:03:50.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.417+0000 7fbcc89ff700 1 -- 172.21.15.8:0/757945403 shutdown_connections 2023-12-17T12:03:50.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.417+0000 7fbcc89ff700 1 --2- 172.21.15.8:0/757945403 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fbcac0a1510 0x7fbcac0a39d0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.417+0000 7fbcc89ff700 1 --2- 172.21.15.8:0/757945403 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fbcc410db70 0x7fbcc41a5010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.417+0000 7fbcc89ff700 1 --2- 172.21.15.8:0/757945403 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fbcc4074030 0x7fbcc419dab0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.417+0000 7fbcc89ff700 1 --2- 172.21.15.8:0/757945403 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbcc4075610 0x7fbcc419dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.417+0000 7fbcc89ff700 1 -- 172.21.15.8:0/757945403 >> 172.21.15.8:0/757945403 conn(0x7fbcc40fcb10 msgr2=0x7fbcc4100f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:50.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.417+0000 7fbcc89ff700 1 -- 172.21.15.8:0/757945403 shutdown_connections 2023-12-17T12:03:50.424 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.417+0000 7fbcc89ff700 1 -- 172.21.15.8:0/757945403 wait complete. 2023-12-17T12:03:50.436 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:50 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/1187813210' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:03:50.436 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:50 smithi008 ceph-mon[36830]: pgmap v296: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-12-17T12:03:50.436 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:50 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/3372892912' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:03:50.439 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.k status 2023-12-17T12:03:50.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:50 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/1187813210' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:03:50.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:50 smithi186 ceph-mon[41182]: pgmap v296: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-12-17T12:03:50.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:50 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/3372892912' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:03:50.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.662+0000 7fed9f1ff700 1 -- 172.21.15.8:0/4046643021 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fed98075610 msgr2=0x7fed98073a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:50.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.662+0000 7fed9f1ff700 1 --2- 172.21.15.8:0/4046643021 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fed98075610 0x7fed98073a60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fed8c009990 tx=0x7fed8c009ca0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.662+0000 7fed9f1ff700 1 -- 172.21.15.8:0/4046643021 shutdown_connections 2023-12-17T12:03:50.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.662+0000 7fed9f1ff700 1 --2- 172.21.15.8:0/4046643021 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed9810db70 0x7fed9810ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.662+0000 7fed9f1ff700 1 --2- 172.21.15.8:0/4046643021 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fed98075610 0x7fed98073a60 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.662+0000 7fed9f1ff700 1 --2- 172.21.15.8:0/4046643021 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fed98074030 0x7fed980744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.662+0000 7fed9f1ff700 1 -- 172.21.15.8:0/4046643021 >> 172.21.15.8:0/4046643021 conn(0x7fed980fcb10 msgr2=0x7fed980fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:50.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.662+0000 7fed9f1ff700 1 -- 172.21.15.8:0/4046643021 shutdown_connections 2023-12-17T12:03:50.665 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.662+0000 7fed9f1ff700 1 -- 172.21.15.8:0/4046643021 wait complete. 2023-12-17T12:03:50.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.663+0000 7fed9f1ff700 1 Processor -- start 2023-12-17T12:03:50.666 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.664+0000 7fed9f1ff700 1 -- start start 2023-12-17T12:03:50.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.664+0000 7fed9f1ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed98074030 0x7fed9819da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.664+0000 7fed9f1ff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fed98075610 0x7fed9819dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.667 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.664+0000 7fed9f1ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fed9810db70 0x7fed981a4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.664+0000 7fed9f1ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed981a55a0 con 0x7fed9810db70 2023-12-17T12:03:50.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.664+0000 7fed9f1ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed981a56e0 con 0x7fed98074030 2023-12-17T12:03:50.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.664+0000 7fed9f1ff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed981a5870 con 0x7fed98075610 2023-12-17T12:03:50.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.664+0000 7fed9cf9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed98074030 0x7fed9819da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.664+0000 7fed97fff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fed98075610 0x7fed9819dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.665+0000 7fed97fff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fed98075610 0x7fed9819dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:54046/0 (socket says 172.21.15.8:54046) 2023-12-17T12:03:50.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.665+0000 7fed97fff700 1 -- 172.21.15.8:0/3583218898 learned_addr learned my addr 172.21.15.8:0/3583218898 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:50.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.665+0000 7fed9d79c700 1 --2- 172.21.15.8:0/3583218898 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fed9810db70 0x7fed981a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.665+0000 7fed97fff700 1 -- 172.21.15.8:0/3583218898 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed98074030 msgr2=0x7fed9819da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:50.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.665+0000 7fed97fff700 1 --2- 172.21.15.8:0/3583218898 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed98074030 0x7fed9819da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.665+0000 7fed97fff700 1 -- 172.21.15.8:0/3583218898 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fed9810db70 msgr2=0x7fed981a4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:50.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.665+0000 7fed97fff700 1 --2- 172.21.15.8:0/3583218898 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fed9810db70 0x7fed981a4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.665+0000 7fed97fff700 1 -- 172.21.15.8:0/3583218898 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed8c0095f0 con 0x7fed98075610 2023-12-17T12:03:50.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.665+0000 7fed9cf9b700 1 --2- 172.21.15.8:0/3583218898 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed98074030 0x7fed9819da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T12:03:50.668 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.665+0000 7fed97fff700 1 --2- 172.21.15.8:0/3583218898 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fed98075610 0x7fed9819dfb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fed8400e970 tx=0x7fed8400ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:50.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.666+0000 7fed95ffb700 1 -- 172.21.15.8:0/3583218898 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed84009790 con 0x7fed98075610 2023-12-17T12:03:50.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.666+0000 7fed95ffb700 1 -- 172.21.15.8:0/3583218898 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fed8400c7e0 con 0x7fed98075610 2023-12-17T12:03:50.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.666+0000 7fed9f1ff700 1 -- 172.21.15.8:0/3583218898 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed981a5b50 con 0x7fed98075610 2023-12-17T12:03:50.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.666+0000 7fed95ffb700 1 -- 172.21.15.8:0/3583218898 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed84003bd0 con 0x7fed98075610 2023-12-17T12:03:50.669 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.666+0000 7fed9f1ff700 1 -- 172.21.15.8:0/3583218898 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed981a60b0 con 0x7fed98075610 2023-12-17T12:03:50.673 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.671+0000 7fed95ffb700 1 -- 172.21.15.8:0/3583218898 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7fed84003d30 con 0x7fed98075610 2023-12-17T12:03:50.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.672+0000 7fedb2afab80 1 Processor -- start 2023-12-17T12:03:50.674 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.672+0000 7fedb2afab80 1 -- start start 2023-12-17T12:03:50.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.672+0000 7fedb2afab80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589e479ab00 0x5589e479af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.672+0000 7fedb2afab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5589e479b460 0x5589e479bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.673+0000 7fedb2afab80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5589e479c350 0x5589e479c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.673+0000 7fedb2afab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589e4712420 con 0x5589e479b460 2023-12-17T12:03:50.675 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.673+0000 7fedb2afab80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589e46f4c00 con 0x5589e479c350 2023-12-17T12:03:50.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.673+0000 7fedb2afab80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589e46f2520 con 0x5589e479ab00 2023-12-17T12:03:50.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.673+0000 7fed95ffb700 1 --2- 172.21.15.8:0/3583218898 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fed880a1590 0x7fed880a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.673+0000 7fed9cf9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5589e479b460 0x5589e479bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.673+0000 7fed9cf9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5589e479b460 0x5589e479bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57546/0 (socket says 172.21.15.8:57546) 2023-12-17T12:03:50.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.673+0000 7fed9cf9b700 1 -- 172.21.15.8:0/3147693456 learned_addr learned my addr 172.21.15.8:0/3147693456 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:50.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.673+0000 7fed97fff700 1 --2- 172.21.15.8:0/3147693456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5589e479c350 0x5589e479c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.676 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.673+0000 7fed9d79c700 1 --2- 172.21.15.8:0/3147693456 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589e479ab00 0x5589e479af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.673+0000 7fed95ffb700 1 -- 172.21.15.8:0/3583218898 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fed84014070 con 0x7fed98075610 2023-12-17T12:03:50.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.673+0000 7fed9d79c700 1 --2- 172.21.15.8:0/3583218898 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fed880a1590 0x7fed880a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.673+0000 7fed97fff700 1 -- 172.21.15.8:0/3147693456 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589e479ab00 msgr2=0x5589e479af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T12:03:50.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.673+0000 7fed97fff700 1 --2- 172.21.15.8:0/3147693456 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589e479ab00 0x5589e479af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.673+0000 7fed97fff700 1 -- 172.21.15.8:0/3147693456 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5589e479b460 msgr2=0x5589e479bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T12:03:50.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.673+0000 7fed97fff700 1 --2- 172.21.15.8:0/3147693456 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5589e479b460 0x5589e479bd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.674+0000 7fed97fff700 1 -- 172.21.15.8:0/3147693456 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589e474fb50 con 0x5589e479c350 2023-12-17T12:03:50.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.674+0000 7fed9cf9b700 1 --2- 172.21.15.8:0/3147693456 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5589e479b460 0x5589e479bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T12:03:50.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.674+0000 7fed9d79c700 1 --2- 172.21.15.8:0/3147693456 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589e479ab00 0x5589e479af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T12:03:50.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.674+0000 7fed97fff700 1 --2- 172.21.15.8:0/3147693456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5589e479c350 0x5589e479c7d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fed840caa00 tx=0x7fed8406d1d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=452949141e55a952 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:50.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.674+0000 7fed82ffd700 1 -- 172.21.15.8:0/3147693456 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8400cc50 con 0x5589e479c350 2023-12-17T12:03:50.677 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.674+0000 7fed82ffd700 1 -- 172.21.15.8:0/3147693456 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fed84066940 con 0x5589e479c350 2023-12-17T12:03:50.678 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.674+0000 7fed82ffd700 1 -- 172.21.15.8:0/3147693456 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed84096920 con 0x5589e479c350 2023-12-17T12:03:50.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.675+0000 7fedb2afab80 1 -- 172.21.15.8:0/3147693456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5589e479c350 msgr2=0x5589e479c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:50.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.675+0000 7fed9d79c700 1 --2- 172.21.15.8:0/3583218898 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fed880a1590 0x7fed880a3a50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fed900078c0 tx=0x7fed90009100 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:50.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.675+0000 7fedb2afab80 1 --2- 172.21.15.8:0/3147693456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5589e479c350 0x5589e479c7d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fed840caa00 tx=0x7fed8406d1d0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.675+0000 7fedb2afab80 1 -- 172.21.15.8:0/3147693456 shutdown_connections 2023-12-17T12:03:50.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.675+0000 7fedb2afab80 1 --2- 172.21.15.8:0/3147693456 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5589e479c350 0x5589e479c7d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.675+0000 7fedb2afab80 1 --2- 172.21.15.8:0/3147693456 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589e479ab00 0x5589e479af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.675+0000 7fedb2afab80 1 --2- 172.21.15.8:0/3147693456 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5589e479b460 0x5589e479bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.675+0000 7fedb2afab80 1 -- 172.21.15.8:0/3147693456 >> 172.21.15.8:0/3147693456 conn(0x5589e4795670 msgr2=0x5589e4795a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:50.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.675+0000 7fedb2afab80 1 -- 172.21.15.8:0/3147693456 shutdown_connections 2023-12-17T12:03:50.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.675+0000 7fedb2afab80 1 -- 172.21.15.8:0/3147693456 wait complete. 2023-12-17T12:03:50.680 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.676+0000 7fedb2afab80 1 -- start start 2023-12-17T12:03:50.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.676+0000 7fedb2afab80 1 Processor -- start 2023-12-17T12:03:50.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.676+0000 7fedb2afab80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589e479ab00 0x5589e47a4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.676+0000 7fedb2afab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5589e479b460 0x5589e47a4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.676+0000 7fedb2afab80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5589e479c350 0x5589e47abef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.677+0000 7fedb2afab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589e46ede10 con 0x5589e479b460 2023-12-17T12:03:50.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.677+0000 7fedb2afab80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589e468d000 con 0x5589e479c350 2023-12-17T12:03:50.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.677+0000 7fedb2afab80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589e468cca0 con 0x5589e479ab00 2023-12-17T12:03:50.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.677+0000 7fedb2afab80 10 client.0 _ll_register_callbacks cb 0x5589e46953a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-17T12:03:50.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.677+0000 7fed97fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5589e479b460 0x5589e47a4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.677+0000 7fed9d79c700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5589e479c350 0x5589e47abef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.677+0000 7fed97fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5589e479b460 0x5589e47a4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57550/0 (socket says 172.21.15.8:57550) 2023-12-17T12:03:50.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.677+0000 7fed97fff700 1 -- 172.21.15.8:0/675903536 learned_addr learned my addr 172.21.15.8:0/675903536 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:50.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.677+0000 7fed9cf9b700 1 --2- 172.21.15.8:0/675903536 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589e479ab00 0x5589e47a4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.677+0000 7fed9d79c700 1 -- 172.21.15.8:0/675903536 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589e479ab00 msgr2=0x5589e47a4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T12:03:50.681 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.677+0000 7fed9d79c700 1 --2- 172.21.15.8:0/675903536 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589e479ab00 0x5589e47a4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.677+0000 7fed9d79c700 1 -- 172.21.15.8:0/675903536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5589e479b460 msgr2=0x5589e47a4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T12:03:50.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.677+0000 7fed9d79c700 1 --2- 172.21.15.8:0/675903536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5589e479b460 0x5589e47a4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.677+0000 7fed9d79c700 1 -- 172.21.15.8:0/675903536 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed98110910 con 0x5589e479c350 2023-12-17T12:03:50.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.678+0000 7fed9d79c700 1 --2- 172.21.15.8:0/675903536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5589e479c350 0x5589e47abef0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fed90009a20 tx=0x7fed90004ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=771aa6bc91086a67 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:50.682 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.678+0000 7fed77fff700 10 client.0 ms_handle_connect on v2:172.21.15.100:3300/0 2023-12-17T12:03:50.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.678+0000 7fed77fff700 1 -- 172.21.15.8:0/675903536 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed90028070 con 0x5589e479c350 2023-12-17T12:03:50.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.678+0000 7fed77fff700 1 -- 172.21.15.8:0/675903536 <== mon.2 v2:172.21.15.100:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fed90004bb0 con 0x5589e479c350 2023-12-17T12:03:50.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.678+0000 7fedb2afab80 1 -- 172.21.15.8:0/675903536 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5589e478d470 con 0x5589e479c350 2023-12-17T12:03:50.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.679+0000 7fed77fff700 1 -- 172.21.15.8:0/675903536 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed90004d70 con 0x5589e479c350 2023-12-17T12:03:50.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.679+0000 7fedb2afab80 10 client.24926 fetch_fsmap learned FSMap version 27 2023-12-17T12:03:50.684 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.679+0000 7fedb2afab80 1 -- 172.21.15.8:0/675903536 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fed981a60b0 con 0x5589e479c350 2023-12-17T12:03:50.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.679+0000 7fed77fff700 1 -- 172.21.15.8:0/675903536 <== mon.2 v2:172.21.15.100:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5589e478d470 con 0x5589e479c350 2023-12-17T12:03:50.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.679+0000 7fed77fff700 1 -- 172.21.15.8:0/675903536 <== mon.2 v2:172.21.15.100:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fed9002b030 con 0x5589e479c350 2023-12-17T12:03:50.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.679+0000 7fedb2afab80 10 client.24926 fetch_fsmap finished waiting for FSMap version 27 2023-12-17T12:03:50.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.679+0000 7fedb2afab80 10 client.24926 resolve_mds: resolved name 'k' to daemon mds.k 2023-12-17T12:03:50.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.679+0000 7fedb2afab80 20 client.24926 populate_metadata read hostname 'smithi008' 2023-12-17T12:03:50.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.679+0000 7fedb2afab80 1 --2- 172.21.15.8:0/675903536 >> [v2:172.21.15.100:6832/305815776,v1:172.21.15.100:6833/305815776] conn(0x5589e47b0620 0x5589e47af0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.679+0000 7fedb2afab80 4 client.24926 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-17T12:03:50.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.679+0000 7fedb2afab80 1 -- 172.21.15.8:0/675903536 --> [v2:172.21.15.100:6832/305815776,v1:172.21.15.100:6833/305815776] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5589e46e6ca0 con 0x5589e47b0620 2023-12-17T12:03:50.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.680+0000 7fed9cf9b700 1 --2- 172.21.15.8:0/675903536 >> [v2:172.21.15.100:6832/305815776,v1:172.21.15.100:6833/305815776] conn(0x5589e47b0620 0x5589e47af0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.680+0000 7fed9cf9b700 1 --2- 172.21.15.8:0/675903536 >> [v2:172.21.15.100:6832/305815776,v1:172.21.15.100:6833/305815776] conn(0x5589e47b0620 0x5589e47af0f0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e3e2534bb00f7236 server_cookie=2d19964c214f0787 in_seq=0 out_seq=0 2023-12-17T12:03:50.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.680+0000 7fed77fff700 10 client.24926 ms_handle_connect on v2:172.21.15.100:6832/305815776 2023-12-17T12:03:50.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.681+0000 7fed77fff700 1 -- 172.21.15.8:0/675903536 <== mds.3 v2:172.21.15.100:6832/305815776 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5589e46e6ca0 con 0x5589e47b0620 2023-12-17T12:03:50.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.681+0000 7fed77fff700 10 client.24926 handle_command_reply: tid=0 2023-12-17T12:03:50.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.681+0000 7fedb2afab80 1 client.24926 shutdown 2023-12-17T12:03:50.685 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.681+0000 7fedb2afab80 1 -- 172.21.15.8:0/675903536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5589e479c350 msgr2=0x5589e47abef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:50.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.681+0000 7fedb2afab80 1 --2- 172.21.15.8:0/675903536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5589e479c350 0x5589e47abef0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fed90009a20 tx=0x7fed90004ad0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.681+0000 7fedb2afab80 1 -- 172.21.15.8:0/675903536 shutdown_connections 2023-12-17T12:03:50.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.681+0000 7fedb2afab80 1 --2- 172.21.15.8:0/675903536 >> [v2:172.21.15.100:6832/305815776,v1:172.21.15.100:6833/305815776] conn(0x5589e47b0620 0x5589e47af0f0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.681+0000 7fedb2afab80 1 --2- 172.21.15.8:0/675903536 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5589e479c350 0x5589e47abef0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.681+0000 7fedb2afab80 1 --2- 172.21.15.8:0/675903536 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589e479ab00 0x5589e47a4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.681+0000 7fedb2afab80 1 --2- 172.21.15.8:0/675903536 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5589e479b460 0x5589e47a4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.681+0000 7fedb2afab80 1 -- 172.21.15.8:0/675903536 >> 172.21.15.8:0/675903536 conn(0x5589e4795670 msgr2=0x5589e4794b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:50.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.681+0000 7fed77fff700 0 client.24926 ms_handle_reset on v2:172.21.15.100:6832/305815776 2023-12-17T12:03:50.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.681+0000 7fedb2afab80 1 -- 172.21.15.8:0/675903536 shutdown_connections 2023-12-17T12:03:50.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.681+0000 7fedb2afab80 1 -- 172.21.15.8:0/675903536 wait complete. 2023-12-17T12:03:50.686 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.682+0000 7fedb2afab80 20 client.24926 trim_cache size 0 max 16384 2023-12-17T12:03:50.705 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.703+0000 7fedb2afab80 1 Processor -- start 2023-12-17T12:03:50.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.703+0000 7fedb2afab80 1 -- start start 2023-12-17T12:03:50.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.703+0000 7fedb2afab80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5589e479ab00 0x5589e47a3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.703+0000 7fedb2afab80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589e479b460 0x5589e47a3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.703+0000 7fedb2afab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5589e479c350 0x5589e47abeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.703+0000 7fedb2afab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589e456c650 con 0x5589e479c350 2023-12-17T12:03:50.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.703+0000 7fedb2afab80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589e46929e0 con 0x5589e479ab00 2023-12-17T12:03:50.706 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.703+0000 7fedb2afab80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589e46e9f00 con 0x5589e479b460 2023-12-17T12:03:50.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.704+0000 7fed9d79c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5589e479c350 0x5589e47abeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.704+0000 7fed9cf9b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5589e479ab00 0x5589e47a3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.704+0000 7fed9d79c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5589e479c350 0x5589e47abeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57566/0 (socket says 172.21.15.8:57566) 2023-12-17T12:03:50.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.704+0000 7fed9d79c700 1 -- 172.21.15.8:0/2773677739 learned_addr learned my addr 172.21.15.8:0/2773677739 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:50.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.704+0000 7fed97fff700 1 --2- 172.21.15.8:0/2773677739 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589e479b460 0x5589e47a3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.704+0000 7fed9d79c700 1 -- 172.21.15.8:0/2773677739 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589e479b460 msgr2=0x5589e47a3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T12:03:50.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.704+0000 7fed9d79c700 1 --2- 172.21.15.8:0/2773677739 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589e479b460 0x5589e47a3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.708 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.704+0000 7fed9d79c700 1 -- 172.21.15.8:0/2773677739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5589e479ab00 msgr2=0x5589e47a3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T12:03:50.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.704+0000 7fed9d79c700 1 --2- 172.21.15.8:0/2773677739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5589e479ab00 0x5589e47a3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.704+0000 7fed9d79c700 1 -- 172.21.15.8:0/2773677739 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5589e4516b10 con 0x5589e479c350 2023-12-17T12:03:50.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.704+0000 7fed9d79c700 1 --2- 172.21.15.8:0/2773677739 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5589e479c350 0x5589e47abeb0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fed9001abc0 tx=0x7fed90009170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e55f207dfb239bd6 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:50.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.704+0000 7fed837fe700 1 -- 172.21.15.8:0/2773677739 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed90028070 con 0x5589e479c350 2023-12-17T12:03:50.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.705+0000 7fed837fe700 1 -- 172.21.15.8:0/2773677739 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fed90020040 con 0x5589e479c350 2023-12-17T12:03:50.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.705+0000 7fed837fe700 1 -- 172.21.15.8:0/2773677739 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed90003c00 con 0x5589e479c350 2023-12-17T12:03:50.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.705+0000 7fedb2afab80 1 -- 172.21.15.8:0/2773677739 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5589e479c350 msgr2=0x5589e47abeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:50.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.705+0000 7fedb2afab80 1 --2- 172.21.15.8:0/2773677739 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5589e479c350 0x5589e47abeb0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fed9001abc0 tx=0x7fed90009170 comp rx=0 tx=0).stop 2023-12-17T12:03:50.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.705+0000 7fedb2afab80 1 -- 172.21.15.8:0/2773677739 shutdown_connections 2023-12-17T12:03:50.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.705+0000 7fedb2afab80 1 --2- 172.21.15.8:0/2773677739 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5589e479c350 0x5589e47abeb0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.705+0000 7fedb2afab80 1 --2- 172.21.15.8:0/2773677739 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5589e479ab00 0x5589e47a3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.705+0000 7fedb2afab80 1 --2- 172.21.15.8:0/2773677739 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589e479b460 0x5589e47a3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.705+0000 7fedb2afab80 1 -- 172.21.15.8:0/2773677739 >> 172.21.15.8:0/2773677739 conn(0x5589e4795670 msgr2=0x5589e47a29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:50.709 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.705+0000 7fedb2afab80 1 -- 172.21.15.8:0/2773677739 shutdown_connections 2023-12-17T12:03:50.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.705+0000 7fedb2afab80 1 -- 172.21.15.8:0/2773677739 wait complete. 2023-12-17T12:03:50.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.706+0000 7fedb2afab80 1 -- start start 2023-12-17T12:03:50.710 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.706+0000 7fedb2afab80 1 Processor -- start 2023-12-17T12:03:50.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.706+0000 7fedb2afab80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589e479ab00 0x5589e479e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.706+0000 7fedb2afab80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5589e479b460 0x5589e47aaef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.706+0000 7fedb2afab80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5589e479c350 0x5589e47ab430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.706+0000 7fedb2afab80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589e47ab9f0 con 0x5589e479b460 2023-12-17T12:03:50.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.706+0000 7fedb2afab80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589e47abb60 con 0x5589e479c350 2023-12-17T12:03:50.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.706+0000 7fedb2afab80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5589e47abd20 con 0x5589e479ab00 2023-12-17T12:03:50.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.707+0000 7fedb2afab80 10 client.0 _ll_register_callbacks cb 0x5589e46953a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-17T12:03:50.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.707+0000 7fed97fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5589e479b460 0x5589e47aaef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.707+0000 7fed97fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5589e479b460 0x5589e47aaef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:57572/0 (socket says 172.21.15.8:57572) 2023-12-17T12:03:50.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.707+0000 7fed9cf9b700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589e479ab00 0x5589e479e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.713 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.707+0000 7fed97fff700 1 -- 172.21.15.8:0/2809351956 learned_addr learned my addr 172.21.15.8:0/2809351956 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:50.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.707+0000 7fed9d79c700 1 --2- 172.21.15.8:0/2809351956 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5589e479c350 0x5589e47ab430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.707+0000 7fed97fff700 1 -- 172.21.15.8:0/2809351956 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589e479ab00 msgr2=0x5589e479e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T12:03:50.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.707+0000 7fed97fff700 1 --2- 172.21.15.8:0/2809351956 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589e479ab00 0x5589e479e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.707+0000 7fed97fff700 1 -- 172.21.15.8:0/2809351956 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5589e479c350 msgr2=0x5589e47ab430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T12:03:50.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.707+0000 7fed97fff700 1 --2- 172.21.15.8:0/2809351956 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5589e479c350 0x5589e47ab430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.707+0000 7fed97fff700 1 -- 172.21.15.8:0/2809351956 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed981a60b0 con 0x5589e479b460 2023-12-17T12:03:50.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.707+0000 7fed9cf9b700 1 --2- 172.21.15.8:0/2809351956 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589e479ab00 0x5589e479e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T12:03:50.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.707+0000 7fed97fff700 1 --2- 172.21.15.8:0/2809351956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5589e479b460 0x5589e47aaef0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fed84005950 tx=0x7fed84066ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=857cbce16ab85227 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:50.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.707+0000 7fed77fff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-12-17T12:03:50.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.708+0000 7fed77fff700 1 -- 172.21.15.8:0/2809351956 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8401f550 con 0x5589e479b460 2023-12-17T12:03:50.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.708+0000 7fed77fff700 1 -- 172.21.15.8:0/2809351956 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fed8400cc50 con 0x5589e479b460 2023-12-17T12:03:50.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.708+0000 7fedb2afab80 1 -- 172.21.15.8:0/2809351956 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fed84066940 con 0x5589e479b460 2023-12-17T12:03:50.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.708+0000 7fed77fff700 1 -- 172.21.15.8:0/2809351956 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed8409e150 con 0x5589e479b460 2023-12-17T12:03:50.714 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.708+0000 7fedb2afab80 10 client.15126 fetch_fsmap learned FSMap version 27 2023-12-17T12:03:50.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.708+0000 7fedb2afab80 1 -- 172.21.15.8:0/2809351956 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5589e46af290 con 0x5589e479b460 2023-12-17T12:03:50.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.708+0000 7fed77fff700 1 -- 172.21.15.8:0/2809351956 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fed84066940 con 0x5589e479b460 2023-12-17T12:03:50.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.708+0000 7fed77fff700 1 -- 172.21.15.8:0/2809351956 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7fed84099820 con 0x5589e479b460 2023-12-17T12:03:50.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.708+0000 7fedb2afab80 10 client.15126 fetch_fsmap finished waiting for FSMap version 27 2023-12-17T12:03:50.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.708+0000 7fedb2afab80 10 client.15126 resolve_mds: resolved name 'k' to daemon mds.k 2023-12-17T12:03:50.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.708+0000 7fedb2afab80 20 client.15126 populate_metadata read hostname 'smithi008' 2023-12-17T12:03:50.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.708+0000 7fedb2afab80 1 --2- 172.21.15.8:0/2809351956 >> [v2:172.21.15.100:6832/305815776,v1:172.21.15.100:6833/305815776] conn(0x5589e480af30 0x5589e4807420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.708+0000 7fedb2afab80 4 client.15126 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-17T12:03:50.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.708+0000 7fedb2afab80 1 -- 172.21.15.8:0/2809351956 --> [v2:172.21.15.100:6832/305815776,v1:172.21.15.100:6833/305815776] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5589e46e69c0 con 0x5589e480af30 2023-12-17T12:03:50.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.709+0000 7fed9cf9b700 1 --2- 172.21.15.8:0/2809351956 >> [v2:172.21.15.100:6832/305815776,v1:172.21.15.100:6833/305815776] conn(0x5589e480af30 0x5589e4807420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.709+0000 7fed9cf9b700 1 --2- 172.21.15.8:0/2809351956 >> [v2:172.21.15.100:6832/305815776,v1:172.21.15.100:6833/305815776] conn(0x5589e480af30 0x5589e4807420 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d837b0f67faab907 server_cookie=82337a627a841912 in_seq=0 out_seq=0 2023-12-17T12:03:50.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.709+0000 7fed77fff700 10 client.15126 ms_handle_connect on v2:172.21.15.100:6832/305815776 2023-12-17T12:03:50.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.710+0000 7fed77fff700 1 -- 172.21.15.8:0/2809351956 <== mds.3 v2:172.21.15.100:6832/305815776 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x5589e46e69c0 con 0x5589e480af30 2023-12-17T12:03:50.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.710+0000 7fed77fff700 10 client.15126 handle_command_reply: tid=0 2023-12-17T12:03:50.715 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.710+0000 7fedb2afab80 1 client.15126 shutdown 2023-12-17T12:03:50.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.710+0000 7fedb2afab80 1 -- 172.21.15.8:0/2809351956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5589e479b460 msgr2=0x5589e47aaef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:50.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.710+0000 7fedb2afab80 1 --2- 172.21.15.8:0/2809351956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5589e479b460 0x5589e47aaef0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fed84005950 tx=0x7fed84066ab0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.710+0000 7fedb2afab80 1 -- 172.21.15.8:0/2809351956 shutdown_connections 2023-12-17T12:03:50.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.710+0000 7fedb2afab80 1 --2- 172.21.15.8:0/2809351956 >> [v2:172.21.15.100:6832/305815776,v1:172.21.15.100:6833/305815776] conn(0x5589e480af30 0x5589e4807420 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.710+0000 7fedb2afab80 1 --2- 172.21.15.8:0/2809351956 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5589e479c350 0x5589e47ab430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.710+0000 7fedb2afab80 1 --2- 172.21.15.8:0/2809351956 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5589e479ab00 0x5589e479e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.710+0000 7fedb2afab80 1 --2- 172.21.15.8:0/2809351956 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5589e479b460 0x5589e47aaef0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.710+0000 7fed77fff700 0 client.15126 ms_handle_reset on v2:172.21.15.100:6832/305815776 2023-12-17T12:03:50.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.710+0000 7fedb2afab80 1 -- 172.21.15.8:0/2809351956 >> 172.21.15.8:0/2809351956 conn(0x5589e4795670 msgr2=0x5589e47b8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:50.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.710+0000 7fedb2afab80 1 -- 172.21.15.8:0/2809351956 shutdown_connections 2023-12-17T12:03:50.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.710+0000 7fedb2afab80 1 -- 172.21.15.8:0/2809351956 wait complete. 2023-12-17T12:03:50.716 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.710+0000 7fedb2afab80 20 client.15126 trim_cache size 0 max 16384 2023-12-17T12:03:50.717 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-12-17T12:03:50.717 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "f43f508a-9cd2-11ee-95a5-87774f69a715", 2023-12-17T12:03:50.717 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 3, 2023-12-17T12:03:50.717 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 24470, 2023-12-17T12:03:50.717 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-12-17T12:03:50.717 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-12-17T12:03:50.717 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-12-17T12:03:50.717 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 54.701226773999998, 2023-12-17T12:03:50.717 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 27, 2023-12-17T12:03:50.717 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 85, 2023-12-17T12:03:50.718 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 83, 2023-12-17T12:03:50.718 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 92.585989346999995 2023-12-17T12:03:50.718 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-12-17T12:03:50.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.711+0000 7fed9f1ff700 1 -- 172.21.15.8:0/3583218898 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fed880a1590 msgr2=0x7fed880a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:50.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.711+0000 7fed9f1ff700 1 --2- 172.21.15.8:0/3583218898 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fed880a1590 0x7fed880a3a50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fed900078c0 tx=0x7fed90009100 comp rx=0 tx=0).stop 2023-12-17T12:03:50.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.711+0000 7fed9f1ff700 1 -- 172.21.15.8:0/3583218898 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fed98075610 msgr2=0x7fed9819dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:50.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.711+0000 7fed9f1ff700 1 --2- 172.21.15.8:0/3583218898 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fed98075610 0x7fed9819dfb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fed8400e970 tx=0x7fed8400ec80 comp rx=0 tx=0).stop 2023-12-17T12:03:50.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.711+0000 7fed9f1ff700 1 -- 172.21.15.8:0/3583218898 shutdown_connections 2023-12-17T12:03:50.718 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.711+0000 7fed9f1ff700 1 --2- 172.21.15.8:0/3583218898 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fed880a1590 0x7fed880a3a50 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.711+0000 7fed9f1ff700 1 --2- 172.21.15.8:0/3583218898 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fed9810db70 0x7fed981a4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.711+0000 7fed9f1ff700 1 --2- 172.21.15.8:0/3583218898 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fed98074030 0x7fed9819da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.711+0000 7fed9f1ff700 1 --2- 172.21.15.8:0/3583218898 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fed98075610 0x7fed9819dfb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.711+0000 7fed9f1ff700 1 -- 172.21.15.8:0/3583218898 >> 172.21.15.8:0/3583218898 conn(0x7fed980fcb10 msgr2=0x7fed98100f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:50.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.711+0000 7fed9f1ff700 1 -- 172.21.15.8:0/3583218898 shutdown_connections 2023-12-17T12:03:50.719 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.711+0000 7fed9f1ff700 1 -- 172.21.15.8:0/3583218898 wait complete. 2023-12-17T12:03:50.734 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2023-12-17T12:03:50.952 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.950+0000 7f73e6bff700 1 -- 172.21.15.8:0/1162919445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73e0074030 msgr2=0x7f73e00744b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:50.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.950+0000 7f73e6bff700 1 --2- 172.21.15.8:0/1162919445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73e0074030 0x7f73e00744b0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f73cc009990 tx=0x7f73cc009ca0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.950+0000 7f73e6bff700 1 -- 172.21.15.8:0/1162919445 shutdown_connections 2023-12-17T12:03:50.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.950+0000 7f73e6bff700 1 --2- 172.21.15.8:0/1162919445 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73e010db70 0x7f73e010ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.950+0000 7f73e6bff700 1 --2- 172.21.15.8:0/1162919445 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73e0075610 0x7f73e0073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.950+0000 7f73e6bff700 1 --2- 172.21.15.8:0/1162919445 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73e0074030 0x7f73e00744b0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.950+0000 7f73e6bff700 1 -- 172.21.15.8:0/1162919445 >> 172.21.15.8:0/1162919445 conn(0x7f73e00fcb10 msgr2=0x7f73e00fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:50.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.950+0000 7f73e6bff700 1 -- 172.21.15.8:0/1162919445 shutdown_connections 2023-12-17T12:03:50.953 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.950+0000 7f73e6bff700 1 -- 172.21.15.8:0/1162919445 wait complete. 2023-12-17T12:03:50.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.951+0000 7f73e6bff700 1 Processor -- start 2023-12-17T12:03:50.954 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.952+0000 7f73e6bff700 1 -- start start 2023-12-17T12:03:50.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.952+0000 7f73e6bff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73e0074030 0x7f73e019dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.952+0000 7f73e6bff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73e0075610 0x7f73e019e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.952+0000 7f73e6bff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73e010db70 0x7f73e01a5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.955 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.952+0000 7f73e6bff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e01a5600 con 0x7f73e0075610 2023-12-17T12:03:50.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.952+0000 7f73e6bff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e01a5740 con 0x7f73e0074030 2023-12-17T12:03:50.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.952+0000 7f73e6bff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e01a58d0 con 0x7f73e010db70 2023-12-17T12:03:50.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.952+0000 7f73dffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73e0075610 0x7f73e019e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.952+0000 7f73e499b700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73e0074030 0x7f73e019dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.952+0000 7f73dffff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73e0075610 0x7f73e019e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52182/0 (socket says 172.21.15.8:52182) 2023-12-17T12:03:50.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.952+0000 7f73dffff700 1 -- 172.21.15.8:0/2474631610 learned_addr learned my addr 172.21.15.8:0/2474631610 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:50.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.952+0000 7f73e519c700 1 --2- 172.21.15.8:0/2474631610 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73e010db70 0x7f73e01a5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.953+0000 7f73dffff700 1 -- 172.21.15.8:0/2474631610 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73e010db70 msgr2=0x7f73e01a5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:50.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.953+0000 7f73dffff700 1 --2- 172.21.15.8:0/2474631610 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73e010db70 0x7f73e01a5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.953+0000 7f73dffff700 1 -- 172.21.15.8:0/2474631610 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73e0074030 msgr2=0x7f73e019dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:50.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.953+0000 7f73dffff700 1 --2- 172.21.15.8:0/2474631610 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73e0074030 0x7f73e019dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.953+0000 7f73dffff700 1 -- 172.21.15.8:0/2474631610 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d8009c40 con 0x7f73e0075610 2023-12-17T12:03:50.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.953+0000 7f73dffff700 1 --2- 172.21.15.8:0/2474631610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73e0075610 0x7f73e019e010 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f73cc005910 tx=0x7f73cc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:50.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.953+0000 7f73ddffb700 1 -- 172.21.15.8:0/2474631610 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc01d070 con 0x7f73e0075610 2023-12-17T12:03:50.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.953+0000 7f73ddffb700 1 -- 172.21.15.8:0/2474631610 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f73cc00bdb0 con 0x7f73e0075610 2023-12-17T12:03:50.956 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.953+0000 7f73e6bff700 1 -- 172.21.15.8:0/2474631610 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73cc0095f0 con 0x7f73e0075610 2023-12-17T12:03:50.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.953+0000 7f73ddffb700 1 -- 172.21.15.8:0/2474631610 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc022cd0 con 0x7f73e0075610 2023-12-17T12:03:50.957 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.953+0000 7f73e6bff700 1 -- 172.21.15.8:0/2474631610 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e01a5de0 con 0x7f73e0075610 2023-12-17T12:03:50.959 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.956+0000 7f73ddffb700 1 -- 172.21.15.8:0/2474631610 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f73cc022470 con 0x7f73e0075610 2023-12-17T12:03:50.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.958+0000 7f73ddffb700 1 --2- 172.21.15.8:0/2474631610 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f73d00a1510 0x7f73d00a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.958+0000 7f73ddffb700 1 -- 172.21.15.8:0/2474631610 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f73cc0ce3f0 con 0x7f73e0075610 2023-12-17T12:03:50.960 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.958+0000 7f73e499b700 1 --2- 172.21.15.8:0/2474631610 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f73d00a1510 0x7f73d00a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.959+0000 7f73fa501b80 1 Processor -- start 2023-12-17T12:03:50.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.959+0000 7f73fa501b80 1 -- start start 2023-12-17T12:03:50.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.959+0000 7f73e499b700 1 --2- 172.21.15.8:0/2474631610 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f73d00a1510 0x7f73d00a39d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f73d4009c60 tx=0x7f73d4009260 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:50.961 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.959+0000 7f73fa501b80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5582366fab00 0x5582366faf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.959+0000 7f73fa501b80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582366fb460 0x5582366fbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.959+0000 7f73fa501b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5582366fc350 0x5582366fc7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.959+0000 7f73fa501b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558236672420 con 0x5582366fc350 2023-12-17T12:03:50.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.959+0000 7f73fa501b80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x558236654c00 con 0x5582366fb460 2023-12-17T12:03:50.962 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.959+0000 7f73fa501b80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x558236652520 con 0x5582366fab00 2023-12-17T12:03:50.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.960+0000 7f73dffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582366fb460 0x5582366fbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.960+0000 7f73e499b700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5582366fab00 0x5582366faf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.960+0000 7f73e519c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5582366fc350 0x5582366fc7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.960+0000 7f73dffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582366fb460 0x5582366fbd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.8:45496/0 (socket says 172.21.15.8:45496) 2023-12-17T12:03:50.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.960+0000 7f73dffff700 1 -- 172.21.15.8:0/1892167248 learned_addr learned my addr 172.21.15.8:0/1892167248 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:50.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.960+0000 7f73dffff700 1 -- 172.21.15.8:0/1892167248 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5582366fab00 msgr2=0x5582366faf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T12:03:50.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.960+0000 7f73dffff700 1 --2- 172.21.15.8:0/1892167248 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5582366fab00 0x5582366faf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.960+0000 7f73dffff700 1 -- 172.21.15.8:0/1892167248 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5582366fc350 msgr2=0x5582366fc7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T12:03:50.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.960+0000 7f73dffff700 1 --2- 172.21.15.8:0/1892167248 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5582366fc350 0x5582366fc7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.960+0000 7f73dffff700 1 -- 172.21.15.8:0/1892167248 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582366afb50 con 0x5582366fb460 2023-12-17T12:03:50.963 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.960+0000 7f73e499b700 1 --2- 172.21.15.8:0/1892167248 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5582366fab00 0x5582366faf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T12:03:50.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.960+0000 7f73dffff700 1 --2- 172.21.15.8:0/1892167248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582366fb460 0x5582366fbd70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f73cc003ec0 tx=0x7f73cc004320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99f9b1bbc822fdd4 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:50.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.960+0000 7f73caffd700 1 -- 172.21.15.8:0/1892167248 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc09be40 con 0x5582366fb460 2023-12-17T12:03:50.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.960+0000 7f73caffd700 1 -- 172.21.15.8:0/1892167248 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f73cc09b740 con 0x5582366fb460 2023-12-17T12:03:50.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.961+0000 7f73caffd700 1 -- 172.21.15.8:0/1892167248 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc09ae90 con 0x5582366fb460 2023-12-17T12:03:50.964 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.961+0000 7f73fa501b80 1 -- 172.21.15.8:0/1892167248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582366fb460 msgr2=0x5582366fbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:50.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.961+0000 7f73fa501b80 1 --2- 172.21.15.8:0/1892167248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582366fb460 0x5582366fbd70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f73cc003ec0 tx=0x7f73cc004320 comp rx=0 tx=0).stop 2023-12-17T12:03:50.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.962+0000 7f73fa501b80 1 -- 172.21.15.8:0/1892167248 shutdown_connections 2023-12-17T12:03:50.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.962+0000 7f73fa501b80 1 --2- 172.21.15.8:0/1892167248 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5582366fc350 0x5582366fc7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.962+0000 7f73fa501b80 1 --2- 172.21.15.8:0/1892167248 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5582366fab00 0x5582366faf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.962+0000 7f73fa501b80 1 --2- 172.21.15.8:0/1892167248 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582366fb460 0x5582366fbd70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.962+0000 7f73fa501b80 1 -- 172.21.15.8:0/1892167248 >> 172.21.15.8:0/1892167248 conn(0x5582366f5670 msgr2=0x5582366f5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:50.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.962+0000 7f73fa501b80 1 -- 172.21.15.8:0/1892167248 shutdown_connections 2023-12-17T12:03:50.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.962+0000 7f73fa501b80 1 -- 172.21.15.8:0/1892167248 wait complete. 2023-12-17T12:03:50.965 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.962+0000 7f73fa501b80 1 -- start start 2023-12-17T12:03:50.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.963+0000 7f73fa501b80 1 Processor -- start 2023-12-17T12:03:50.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.963+0000 7f73fa501b80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582366fab00 0x558236704550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.964+0000 7f73fa501b80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5582366fb460 0x558236704a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.964+0000 7f73fa501b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5582366fc350 0x55823670bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.964+0000 7f73fa501b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55823664de10 con 0x5582366fc350 2023-12-17T12:03:50.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.964+0000 7f73fa501b80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582365ed000 con 0x5582366fab00 2023-12-17T12:03:50.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.964+0000 7f73fa501b80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582365ecca0 con 0x5582366fb460 2023-12-17T12:03:50.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.964+0000 7f73fa501b80 10 client.0 _ll_register_callbacks cb 0x5582365f53a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-17T12:03:50.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.964+0000 7f73e519c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5582366fc350 0x55823670bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.964+0000 7f73dffff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5582366fb460 0x558236704a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.968 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.964+0000 7f73e519c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5582366fc350 0x55823670bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52202/0 (socket says 172.21.15.8:52202) 2023-12-17T12:03:50.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.964+0000 7f73e519c700 1 -- 172.21.15.8:0/3780152758 learned_addr learned my addr 172.21.15.8:0/3780152758 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:50.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.964+0000 7f73e499b700 1 --2- 172.21.15.8:0/3780152758 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582366fab00 0x558236704550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.964+0000 7f73dffff700 1 -- 172.21.15.8:0/3780152758 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582366fab00 msgr2=0x558236704550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T12:03:50.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.964+0000 7f73dffff700 1 --2- 172.21.15.8:0/3780152758 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582366fab00 0x558236704550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.964+0000 7f73dffff700 1 -- 172.21.15.8:0/3780152758 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5582366fc350 msgr2=0x55823670bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T12:03:50.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.964+0000 7f73dffff700 1 --2- 172.21.15.8:0/3780152758 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5582366fc350 0x55823670bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.964+0000 7f73dffff700 1 -- 172.21.15.8:0/3780152758 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73d4017070 con 0x5582366fb460 2023-12-17T12:03:50.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.964+0000 7f73e499b700 1 --2- 172.21.15.8:0/3780152758 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582366fab00 0x558236704550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T12:03:50.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.965+0000 7f73dffff700 1 --2- 172.21.15.8:0/3780152758 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5582366fb460 0x558236704a90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f73cc003ec0 tx=0x7f73cc00b2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aaa3ce5b25f4f387 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:50.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.965+0000 7f73bffff700 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2023-12-17T12:03:50.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.965+0000 7f73bffff700 1 -- 172.21.15.8:0/3780152758 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73cc067070 con 0x5582366fb460 2023-12-17T12:03:50.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.965+0000 7f73bffff700 1 -- 172.21.15.8:0/3780152758 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f73cc09f890 con 0x5582366fb460 2023-12-17T12:03:50.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.965+0000 7f73fa501b80 1 -- 172.21.15.8:0/3780152758 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5582366ed470 con 0x5582366fb460 2023-12-17T12:03:50.969 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.965+0000 7f73bffff700 1 -- 172.21.15.8:0/3780152758 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f73cc09be40 con 0x5582366fb460 2023-12-17T12:03:50.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.965+0000 7f73fa501b80 10 client.24955 fetch_fsmap learned FSMap version 27 2023-12-17T12:03:50.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.965+0000 7f73fa501b80 1 -- 172.21.15.8:0/3780152758 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f73e01a5de0 con 0x5582366fb460 2023-12-17T12:03:50.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.965+0000 7f73bffff700 1 -- 172.21.15.8:0/3780152758 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5582366ed470 con 0x5582366fb460 2023-12-17T12:03:50.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.965+0000 7f73bffff700 1 -- 172.21.15.8:0/3780152758 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f73cc09a6a0 con 0x5582366fb460 2023-12-17T12:03:50.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.965+0000 7f73fa501b80 10 client.24955 fetch_fsmap finished waiting for FSMap version 27 2023-12-17T12:03:50.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.966+0000 7f73fa501b80 10 client.24955 resolve_mds: resolved name 'e' to daemon mds.e 2023-12-17T12:03:50.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.966+0000 7f73fa501b80 20 client.24955 populate_metadata read hostname 'smithi008' 2023-12-17T12:03:50.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.966+0000 7f73fa501b80 1 --2- 172.21.15.8:0/3780152758 >> [v2:172.21.15.100:6834/2140351853,v1:172.21.15.100:6835/2140351853] conn(0x55823670fbd0 0x55823670eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.966+0000 7f73fa501b80 4 client.24955 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-17T12:03:50.970 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.966+0000 7f73fa501b80 1 -- 172.21.15.8:0/3780152758 --> [v2:172.21.15.100:6834/2140351853,v1:172.21.15.100:6835/2140351853] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558236646ca0 con 0x55823670fbd0 2023-12-17T12:03:50.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.966+0000 7f73e499b700 1 --2- 172.21.15.8:0/3780152758 >> [v2:172.21.15.100:6834/2140351853,v1:172.21.15.100:6835/2140351853] conn(0x55823670fbd0 0x55823670eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.967+0000 7f73e499b700 1 --2- 172.21.15.8:0/3780152758 >> [v2:172.21.15.100:6834/2140351853,v1:172.21.15.100:6835/2140351853] conn(0x55823670fbd0 0x55823670eaa0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3496969bc29a1656 server_cookie=e593d0818070478f in_seq=0 out_seq=0 2023-12-17T12:03:50.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.967+0000 7f73bffff700 10 client.24955 ms_handle_connect on v2:172.21.15.100:6834/2140351853 2023-12-17T12:03:50.971 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.967+0000 7f73bffff700 1 -- 172.21.15.8:0/3780152758 <== mds.2 v2:172.21.15.100:6834/2140351853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558236646ca0 con 0x55823670fbd0 2023-12-17T12:03:50.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.967+0000 7f73bffff700 10 client.24955 handle_command_reply: tid=0 2023-12-17T12:03:50.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.967+0000 7f73fa501b80 1 client.24955 shutdown 2023-12-17T12:03:50.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.968+0000 7f73fa501b80 1 -- 172.21.15.8:0/3780152758 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5582366fb460 msgr2=0x558236704a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:50.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.968+0000 7f73fa501b80 1 --2- 172.21.15.8:0/3780152758 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5582366fb460 0x558236704a90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f73cc003ec0 tx=0x7f73cc00b2e0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.968+0000 7f73fa501b80 1 -- 172.21.15.8:0/3780152758 shutdown_connections 2023-12-17T12:03:50.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.968+0000 7f73fa501b80 1 --2- 172.21.15.8:0/3780152758 >> [v2:172.21.15.100:6834/2140351853,v1:172.21.15.100:6835/2140351853] conn(0x55823670fbd0 0x55823670eaa0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.968+0000 7f73fa501b80 1 --2- 172.21.15.8:0/3780152758 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5582366fc350 0x55823670bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.968+0000 7f73fa501b80 1 --2- 172.21.15.8:0/3780152758 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582366fab00 0x558236704550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.968+0000 7f73fa501b80 1 --2- 172.21.15.8:0/3780152758 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5582366fb460 0x558236704a90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.968+0000 7f73fa501b80 1 -- 172.21.15.8:0/3780152758 >> 172.21.15.8:0/3780152758 conn(0x5582366f5670 msgr2=0x5582366f4b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:50.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.968+0000 7f73bffff700 0 client.24955 ms_handle_reset on v2:172.21.15.100:6834/2140351853 2023-12-17T12:03:50.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.968+0000 7f73fa501b80 1 -- 172.21.15.8:0/3780152758 shutdown_connections 2023-12-17T12:03:50.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.968+0000 7f73fa501b80 1 -- 172.21.15.8:0/3780152758 wait complete. 2023-12-17T12:03:50.973 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.968+0000 7f73fa501b80 20 client.24955 trim_cache size 0 max 16384 2023-12-17T12:03:50.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.987+0000 7f73fa501b80 1 Processor -- start 2023-12-17T12:03:50.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.987+0000 7f73fa501b80 1 -- start start 2023-12-17T12:03:50.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.988+0000 7f73fa501b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5582366fab00 0x5582366fc730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.988+0000 7f73fa501b80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582366fb460 0x55823670b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.988+0000 7f73fa501b80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5582366fc350 0x558236703a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.988+0000 7f73fa501b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582364cc650 con 0x5582366fab00 2023-12-17T12:03:50.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.988+0000 7f73fa501b80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x558236646cd0 con 0x5582366fb460 2023-12-17T12:03:50.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.988+0000 7f73fa501b80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582365b8ce0 con 0x5582366fc350 2023-12-17T12:03:50.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.988+0000 7f73e499b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5582366fab00 0x5582366fc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.991 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.988+0000 7f73e519c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5582366fc350 0x558236703a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.988+0000 7f73dffff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582366fb460 0x55823670b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.988+0000 7f73e499b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5582366fab00 0x5582366fc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52204/0 (socket says 172.21.15.8:52204) 2023-12-17T12:03:50.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.988+0000 7f73e519c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5582366fc350 0x558236703a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:46484/0 (socket says 172.21.15.8:46484) 2023-12-17T12:03:50.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.988+0000 7f73e499b700 1 -- 172.21.15.8:0/1310374968 learned_addr learned my addr 172.21.15.8:0/1310374968 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:50.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.989+0000 7f73e499b700 1 -- 172.21.15.8:0/1310374968 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5582366fc350 msgr2=0x558236703a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T12:03:50.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.989+0000 7f73e499b700 1 --2- 172.21.15.8:0/1310374968 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5582366fc350 0x558236703a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.989+0000 7f73e499b700 1 -- 172.21.15.8:0/1310374968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582366fb460 msgr2=0x55823670b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T12:03:50.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.989+0000 7f73e499b700 1 --2- 172.21.15.8:0/1310374968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582366fb460 0x55823670b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.989+0000 7f73e499b700 1 -- 172.21.15.8:0/1310374968 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558236476b10 con 0x5582366fab00 2023-12-17T12:03:50.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.989+0000 7f73e519c700 1 --2- 172.21.15.8:0/1310374968 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5582366fc350 0x558236703a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T12:03:50.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.989+0000 7f73dffff700 1 --2- 172.21.15.8:0/1310374968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582366fb460 0x55823670b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T12:03:50.992 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.989+0000 7f73e499b700 1 --2- 172.21.15.8:0/1310374968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5582366fab00 0x5582366fc730 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x558236710900 tx=0x7f73d4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14d93b7b303bbb3d server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:50.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.989+0000 7f73cb7fe700 1 -- 172.21.15.8:0/1310374968 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d402a070 con 0x5582366fab00 2023-12-17T12:03:50.994 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.989+0000 7f73cb7fe700 1 -- 172.21.15.8:0/1310374968 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f73d4023040 con 0x5582366fab00 2023-12-17T12:03:50.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.989+0000 7f73cb7fe700 1 -- 172.21.15.8:0/1310374968 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d4029a10 con 0x5582366fab00 2023-12-17T12:03:50.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.990+0000 7f73fa501b80 1 -- 172.21.15.8:0/1310374968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5582366fab00 msgr2=0x5582366fc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:50.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.990+0000 7f73fa501b80 1 --2- 172.21.15.8:0/1310374968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5582366fab00 0x5582366fc730 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x558236710900 tx=0x7f73d4014000 comp rx=0 tx=0).stop 2023-12-17T12:03:50.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.990+0000 7f73fa501b80 1 -- 172.21.15.8:0/1310374968 shutdown_connections 2023-12-17T12:03:50.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.990+0000 7f73fa501b80 1 --2- 172.21.15.8:0/1310374968 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5582366fc350 0x558236703a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.990+0000 7f73fa501b80 1 --2- 172.21.15.8:0/1310374968 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5582366fab00 0x5582366fc730 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.990+0000 7f73fa501b80 1 --2- 172.21.15.8:0/1310374968 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582366fb460 0x55823670b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.990+0000 7f73fa501b80 1 -- 172.21.15.8:0/1310374968 >> 172.21.15.8:0/1310374968 conn(0x5582366f5670 msgr2=0x5582366f5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:50.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.990+0000 7f73fa501b80 1 -- 172.21.15.8:0/1310374968 shutdown_connections 2023-12-17T12:03:50.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.990+0000 7f73fa501b80 1 -- 172.21.15.8:0/1310374968 wait complete. 2023-12-17T12:03:50.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.990+0000 7f73fa501b80 1 -- start start 2023-12-17T12:03:50.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.991+0000 7f73fa501b80 1 Processor -- start 2023-12-17T12:03:50.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.991+0000 7f73fa501b80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5582366fab00 0x5582367049d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.995 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.991+0000 7f73fa501b80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582366fb460 0x55823670aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.991+0000 7f73fa501b80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5582366fc350 0x55823670af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:50.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.991+0000 7f73fa501b80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55823670b5c0 con 0x5582366fc350 2023-12-17T12:03:50.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.991+0000 7f73fa501b80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55823670b730 con 0x5582366fb460 2023-12-17T12:03:50.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.991+0000 7f73fa501b80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55823670b8f0 con 0x5582366fab00 2023-12-17T12:03:50.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.991+0000 7f73fa501b80 10 client.0 _ll_register_callbacks cb 0x5582365f53a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-17T12:03:50.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.992+0000 7f73e499b700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5582366fab00 0x5582367049d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.992+0000 7f73e499b700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5582366fab00 0x5582367049d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:46490/0 (socket says 172.21.15.8:46490) 2023-12-17T12:03:50.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.992+0000 7f73e499b700 1 -- 172.21.15.8:0/2868808663 learned_addr learned my addr 172.21.15.8:0/2868808663 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:50.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.992+0000 7f73e519c700 1 --2- 172.21.15.8:0/2868808663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5582366fc350 0x55823670af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.992+0000 7f73dffff700 1 --2- 172.21.15.8:0/2868808663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582366fb460 0x55823670aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:50.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.992+0000 7f73e499b700 1 -- 172.21.15.8:0/2868808663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582366fb460 msgr2=0x55823670aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T12:03:50.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.992+0000 7f73e499b700 1 --2- 172.21.15.8:0/2868808663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582366fb460 0x55823670aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.992+0000 7f73e499b700 1 -- 172.21.15.8:0/2868808663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5582366fc350 msgr2=0x55823670af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T12:03:50.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.992+0000 7f73e499b700 1 --2- 172.21.15.8:0/2868808663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5582366fc350 0x55823670af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:50.996 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.992+0000 7f73e499b700 1 -- 172.21.15.8:0/2868808663 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e01a5de0 con 0x5582366fab00 2023-12-17T12:03:50.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.992+0000 7f73e519c700 1 --2- 172.21.15.8:0/2868808663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5582366fc350 0x55823670af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T12:03:50.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.992+0000 7f73e499b700 1 --2- 172.21.15.8:0/2868808663 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5582366fab00 0x5582367049d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f73d4029480 tx=0x7f73d40294b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=feb3a33c8c793e08 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:50.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.992+0000 7f73bffff700 10 client.0 ms_handle_connect on v2:172.21.15.186:3300/0 2023-12-17T12:03:51.000 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.993+0000 7f73bffff700 1 -- 172.21.15.8:0/2868808663 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d4005450 con 0x5582366fab00 2023-12-17T12:03:51.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.993+0000 7f73bffff700 1 -- 172.21.15.8:0/2868808663 <== mon.1 v2:172.21.15.186:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f73d40055b0 con 0x5582366fab00 2023-12-17T12:03:51.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.993+0000 7f73fa501b80 1 -- 172.21.15.8:0/2868808663 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f73cc09b740 con 0x5582366fab00 2023-12-17T12:03:51.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.993+0000 7f73bffff700 1 -- 172.21.15.8:0/2868808663 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f73d4004750 con 0x5582366fab00 2023-12-17T12:03:51.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.993+0000 7f73fa501b80 10 client.24961 fetch_fsmap learned FSMap version 27 2023-12-17T12:03:51.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.993+0000 7f73fa501b80 1 -- 172.21.15.8:0/2868808663 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f73d800e530 con 0x5582366fab00 2023-12-17T12:03:51.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.993+0000 7f73bffff700 1 -- 172.21.15.8:0/2868808663 <== mon.1 v2:172.21.15.186:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f73cc09b740 con 0x5582366fab00 2023-12-17T12:03:51.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.994+0000 7f73bffff700 1 -- 172.21.15.8:0/2868808663 <== mon.1 v2:172.21.15.186:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f73d4034760 con 0x5582366fab00 2023-12-17T12:03:51.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.994+0000 7f73fa501b80 10 client.24961 fetch_fsmap finished waiting for FSMap version 27 2023-12-17T12:03:51.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.994+0000 7f73fa501b80 10 client.24961 resolve_mds: resolved name 'e' to daemon mds.e 2023-12-17T12:03:51.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.994+0000 7f73fa501b80 20 client.24961 populate_metadata read hostname 'smithi008' 2023-12-17T12:03:51.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.994+0000 7f73fa501b80 1 --2- 172.21.15.8:0/2868808663 >> [v2:172.21.15.100:6834/2140351853,v1:172.21.15.100:6835/2140351853] conn(0x55823676a770 0x558236766c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:51.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.994+0000 7f73fa501b80 4 client.24961 mds_command: new command op to 24503 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-17T12:03:51.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.994+0000 7f73fa501b80 1 -- 172.21.15.8:0/2868808663 --> [v2:172.21.15.100:6834/2140351853,v1:172.21.15.100:6835/2140351853] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5582366469c0 con 0x55823676a770 2023-12-17T12:03:51.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.994+0000 7f73dffff700 1 --2- 172.21.15.8:0/2868808663 >> [v2:172.21.15.100:6834/2140351853,v1:172.21.15.100:6835/2140351853] conn(0x55823676a770 0x558236766c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:51.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.995+0000 7f73dffff700 1 --2- 172.21.15.8:0/2868808663 >> [v2:172.21.15.100:6834/2140351853,v1:172.21.15.100:6835/2140351853] conn(0x55823676a770 0x558236766c10 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3dd9b47f484c2e19 server_cookie=3f47180d2bdca09c in_seq=0 out_seq=0 2023-12-17T12:03:51.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.995+0000 7f73bffff700 10 client.24961 ms_handle_connect on v2:172.21.15.100:6834/2140351853 2023-12-17T12:03:51.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.995+0000 7f73bffff700 1 -- 172.21.15.8:0/2868808663 <== mds.2 v2:172.21.15.100:6834/2140351853 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x5582366469c0 con 0x55823676a770 2023-12-17T12:03:51.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.995+0000 7f73bffff700 10 client.24961 handle_command_reply: tid=0 2023-12-17T12:03:51.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.995+0000 7f73fa501b80 1 client.24961 shutdown 2023-12-17T12:03:51.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.995+0000 7f73fa501b80 1 -- 172.21.15.8:0/2868808663 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5582366fab00 msgr2=0x5582367049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:51.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.995+0000 7f73fa501b80 1 --2- 172.21.15.8:0/2868808663 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5582366fab00 0x5582367049d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f73d4029480 tx=0x7f73d40294b0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.995+0000 7f73fa501b80 1 -- 172.21.15.8:0/2868808663 shutdown_connections 2023-12-17T12:03:51.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.995+0000 7f73fa501b80 1 --2- 172.21.15.8:0/2868808663 >> [v2:172.21.15.100:6834/2140351853,v1:172.21.15.100:6835/2140351853] conn(0x55823676a770 0x558236766c10 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.995+0000 7f73fa501b80 1 --2- 172.21.15.8:0/2868808663 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x5582366fc350 0x55823670af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.995+0000 7f73bffff700 0 client.24961 ms_handle_reset on v2:172.21.15.100:6834/2140351853 2023-12-17T12:03:51.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.995+0000 7f73fa501b80 1 --2- 172.21.15.8:0/2868808663 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x5582366fab00 0x5582367049d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.995+0000 7f73fa501b80 1 --2- 172.21.15.8:0/2868808663 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x5582366fb460 0x55823670aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.995+0000 7f73fa501b80 1 -- 172.21.15.8:0/2868808663 >> 172.21.15.8:0/2868808663 conn(0x5582366f5670 msgr2=0x558236703960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:51.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.995+0000 7f73fa501b80 1 -- 172.21.15.8:0/2868808663 shutdown_connections 2023-12-17T12:03:51.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.996+0000 7f73fa501b80 1 -- 172.21.15.8:0/2868808663 wait complete. 2023-12-17T12:03:51.003 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.996+0000 7f73fa501b80 20 client.24961 trim_cache size 0 max 16384 2023-12-17T12:03:51.003 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-12-17T12:03:51.003 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "f43f508a-9cd2-11ee-95a5-87774f69a715", 2023-12-17T12:03:51.003 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 2, 2023-12-17T12:03:51.003 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 24503, 2023-12-17T12:03:51.003 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-12-17T12:03:51.003 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-12-17T12:03:51.003 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-12-17T12:03:51.004 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 56.014756106, 2023-12-17T12:03:51.004 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 27, 2023-12-17T12:03:51.004 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 85, 2023-12-17T12:03:51.004 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 83, 2023-12-17T12:03:51.004 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 84.992616646000002 2023-12-17T12:03:51.004 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-12-17T12:03:51.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.996+0000 7f73e6bff700 1 -- 172.21.15.8:0/2474631610 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f73d00a1510 msgr2=0x7f73d00a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:51.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.996+0000 7f73e6bff700 1 --2- 172.21.15.8:0/2474631610 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f73d00a1510 0x7f73d00a39d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f73d4009c60 tx=0x7f73d4009260 comp rx=0 tx=0).stop 2023-12-17T12:03:51.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.996+0000 7f73e6bff700 1 -- 172.21.15.8:0/2474631610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73e0075610 msgr2=0x7f73e019e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:51.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.996+0000 7f73e6bff700 1 --2- 172.21.15.8:0/2474631610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73e0075610 0x7f73e019e010 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f73cc005910 tx=0x7f73cc004730 comp rx=0 tx=0).stop 2023-12-17T12:03:51.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.996+0000 7f73e6bff700 1 -- 172.21.15.8:0/2474631610 shutdown_connections 2023-12-17T12:03:51.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.996+0000 7f73e6bff700 1 --2- 172.21.15.8:0/2474631610 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f73d00a1510 0x7f73d00a39d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.996+0000 7f73e6bff700 1 --2- 172.21.15.8:0/2474631610 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f73e010db70 0x7f73e01a5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.996+0000 7f73e6bff700 1 --2- 172.21.15.8:0/2474631610 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f73e0074030 0x7f73e019dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.996+0000 7f73e6bff700 1 --2- 172.21.15.8:0/2474631610 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f73e0075610 0x7f73e019e010 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.996+0000 7f73e6bff700 1 -- 172.21.15.8:0/2474631610 >> 172.21.15.8:0/2474631610 conn(0x7f73e00fcb10 msgr2=0x7f73e0100f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:51.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.997+0000 7f73e6bff700 1 -- 172.21.15.8:0/2474631610 shutdown_connections 2023-12-17T12:03:51.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:50.997+0000 7f73e6bff700 1 -- 172.21.15.8:0/2474631610 wait complete. 2023-12-17T12:03:51.019 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-12-17T12:03:51.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.233+0000 7f772afff700 1 -- 172.21.15.8:0/266246779 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7724107260 msgr2=0x7f77241096d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:51.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.233+0000 7f772afff700 1 --2- 172.21.15.8:0/266246779 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7724107260 0x7f77241096d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f771c00b0a0 tx=0x7f771c00b3b0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.233+0000 7f772afff700 1 -- 172.21.15.8:0/266246779 shutdown_connections 2023-12-17T12:03:51.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.233+0000 7f772afff700 1 --2- 172.21.15.8:0/266246779 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7724107260 0x7f77241096d0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.233+0000 7f772afff700 1 --2- 172.21.15.8:0/266246779 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7724102000 0x7f77241043f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.233+0000 7f772afff700 1 --2- 172.21.15.8:0/266246779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7724104930 0x7f7724106d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.233+0000 7f772afff700 1 -- 172.21.15.8:0/266246779 >> 172.21.15.8:0/266246779 conn(0x7f77240fb9f0 msgr2=0x7f77240fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:51.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.233+0000 7f772afff700 1 -- 172.21.15.8:0/266246779 shutdown_connections 2023-12-17T12:03:51.236 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.233+0000 7f772afff700 1 -- 172.21.15.8:0/266246779 wait complete. 2023-12-17T12:03:51.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.234+0000 7f772afff700 1 Processor -- start 2023-12-17T12:03:51.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.234+0000 7f772afff700 1 -- start start 2023-12-17T12:03:51.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.235+0000 7f772afff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7724102000 0x7f77241996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:51.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.235+0000 7f772afff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7724104930 0x7f7724199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:51.238 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.235+0000 7f772afff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7724107260 0x7f77241a0c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:51.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.235+0000 7f772afff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77241a1200 con 0x7f7724102000 2023-12-17T12:03:51.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.235+0000 7f772afff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77241a1340 con 0x7f7724104930 2023-12-17T12:03:51.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.235+0000 7f772afff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77241a14d0 con 0x7f7724107260 2023-12-17T12:03:51.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.235+0000 7f7728d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7724102000 0x7f77241996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:51.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.235+0000 7f7723fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7724104930 0x7f7724199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:51.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.235+0000 7f7728d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7724102000 0x7f77241996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52214/0 (socket says 172.21.15.8:52214) 2023-12-17T12:03:51.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.235+0000 7f7728d9b700 1 -- 172.21.15.8:0/3690395177 learned_addr learned my addr 172.21.15.8:0/3690395177 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:51.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.235+0000 7f772959c700 1 --2- 172.21.15.8:0/3690395177 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7724107260 0x7f77241a0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:51.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.235+0000 7f7728d9b700 1 -- 172.21.15.8:0/3690395177 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7724107260 msgr2=0x7f77241a0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:51.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.235+0000 7f7728d9b700 1 --2- 172.21.15.8:0/3690395177 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7724107260 0x7f77241a0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.235+0000 7f7728d9b700 1 -- 172.21.15.8:0/3690395177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7724104930 msgr2=0x7f7724199c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:51.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.235+0000 7f7728d9b700 1 --2- 172.21.15.8:0/3690395177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7724104930 0x7f7724199c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.235+0000 7f7728d9b700 1 -- 172.21.15.8:0/3690395177 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f771c009d00 con 0x7f7724102000 2023-12-17T12:03:51.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.236+0000 7f7728d9b700 1 --2- 172.21.15.8:0/3690395177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7724102000 0x7f77241996d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f771800e9a0 tx=0x7f771800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:51.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.236+0000 7f7721ffb700 1 -- 172.21.15.8:0/3690395177 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7718009790 con 0x7f7724102000 2023-12-17T12:03:51.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.236+0000 7f7721ffb700 1 -- 172.21.15.8:0/3690395177 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7718010430 con 0x7f7724102000 2023-12-17T12:03:51.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.236+0000 7f772afff700 1 -- 172.21.15.8:0/3690395177 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77241a17b0 con 0x7f7724102000 2023-12-17T12:03:51.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.236+0000 7f7721ffb700 1 -- 172.21.15.8:0/3690395177 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771800cea0 con 0x7f7724102000 2023-12-17T12:03:51.240 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.236+0000 7f772afff700 1 -- 172.21.15.8:0/3690395177 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77241a1cc0 con 0x7f7724102000 2023-12-17T12:03:51.242 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.239+0000 7f7721ffb700 1 -- 172.21.15.8:0/3690395177 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f77180105a0 con 0x7f7724102000 2023-12-17T12:03:51.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.241+0000 7f7721ffb700 1 --2- 172.21.15.8:0/3690395177 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f77140a1510 0x7f77140a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:51.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.241+0000 7f773e97cb80 1 Processor -- start 2023-12-17T12:03:51.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.241+0000 7f7721ffb700 1 -- 172.21.15.8:0/3690395177 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f7718014070 con 0x7f7724102000 2023-12-17T12:03:51.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.241+0000 7f773e97cb80 1 -- start start 2023-12-17T12:03:51.243 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.241+0000 7f7723fff700 1 --2- 172.21.15.8:0/3690395177 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f77140a1510 0x7f77140a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:51.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.241+0000 7f773e97cb80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558c3b13ab00 0x558c3b13af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:51.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.241+0000 7f773e97cb80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c3b13b460 0x558c3b13bd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:51.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.241+0000 7f773e97cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3b13c350 0x558c3b13c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:51.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.241+0000 7f773e97cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c3b0b2420 con 0x558c3b13c350 2023-12-17T12:03:51.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.241+0000 7f773e97cb80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c3b094c00 con 0x558c3b13b460 2023-12-17T12:03:51.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.241+0000 7f773e97cb80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c3b092520 con 0x558c3b13ab00 2023-12-17T12:03:51.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.242+0000 7f7728d9b700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558c3b13ab00 0x558c3b13af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:51.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.242+0000 7f772959c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3b13c350 0x558c3b13c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:51.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.242+0000 7f7728d9b700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558c3b13ab00 0x558c3b13af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:46508/0 (socket says 172.21.15.8:46508) 2023-12-17T12:03:51.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.242+0000 7f7728d9b700 1 -- 172.21.15.8:0/3888632908 learned_addr learned my addr 172.21.15.8:0/3888632908 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:51.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.242+0000 7f7723fff700 1 --2- 172.21.15.8:0/3690395177 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f77140a1510 0x7f77140a39d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7710009c60 tx=0x7f7710009260 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:51.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.242+0000 7f7728d9b700 1 -- 172.21.15.8:0/3888632908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c3b13b460 msgr2=0x558c3b13bd70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-17T12:03:51.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.242+0000 7f7728d9b700 1 --2- 172.21.15.8:0/3888632908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c3b13b460 0x558c3b13bd70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.242+0000 7f7728d9b700 1 -- 172.21.15.8:0/3888632908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3b13c350 msgr2=0x558c3b13c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T12:03:51.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.242+0000 7f7728d9b700 1 --2- 172.21.15.8:0/3888632908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3b13c350 0x558c3b13c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.242+0000 7f7728d9b700 1 -- 172.21.15.8:0/3888632908 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c3b0efb50 con 0x558c3b13ab00 2023-12-17T12:03:51.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.242+0000 7f7728d9b700 1 --2- 172.21.15.8:0/3888632908 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558c3b13ab00 0x558c3b13af20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f77180a2070 tx=0x7f7718010880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cc06117a14c6c9e server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:51.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.243+0000 7f770effd700 1 -- 172.21.15.8:0/3888632908 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771809e120 con 0x558c3b13ab00 2023-12-17T12:03:51.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.243+0000 7f770effd700 1 -- 172.21.15.8:0/3888632908 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f771809a210 con 0x558c3b13ab00 2023-12-17T12:03:51.246 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.243+0000 7f770effd700 1 -- 172.21.15.8:0/3888632908 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7718099960 con 0x558c3b13ab00 2023-12-17T12:03:51.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.244+0000 7f773e97cb80 1 -- 172.21.15.8:0/3888632908 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558c3b13ab00 msgr2=0x558c3b13af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:51.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.244+0000 7f773e97cb80 1 --2- 172.21.15.8:0/3888632908 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558c3b13ab00 0x558c3b13af20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f77180a2070 tx=0x7f7718010880 comp rx=0 tx=0).stop 2023-12-17T12:03:51.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.244+0000 7f773e97cb80 1 -- 172.21.15.8:0/3888632908 shutdown_connections 2023-12-17T12:03:51.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.244+0000 7f773e97cb80 1 --2- 172.21.15.8:0/3888632908 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3b13c350 0x558c3b13c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.244+0000 7f773e97cb80 1 --2- 172.21.15.8:0/3888632908 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558c3b13ab00 0x558c3b13af20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.247 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.244+0000 7f773e97cb80 1 --2- 172.21.15.8:0/3888632908 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c3b13b460 0x558c3b13bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.244+0000 7f773e97cb80 1 -- 172.21.15.8:0/3888632908 >> 172.21.15.8:0/3888632908 conn(0x558c3b135670 msgr2=0x558c3b135a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:51.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.244+0000 7f773e97cb80 1 -- 172.21.15.8:0/3888632908 shutdown_connections 2023-12-17T12:03:51.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.244+0000 7f773e97cb80 1 -- 172.21.15.8:0/3888632908 wait complete. 2023-12-17T12:03:51.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.245+0000 7f773e97cb80 1 -- start start 2023-12-17T12:03:51.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.245+0000 7f773e97cb80 1 Processor -- start 2023-12-17T12:03:51.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.246+0000 7f773e97cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3b13ab00 0x558c3b144920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:51.250 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.246+0000 7f773e97cb80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558c3b13b460 0x558c3b144e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:51.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.246+0000 7f773e97cb80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c3b13c350 0x558c3b14bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:51.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.246+0000 7f773e97cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c3b08de10 con 0x558c3b13ab00 2023-12-17T12:03:51.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.246+0000 7f773e97cb80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c3b02d000 con 0x558c3b13c350 2023-12-17T12:03:51.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.246+0000 7f773e97cb80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c3b02cca0 con 0x558c3b13b460 2023-12-17T12:03:51.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.246+0000 7f773e97cb80 10 client.0 _ll_register_callbacks cb 0x558c3b0353a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-17T12:03:51.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.246+0000 7f7728d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3b13ab00 0x558c3b144920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:51.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.246+0000 7f7723fff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558c3b13b460 0x558c3b144e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:51.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.246+0000 7f7728d9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3b13ab00 0x558c3b144920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52224/0 (socket says 172.21.15.8:52224) 2023-12-17T12:03:51.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.246+0000 7f7728d9b700 1 -- 172.21.15.8:0/2176408480 learned_addr learned my addr 172.21.15.8:0/2176408480 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:51.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.246+0000 7f772959c700 1 --2- 172.21.15.8:0/2176408480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c3b13c350 0x558c3b14bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:51.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.246+0000 7f7728d9b700 1 -- 172.21.15.8:0/2176408480 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558c3b13b460 msgr2=0x558c3b144e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T12:03:51.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.246+0000 7f7728d9b700 1 --2- 172.21.15.8:0/2176408480 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558c3b13b460 0x558c3b144e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.246+0000 7f7728d9b700 1 -- 172.21.15.8:0/2176408480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c3b13c350 msgr2=0x558c3b14bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T12:03:51.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.247+0000 7f7728d9b700 1 --2- 172.21.15.8:0/2176408480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c3b13c350 0x558c3b14bea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.251 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.247+0000 7f7728d9b700 1 -- 172.21.15.8:0/2176408480 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77241a1cc0 con 0x558c3b13ab00 2023-12-17T12:03:51.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.247+0000 7f7723fff700 1 --2- 172.21.15.8:0/2176408480 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558c3b13b460 0x558c3b144e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T12:03:51.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.247+0000 7f7728d9b700 1 --2- 172.21.15.8:0/2176408480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3b13ab00 0x558c3b144920 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f771800c2d0 tx=0x7f77180a2340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a62c45ccb08c703 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:51.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.247+0000 7f7703fff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-12-17T12:03:51.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.247+0000 7f7703fff700 1 -- 172.21.15.8:0/2176408480 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771809e120 con 0x558c3b13ab00 2023-12-17T12:03:51.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.247+0000 7f7703fff700 1 -- 172.21.15.8:0/2176408480 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f771809e360 con 0x558c3b13ab00 2023-12-17T12:03:51.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.247+0000 7f773e97cb80 1 -- 172.21.15.8:0/2176408480 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558c3b12d470 con 0x558c3b13ab00 2023-12-17T12:03:51.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.247+0000 7f7703fff700 1 -- 172.21.15.8:0/2176408480 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f771800cc20 con 0x558c3b13ab00 2023-12-17T12:03:51.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.247+0000 7f773e97cb80 10 client.15156 fetch_fsmap learned FSMap version 27 2023-12-17T12:03:51.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.247+0000 7f773e97cb80 1 -- 172.21.15.8:0/2176408480 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x558c3aeb6b10 con 0x558c3b13ab00 2023-12-17T12:03:51.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.248+0000 7f7703fff700 1 -- 172.21.15.8:0/2176408480 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558c3b12d470 con 0x558c3b13ab00 2023-12-17T12:03:51.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.248+0000 7f7703fff700 1 -- 172.21.15.8:0/2176408480 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f771809f0a0 con 0x558c3b13ab00 2023-12-17T12:03:51.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.248+0000 7f773e97cb80 10 client.15156 fetch_fsmap finished waiting for FSMap version 27 2023-12-17T12:03:51.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.248+0000 7f773e97cb80 10 client.15156 resolve_mds: resolved name 'i' to daemon mds.i 2023-12-17T12:03:51.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.248+0000 7f773e97cb80 20 client.15156 populate_metadata read hostname 'smithi008' 2023-12-17T12:03:51.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.248+0000 7f773e97cb80 1 --2- 172.21.15.8:0/2176408480 >> [v2:172.21.15.186:6838/91602342,v1:172.21.15.186:6839/91602342] conn(0x558c3b150160 0x558c3b14ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:51.252 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.248+0000 7f773e97cb80 4 client.15156 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-17T12:03:51.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.248+0000 7f773e97cb80 1 -- 172.21.15.8:0/2176408480 --> [v2:172.21.15.186:6838/91602342,v1:172.21.15.186:6839/91602342] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558c3b086ca0 con 0x558c3b150160 2023-12-17T12:03:51.253 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.248+0000 7f7723fff700 1 --2- 172.21.15.8:0/2176408480 >> [v2:172.21.15.186:6838/91602342,v1:172.21.15.186:6839/91602342] conn(0x558c3b150160 0x558c3b14ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:51.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.249+0000 7f7723fff700 1 --2- 172.21.15.8:0/2176408480 >> [v2:172.21.15.186:6838/91602342,v1:172.21.15.186:6839/91602342] conn(0x558c3b150160 0x558c3b14ee70 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b344619fcfbbdd53 server_cookie=6a77f31b2814cc42 in_seq=0 out_seq=0 2023-12-17T12:03:51.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.249+0000 7f7703fff700 10 client.15156 ms_handle_connect on v2:172.21.15.186:6838/91602342 2023-12-17T12:03:51.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.250+0000 7f7703fff700 1 -- 172.21.15.8:0/2176408480 <== mds.1 v2:172.21.15.186:6838/91602342 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x558c3b086ca0 con 0x558c3b150160 2023-12-17T12:03:51.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.250+0000 7f7703fff700 10 client.15156 handle_command_reply: tid=0 2023-12-17T12:03:51.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.250+0000 7f773e97cb80 1 client.15156 shutdown 2023-12-17T12:03:51.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.250+0000 7f773e97cb80 1 -- 172.21.15.8:0/2176408480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3b13ab00 msgr2=0x558c3b144920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:51.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.250+0000 7f773e97cb80 1 --2- 172.21.15.8:0/2176408480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3b13ab00 0x558c3b144920 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f771800c2d0 tx=0x7f77180a2340 comp rx=0 tx=0).stop 2023-12-17T12:03:51.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.250+0000 7f773e97cb80 1 -- 172.21.15.8:0/2176408480 shutdown_connections 2023-12-17T12:03:51.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.250+0000 7f773e97cb80 1 --2- 172.21.15.8:0/2176408480 >> [v2:172.21.15.186:6838/91602342,v1:172.21.15.186:6839/91602342] conn(0x558c3b150160 0x558c3b14ee70 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.250+0000 7f773e97cb80 1 --2- 172.21.15.8:0/2176408480 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c3b13c350 0x558c3b14bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.250+0000 7f7703fff700 0 client.15156 ms_handle_reset on v2:172.21.15.186:6838/91602342 2023-12-17T12:03:51.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.250+0000 7f773e97cb80 1 --2- 172.21.15.8:0/2176408480 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3b13ab00 0x558c3b144920 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.254 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.251+0000 7f773e97cb80 1 --2- 172.21.15.8:0/2176408480 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558c3b13b460 0x558c3b144e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.251+0000 7f773e97cb80 1 -- 172.21.15.8:0/2176408480 >> 172.21.15.8:0/2176408480 conn(0x558c3b135670 msgr2=0x558c3b134b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:51.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.251+0000 7f773e97cb80 1 -- 172.21.15.8:0/2176408480 shutdown_connections 2023-12-17T12:03:51.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.251+0000 7f773e97cb80 1 -- 172.21.15.8:0/2176408480 wait complete. 2023-12-17T12:03:51.255 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.251+0000 7f773e97cb80 20 client.15156 trim_cache size 0 max 16384 2023-12-17T12:03:51.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.270+0000 7f773e97cb80 1 Processor -- start 2023-12-17T12:03:51.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.271+0000 7f773e97cb80 1 -- start start 2023-12-17T12:03:51.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.271+0000 7f773e97cb80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c3b13ab00 0x558c3b143e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:51.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.271+0000 7f773e97cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3b13b460 0x558c3b1456b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:51.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.271+0000 7f773e97cb80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558c3b13c350 0x558c3b13c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:51.273 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.271+0000 7f773e97cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c3af0c650 con 0x558c3b13b460 2023-12-17T12:03:51.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.271+0000 7f773e97cb80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c3aff8ce0 con 0x558c3b13ab00 2023-12-17T12:03:51.274 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.271+0000 7f773e97cb80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c3b0986a0 con 0x558c3b13c350 2023-12-17T12:03:51.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.271+0000 7f7723fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3b13b460 0x558c3b1456b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:51.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.271+0000 7f7723fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3b13b460 0x558c3b1456b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52228/0 (socket says 172.21.15.8:52228) 2023-12-17T12:03:51.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.271+0000 7f7723fff700 1 -- 172.21.15.8:0/4104436160 learned_addr learned my addr 172.21.15.8:0/4104436160 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:51.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.272+0000 7f772959c700 1 --2- 172.21.15.8:0/4104436160 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558c3b13c350 0x558c3b13c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:51.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.272+0000 7f7728d9b700 1 --2- 172.21.15.8:0/4104436160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c3b13ab00 0x558c3b143e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:51.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.272+0000 7f7723fff700 1 -- 172.21.15.8:0/4104436160 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558c3b13c350 msgr2=0x558c3b13c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T12:03:51.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.272+0000 7f7723fff700 1 --2- 172.21.15.8:0/4104436160 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558c3b13c350 0x558c3b13c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.272+0000 7f7723fff700 1 -- 172.21.15.8:0/4104436160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c3b13ab00 msgr2=0x558c3b143e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T12:03:51.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.272+0000 7f7723fff700 1 --2- 172.21.15.8:0/4104436160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c3b13ab00 0x558c3b143e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.272+0000 7f7723fff700 1 -- 172.21.15.8:0/4104436160 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558c3b04f290 con 0x558c3b13b460 2023-12-17T12:03:51.275 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.272+0000 7f772959c700 1 --2- 172.21.15.8:0/4104436160 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558c3b13c350 0x558c3b13c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T12:03:51.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.272+0000 7f7723fff700 1 --2- 172.21.15.8:0/4104436160 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3b13b460 0x558c3b1456b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x558c3b151000 tx=0x7f7710014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d241c87270b5e47 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:51.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.272+0000 7f770f7fe700 1 -- 172.21.15.8:0/4104436160 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7710022040 con 0x558c3b13b460 2023-12-17T12:03:51.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.273+0000 7f770f7fe700 1 -- 172.21.15.8:0/4104436160 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7710004590 con 0x558c3b13b460 2023-12-17T12:03:51.276 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.273+0000 7f770f7fe700 1 -- 172.21.15.8:0/4104436160 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7710003ba0 con 0x558c3b13b460 2023-12-17T12:03:51.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.273+0000 7f773e97cb80 1 -- 172.21.15.8:0/4104436160 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3b13b460 msgr2=0x558c3b1456b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:51.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.273+0000 7f773e97cb80 1 --2- 172.21.15.8:0/4104436160 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3b13b460 0x558c3b1456b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x558c3b151000 tx=0x7f7710014000 comp rx=0 tx=0).stop 2023-12-17T12:03:51.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.273+0000 7f773e97cb80 1 -- 172.21.15.8:0/4104436160 shutdown_connections 2023-12-17T12:03:51.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.273+0000 7f773e97cb80 1 --2- 172.21.15.8:0/4104436160 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558c3b13c350 0x558c3b13c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.273+0000 7f773e97cb80 1 --2- 172.21.15.8:0/4104436160 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c3b13ab00 0x558c3b143e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.273+0000 7f773e97cb80 1 --2- 172.21.15.8:0/4104436160 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3b13b460 0x558c3b1456b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.273+0000 7f773e97cb80 1 -- 172.21.15.8:0/4104436160 >> 172.21.15.8:0/4104436160 conn(0x558c3b135670 msgr2=0x558c3b135a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:51.278 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.273+0000 7f773e97cb80 1 -- 172.21.15.8:0/4104436160 shutdown_connections 2023-12-17T12:03:51.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.274+0000 7f773e97cb80 1 -- 172.21.15.8:0/4104436160 wait complete. 2023-12-17T12:03:51.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.274+0000 7f773e97cb80 1 -- start start 2023-12-17T12:03:51.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.274+0000 7f773e97cb80 1 Processor -- start 2023-12-17T12:03:51.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.275+0000 7f773e97cb80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c3b13ab00 0x558c3b144ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:51.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.275+0000 7f773e97cb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3b13b460 0x558c3b14ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:51.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.275+0000 7f773e97cb80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558c3b13c350 0x558c3b14b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:51.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.275+0000 7f773e97cb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c3b14b930 con 0x558c3b13b460 2023-12-17T12:03:51.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.275+0000 7f773e97cb80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c3b14baa0 con 0x558c3b13ab00 2023-12-17T12:03:51.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.275+0000 7f773e97cb80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x558c3b14bc60 con 0x558c3b13c350 2023-12-17T12:03:51.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.275+0000 7f773e97cb80 10 client.0 _ll_register_callbacks cb 0x558c3b0353a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-17T12:03:51.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.275+0000 7f7723fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3b13b460 0x558c3b14ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:51.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.275+0000 7f7723fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3b13b460 0x558c3b14ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52238/0 (socket says 172.21.15.8:52238) 2023-12-17T12:03:51.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.275+0000 7f772959c700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558c3b13c350 0x558c3b14b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:51.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.275+0000 7f7723fff700 1 -- 172.21.15.8:0/2278270503 learned_addr learned my addr 172.21.15.8:0/2278270503 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:51.279 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.275+0000 7f7723fff700 1 -- 172.21.15.8:0/2278270503 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558c3b13c350 msgr2=0x558c3b14b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T12:03:51.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.275+0000 7f7723fff700 1 --2- 172.21.15.8:0/2278270503 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558c3b13c350 0x558c3b14b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.275+0000 7f7723fff700 1 -- 172.21.15.8:0/2278270503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c3b13ab00 msgr2=0x558c3b144ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-17T12:03:51.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.275+0000 7f7723fff700 1 --2- 172.21.15.8:0/2278270503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c3b13ab00 0x558c3b144ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.275+0000 7f7723fff700 1 -- 172.21.15.8:0/2278270503 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7710017070 con 0x558c3b13b460 2023-12-17T12:03:51.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.276+0000 7f7723fff700 1 --2- 172.21.15.8:0/2278270503 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3b13b460 0x558c3b14ae70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7710009310 tx=0x7f7710004620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e73b5a7236743a46 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:51.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.276+0000 7f7703fff700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-12-17T12:03:51.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.276+0000 7f7703fff700 1 -- 172.21.15.8:0/2278270503 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7710022050 con 0x558c3b13b460 2023-12-17T12:03:51.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.276+0000 7f7703fff700 1 -- 172.21.15.8:0/2278270503 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f7710028410 con 0x558c3b13b460 2023-12-17T12:03:51.280 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.276+0000 7f773e97cb80 1 -- 172.21.15.8:0/2278270503 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558c3b0869c0 con 0x558c3b13b460 2023-12-17T12:03:51.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.276+0000 7f7703fff700 1 -- 172.21.15.8:0/2278270503 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f771000ee90 con 0x558c3b13b460 2023-12-17T12:03:51.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.276+0000 7f773e97cb80 10 client.15162 fetch_fsmap learned FSMap version 27 2023-12-17T12:03:51.282 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.276+0000 7f773e97cb80 1 -- 172.21.15.8:0/2278270503 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x558c3af0ec80 con 0x558c3b13b460 2023-12-17T12:03:51.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.276+0000 7f7703fff700 1 -- 172.21.15.8:0/2278270503 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558c3b0869c0 con 0x558c3b13b460 2023-12-17T12:03:51.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.277+0000 7f7703fff700 1 -- 172.21.15.8:0/2278270503 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f7710043050 con 0x558c3b13b460 2023-12-17T12:03:51.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.277+0000 7f773e97cb80 10 client.15162 fetch_fsmap finished waiting for FSMap version 27 2023-12-17T12:03:51.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.277+0000 7f773e97cb80 10 client.15162 resolve_mds: resolved name 'i' to daemon mds.i 2023-12-17T12:03:51.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.277+0000 7f773e97cb80 20 client.15162 populate_metadata read hostname 'smithi008' 2023-12-17T12:03:51.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.277+0000 7f773e97cb80 1 --2- 172.21.15.8:0/2278270503 >> [v2:172.21.15.186:6838/91602342,v1:172.21.15.186:6839/91602342] conn(0x558c3b1aacb0 0x558c3b1a7110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:51.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.277+0000 7f773e97cb80 4 client.15162 mds_command: new command op to 24541 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-17T12:03:51.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.277+0000 7f773e97cb80 1 -- 172.21.15.8:0/2278270503 --> [v2:172.21.15.186:6838/91602342,v1:172.21.15.186:6839/91602342] -- command(tid 0: {"prefix": "status"}) v1 -- 0x558c3aed7ca0 con 0x558c3b1aacb0 2023-12-17T12:03:51.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.277+0000 7f7728d9b700 1 --2- 172.21.15.8:0/2278270503 >> [v2:172.21.15.186:6838/91602342,v1:172.21.15.186:6839/91602342] conn(0x558c3b1aacb0 0x558c3b1a7110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:51.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.278+0000 7f7728d9b700 1 --2- 172.21.15.8:0/2278270503 >> [v2:172.21.15.186:6838/91602342,v1:172.21.15.186:6839/91602342] conn(0x558c3b1aacb0 0x558c3b1a7110 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1884aaf879d6f022 server_cookie=18e239b2f4edf0d in_seq=0 out_seq=0 2023-12-17T12:03:51.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.278+0000 7f7703fff700 10 client.15162 ms_handle_connect on v2:172.21.15.186:6838/91602342 2023-12-17T12:03:51.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.278+0000 7f7703fff700 1 -- 172.21.15.8:0/2278270503 <== mds.1 v2:172.21.15.186:6838/91602342 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x558c3aed7ca0 con 0x558c3b1aacb0 2023-12-17T12:03:51.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.278+0000 7f7703fff700 10 client.15162 handle_command_reply: tid=0 2023-12-17T12:03:51.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.278+0000 7f773e97cb80 1 client.15162 shutdown 2023-12-17T12:03:51.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.278+0000 7f773e97cb80 1 -- 172.21.15.8:0/2278270503 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3b13b460 msgr2=0x558c3b14ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:51.283 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.278+0000 7f773e97cb80 1 --2- 172.21.15.8:0/2278270503 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3b13b460 0x558c3b14ae70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7710009310 tx=0x7f7710004620 comp rx=0 tx=0).stop 2023-12-17T12:03:51.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.278+0000 7f773e97cb80 1 -- 172.21.15.8:0/2278270503 shutdown_connections 2023-12-17T12:03:51.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.278+0000 7f773e97cb80 1 --2- 172.21.15.8:0/2278270503 >> [v2:172.21.15.186:6838/91602342,v1:172.21.15.186:6839/91602342] conn(0x558c3b1aacb0 0x558c3b1a7110 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.278+0000 7f773e97cb80 1 --2- 172.21.15.8:0/2278270503 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x558c3b13c350 0x558c3b14b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.278+0000 7f7703fff700 0 client.15162 ms_handle_reset on v2:172.21.15.186:6838/91602342 2023-12-17T12:03:51.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.278+0000 7f773e97cb80 1 --2- 172.21.15.8:0/2278270503 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x558c3b13ab00 0x558c3b144ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.278+0000 7f773e97cb80 1 --2- 172.21.15.8:0/2278270503 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x558c3b13b460 0x558c3b14ae70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.278+0000 7f773e97cb80 1 -- 172.21.15.8:0/2278270503 >> 172.21.15.8:0/2278270503 conn(0x558c3b135670 msgr2=0x558c3b158ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:51.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.278+0000 7f773e97cb80 1 -- 172.21.15.8:0/2278270503 shutdown_connections 2023-12-17T12:03:51.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.278+0000 7f773e97cb80 1 -- 172.21.15.8:0/2278270503 wait complete. 2023-12-17T12:03:51.284 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.279+0000 7f773e97cb80 20 client.15162 trim_cache size 0 max 16384 2023-12-17T12:03:51.284 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-12-17T12:03:51.284 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "f43f508a-9cd2-11ee-95a5-87774f69a715", 2023-12-17T12:03:51.285 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 1, 2023-12-17T12:03:51.285 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 24541, 2023-12-17T12:03:51.285 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-12-17T12:03:51.285 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-12-17T12:03:51.285 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-12-17T12:03:51.285 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 57.278493644000001, 2023-12-17T12:03:51.285 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 27, 2023-12-17T12:03:51.285 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 85, 2023-12-17T12:03:51.285 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 83, 2023-12-17T12:03:51.285 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 74.959547168 2023-12-17T12:03:51.285 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-12-17T12:03:51.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.279+0000 7f772afff700 1 -- 172.21.15.8:0/3690395177 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f77140a1510 msgr2=0x7f77140a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:51.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.279+0000 7f772afff700 1 --2- 172.21.15.8:0/3690395177 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f77140a1510 0x7f77140a39d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f7710009c60 tx=0x7f7710009260 comp rx=0 tx=0).stop 2023-12-17T12:03:51.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.279+0000 7f772afff700 1 -- 172.21.15.8:0/3690395177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7724102000 msgr2=0x7f77241996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:51.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.279+0000 7f772afff700 1 --2- 172.21.15.8:0/3690395177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7724102000 0x7f77241996d0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f771800e9a0 tx=0x7f771800ecb0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.279+0000 7f772afff700 1 -- 172.21.15.8:0/3690395177 shutdown_connections 2023-12-17T12:03:51.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.279+0000 7f772afff700 1 --2- 172.21.15.8:0/3690395177 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f77140a1510 0x7f77140a39d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.279+0000 7f772afff700 1 --2- 172.21.15.8:0/3690395177 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7724107260 0x7f77241a0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.279+0000 7f772afff700 1 --2- 172.21.15.8:0/3690395177 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f7724102000 0x7f77241996d0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.286 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.279+0000 7f772afff700 1 --2- 172.21.15.8:0/3690395177 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f7724104930 0x7f7724199c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.279+0000 7f772afff700 1 -- 172.21.15.8:0/3690395177 >> 172.21.15.8:0/3690395177 conn(0x7f77240fb9f0 msgr2=0x7f77241016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:51.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.280+0000 7f772afff700 1 -- 172.21.15.8:0/3690395177 shutdown_connections 2023-12-17T12:03:51.287 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.280+0000 7f772afff700 1 -- 172.21.15.8:0/3690395177 wait complete. 2023-12-17T12:03:51.298 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:51 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:03:51.298 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:51 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/373606118' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:03:51.301 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-17T12:03:51.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:51 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:03:51.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:51 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/373606118' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:03:51.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:51 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-12-17T12:03:51.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:51 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/373606118' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:03:51.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.519+0000 7f08c33ff700 1 -- 172.21.15.8:0/2164002016 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08bc1015a0 msgr2=0x7f08bc1019c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:51.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.519+0000 7f08c33ff700 1 --2- 172.21.15.8:0/2164002016 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08bc1015a0 0x7f08bc1019c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f08b80099c0 tx=0x7f08b8009cd0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.519+0000 7f08c33ff700 1 -- 172.21.15.8:0/2164002016 shutdown_connections 2023-12-17T12:03:51.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.519+0000 7f08c33ff700 1 --2- 172.21.15.8:0/2164002016 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08bc103130 0x7f08bc1099e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.519+0000 7f08c33ff700 1 --2- 172.21.15.8:0/2164002016 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08bc1015a0 0x7f08bc1019c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.519+0000 7f08c33ff700 1 --2- 172.21.15.8:0/2164002016 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08bc102790 0x7f08bc102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.519+0000 7f08c33ff700 1 -- 172.21.15.8:0/2164002016 >> 172.21.15.8:0/2164002016 conn(0x7f08bc0fcb10 msgr2=0x7f08bc0fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:51.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.519+0000 7f08c33ff700 1 -- 172.21.15.8:0/2164002016 shutdown_connections 2023-12-17T12:03:51.522 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.519+0000 7f08c33ff700 1 -- 172.21.15.8:0/2164002016 wait complete. 2023-12-17T12:03:51.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.520+0000 7f08c33ff700 1 Processor -- start 2023-12-17T12:03:51.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.521+0000 7f08c33ff700 1 -- start start 2023-12-17T12:03:51.523 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.521+0000 7f08c33ff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08bc1015a0 0x7f08bc075330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:51.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.521+0000 7f08c33ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08bc102790 0x7f08bc0739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:51.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.521+0000 7f08c33ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08bc103130 0x7f08bc073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:51.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.521+0000 7f08c33ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc19b370 con 0x7f08bc102790 2023-12-17T12:03:51.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.521+0000 7f08c33ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc074440 con 0x7f08bc103130 2023-12-17T12:03:51.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.521+0000 7f08c33ff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08bc074600 con 0x7f08bc1015a0 2023-12-17T12:03:51.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.521+0000 7f08c099a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08bc102790 0x7f08bc0739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:51.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.521+0000 7f08c119b700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08bc1015a0 0x7f08bc075330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:51.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.521+0000 7f08c099a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08bc102790 0x7f08bc0739c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52258/0 (socket says 172.21.15.8:52258) 2023-12-17T12:03:51.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.521+0000 7f08c099a700 1 -- 172.21.15.8:0/4191688233 learned_addr learned my addr 172.21.15.8:0/4191688233 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:51.524 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.521+0000 7f08c199c700 1 --2- 172.21.15.8:0/4191688233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08bc103130 0x7f08bc073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:51.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.521+0000 7f08c099a700 1 -- 172.21.15.8:0/4191688233 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08bc1015a0 msgr2=0x7f08bc075330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:51.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.521+0000 7f08c099a700 1 --2- 172.21.15.8:0/4191688233 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08bc1015a0 0x7f08bc075330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.522+0000 7f08c099a700 1 -- 172.21.15.8:0/4191688233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08bc103130 msgr2=0x7f08bc073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:51.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.522+0000 7f08c099a700 1 --2- 172.21.15.8:0/4191688233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08bc103130 0x7f08bc073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.522+0000 7f08c099a700 1 -- 172.21.15.8:0/4191688233 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b80095f0 con 0x7f08bc102790 2023-12-17T12:03:51.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.522+0000 7f08c099a700 1 --2- 172.21.15.8:0/4191688233 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08bc102790 0x7f08bc0739c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f08ac00e9a0 tx=0x7f08ac00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:51.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.522+0000 7f08b27fc700 1 -- 172.21.15.8:0/4191688233 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac009790 con 0x7f08bc102790 2023-12-17T12:03:51.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.522+0000 7f08b27fc700 1 -- 172.21.15.8:0/4191688233 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f08ac010430 con 0x7f08bc102790 2023-12-17T12:03:51.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.522+0000 7f08b27fc700 1 -- 172.21.15.8:0/4191688233 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac00cea0 con 0x7f08bc102790 2023-12-17T12:03:51.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.522+0000 7f08c33ff700 1 -- 172.21.15.8:0/4191688233 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08bc1a5d20 con 0x7f08bc102790 2023-12-17T12:03:51.526 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.522+0000 7f08c33ff700 1 -- 172.21.15.8:0/4191688233 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08bc1a6090 con 0x7f08bc102790 2023-12-17T12:03:51.528 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.526+0000 7f08b27fc700 1 -- 172.21.15.8:0/4191688233 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f08ac0105a0 con 0x7f08bc102790 2023-12-17T12:03:51.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.527+0000 7f08b27fc700 1 --2- 172.21.15.8:0/4191688233 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f08a80a1510 0x7f08a80a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:51.529 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.527+0000 7f08b27fc700 1 -- 172.21.15.8:0/4191688233 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f08ac014070 con 0x7f08bc102790 2023-12-17T12:03:51.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.527+0000 7f08c119b700 1 --2- 172.21.15.8:0/4191688233 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f08a80a1510 0x7f08a80a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:51.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.528+0000 7f08c119b700 1 --2- 172.21.15.8:0/4191688233 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f08a80a1510 0x7f08a80a39d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f08b8009990 tx=0x7f08b8003680 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:51.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.528+0000 7f08d6d5eb80 1 Processor -- start 2023-12-17T12:03:51.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.529+0000 7f08d6d5eb80 1 -- start start 2023-12-17T12:03:51.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.529+0000 7f08d6d5eb80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55860bf2db00 0x55860bf2df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:51.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.529+0000 7f08d6d5eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55860bf2e460 0x55860bf2ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:51.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.529+0000 7f08d6d5eb80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55860bf2f350 0x55860bf2f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:51.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.529+0000 7f08d6d5eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55860bea5420 con 0x55860bf2e460 2023-12-17T12:03:51.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.529+0000 7f08d6d5eb80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55860be87c00 con 0x55860bf2f350 2023-12-17T12:03:51.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.529+0000 7f08d6d5eb80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55860be85520 con 0x55860bf2db00 2023-12-17T12:03:51.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.530+0000 7f08c119b700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55860bf2db00 0x55860bf2df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:51.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.530+0000 7f08c099a700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55860bf2e460 0x55860bf2ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:51.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.530+0000 7f08c119b700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55860bf2db00 0x55860bf2df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.8:46540/0 (socket says 172.21.15.8:46540) 2023-12-17T12:03:51.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.530+0000 7f08c119b700 1 -- 172.21.15.8:0/645288794 learned_addr learned my addr 172.21.15.8:0/645288794 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:51.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.530+0000 7f08c199c700 1 --2- 172.21.15.8:0/645288794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55860bf2f350 0x55860bf2f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:51.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.530+0000 7f08c119b700 1 -- 172.21.15.8:0/645288794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55860bf2f350 msgr2=0x55860bf2f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T12:03:51.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.530+0000 7f08c119b700 1 --2- 172.21.15.8:0/645288794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55860bf2f350 0x55860bf2f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.530+0000 7f08c119b700 1 -- 172.21.15.8:0/645288794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55860bf2e460 msgr2=0x55860bf2ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T12:03:51.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.530+0000 7f08c119b700 1 --2- 172.21.15.8:0/645288794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55860bf2e460 0x55860bf2ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.533 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.530+0000 7f08c119b700 1 -- 172.21.15.8:0/645288794 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55860bee2b50 con 0x55860bf2db00 2023-12-17T12:03:51.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.530+0000 7f08c119b700 1 --2- 172.21.15.8:0/645288794 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55860bf2db00 0x55860bf2df20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f08bc1025f0 tx=0x7f08b801f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f86be45c850f2931 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:51.534 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.531+0000 7f08a77fe700 1 -- 172.21.15.8:0/645288794 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b8029070 con 0x55860bf2db00 2023-12-17T12:03:51.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.531+0000 7f08a77fe700 1 -- 172.21.15.8:0/645288794 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f08b801e040 con 0x55860bf2db00 2023-12-17T12:03:51.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.531+0000 7f08a77fe700 1 -- 172.21.15.8:0/645288794 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b800f680 con 0x55860bf2db00 2023-12-17T12:03:51.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.532+0000 7f08d6d5eb80 1 -- 172.21.15.8:0/645288794 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55860bf2db00 msgr2=0x55860bf2df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:51.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.532+0000 7f08d6d5eb80 1 --2- 172.21.15.8:0/645288794 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55860bf2db00 0x55860bf2df20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f08bc1025f0 tx=0x7f08b801f000 comp rx=0 tx=0).stop 2023-12-17T12:03:51.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.532+0000 7f08d6d5eb80 1 -- 172.21.15.8:0/645288794 shutdown_connections 2023-12-17T12:03:51.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.532+0000 7f08d6d5eb80 1 --2- 172.21.15.8:0/645288794 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55860bf2f350 0x55860bf2f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.532+0000 7f08d6d5eb80 1 --2- 172.21.15.8:0/645288794 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55860bf2db00 0x55860bf2df20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.532+0000 7f08d6d5eb80 1 --2- 172.21.15.8:0/645288794 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55860bf2e460 0x55860bf2ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.532+0000 7f08d6d5eb80 1 -- 172.21.15.8:0/645288794 >> 172.21.15.8:0/645288794 conn(0x55860bf28670 msgr2=0x55860bf28a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:51.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.532+0000 7f08d6d5eb80 1 -- 172.21.15.8:0/645288794 shutdown_connections 2023-12-17T12:03:51.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.532+0000 7f08d6d5eb80 1 -- 172.21.15.8:0/645288794 wait complete. 2023-12-17T12:03:51.535 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.532+0000 7f08d6d5eb80 1 -- start start 2023-12-17T12:03:51.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.533+0000 7f08d6d5eb80 1 Processor -- start 2023-12-17T12:03:51.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.533+0000 7f08d6d5eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55860bf2db00 0x55860bf37800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:51.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.533+0000 7f08d6d5eb80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55860bf2e460 0x55860bf37d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:51.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.533+0000 7f08d6d5eb80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55860bf2f350 0x55860bf3ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:51.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.533+0000 7f08d6d5eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55860be80e10 con 0x55860bf2db00 2023-12-17T12:03:51.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.533+0000 7f08d6d5eb80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55860be20000 con 0x55860bf2e460 2023-12-17T12:03:51.538 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.533+0000 7f08d6d5eb80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55860be1fca0 con 0x55860bf2f350 2023-12-17T12:03:51.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.533+0000 7f08d6d5eb80 10 client.0 _ll_register_callbacks cb 0x55860be283a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-17T12:03:51.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.534+0000 7f08c119b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55860bf2db00 0x55860bf37800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:51.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.534+0000 7f08c099a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55860bf2e460 0x55860bf37d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:51.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.534+0000 7f08c119b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55860bf2db00 0x55860bf37800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52262/0 (socket says 172.21.15.8:52262) 2023-12-17T12:03:51.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.534+0000 7f08c119b700 1 -- 172.21.15.8:0/1118280459 learned_addr learned my addr 172.21.15.8:0/1118280459 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:51.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.534+0000 7f08c199c700 1 --2- 172.21.15.8:0/1118280459 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55860bf2f350 0x55860bf3ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:51.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.534+0000 7f08c119b700 1 -- 172.21.15.8:0/1118280459 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55860bf2f350 msgr2=0x55860bf3ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T12:03:51.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.534+0000 7f08c119b700 1 --2- 172.21.15.8:0/1118280459 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55860bf2f350 0x55860bf3ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.534+0000 7f08c119b700 1 -- 172.21.15.8:0/1118280459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55860bf2e460 msgr2=0x55860bf37d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T12:03:51.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.534+0000 7f08c119b700 1 --2- 172.21.15.8:0/1118280459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55860bf2e460 0x55860bf37d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.534+0000 7f08c119b700 1 -- 172.21.15.8:0/1118280459 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08bc10a330 con 0x55860bf2db00 2023-12-17T12:03:51.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.534+0000 7f08c099a700 1 --2- 172.21.15.8:0/1118280459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55860bf2e460 0x55860bf37d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T12:03:51.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.534+0000 7f08c199c700 1 --2- 172.21.15.8:0/1118280459 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55860bf2f350 0x55860bf3ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T12:03:51.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.534+0000 7f08c119b700 1 --2- 172.21.15.8:0/1118280459 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55860bf2db00 0x55860bf37800 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f08b8009d10 tx=0x7f08b800fbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26630d1948563ee6 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:51.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.534+0000 7f08a4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-12-17T12:03:51.539 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.535+0000 7f08a4ff9700 1 -- 172.21.15.8:0/1118280459 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b8029040 con 0x55860bf2db00 2023-12-17T12:03:51.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.535+0000 7f08a4ff9700 1 -- 172.21.15.8:0/1118280459 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f08b8003760 con 0x55860bf2db00 2023-12-17T12:03:51.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.535+0000 7f08d6d5eb80 1 -- 172.21.15.8:0/1118280459 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55860bf20470 con 0x55860bf2db00 2023-12-17T12:03:51.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.535+0000 7f08a4ff9700 1 -- 172.21.15.8:0/1118280459 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08b8005720 con 0x55860bf2db00 2023-12-17T12:03:51.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.535+0000 7f08d6d5eb80 10 client.15174 fetch_fsmap learned FSMap version 27 2023-12-17T12:03:51.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.535+0000 7f08d6d5eb80 1 -- 172.21.15.8:0/1118280459 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55860bca9b10 con 0x55860bf2db00 2023-12-17T12:03:51.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.535+0000 7f08a4ff9700 1 -- 172.21.15.8:0/1118280459 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55860bf20470 con 0x55860bf2db00 2023-12-17T12:03:51.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.535+0000 7f08a4ff9700 1 -- 172.21.15.8:0/1118280459 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f08b803f050 con 0x55860bf2db00 2023-12-17T12:03:51.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.535+0000 7f08d6d5eb80 10 client.15174 fetch_fsmap finished waiting for FSMap version 27 2023-12-17T12:03:51.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.536+0000 7f08d6d5eb80 10 client.15174 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-17T12:03:51.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.536+0000 7f08d6d5eb80 20 client.15174 populate_metadata read hostname 'smithi008' 2023-12-17T12:03:51.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.536+0000 7f08d6d5eb80 1 --2- 172.21.15.8:0/1118280459 >> [v2:172.21.15.100:6838/3921737538,v1:172.21.15.100:6839/3921737538] conn(0x55860bf42f90 0x55860bf41d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:51.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.536+0000 7f08d6d5eb80 4 client.15174 mds_command: new command op to 24569 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-17T12:03:51.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.536+0000 7f08d6d5eb80 1 -- 172.21.15.8:0/1118280459 --> [v2:172.21.15.100:6838/3921737538,v1:172.21.15.100:6839/3921737538] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55860be79ca0 con 0x55860bf42f90 2023-12-17T12:03:51.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.536+0000 7f08c099a700 1 --2- 172.21.15.8:0/1118280459 >> [v2:172.21.15.100:6838/3921737538,v1:172.21.15.100:6839/3921737538] conn(0x55860bf42f90 0x55860bf41d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:51.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.536+0000 7f08c099a700 1 --2- 172.21.15.8:0/1118280459 >> [v2:172.21.15.100:6838/3921737538,v1:172.21.15.100:6839/3921737538] conn(0x55860bf42f90 0x55860bf41d50 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d37550c228400778 server_cookie=2e58fff1f0b384cb in_seq=0 out_seq=0 2023-12-17T12:03:51.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.536+0000 7f08a4ff9700 10 client.15174 ms_handle_connect on v2:172.21.15.100:6838/3921737538 2023-12-17T12:03:51.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.537+0000 7f08a4ff9700 1 -- 172.21.15.8:0/1118280459 <== mds.0 v2:172.21.15.100:6838/3921737538 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x55860be79ca0 con 0x55860bf42f90 2023-12-17T12:03:51.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.537+0000 7f08a4ff9700 10 client.15174 handle_command_reply: tid=0 2023-12-17T12:03:51.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.537+0000 7f08d6d5eb80 1 client.15174 shutdown 2023-12-17T12:03:51.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.538+0000 7f08d6d5eb80 1 -- 172.21.15.8:0/1118280459 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55860bf2db00 msgr2=0x55860bf37800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:51.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.538+0000 7f08d6d5eb80 1 --2- 172.21.15.8:0/1118280459 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55860bf2db00 0x55860bf37800 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f08b8009d10 tx=0x7f08b800fbf0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.538+0000 7f08d6d5eb80 1 -- 172.21.15.8:0/1118280459 shutdown_connections 2023-12-17T12:03:51.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.538+0000 7f08d6d5eb80 1 --2- 172.21.15.8:0/1118280459 >> [v2:172.21.15.100:6838/3921737538,v1:172.21.15.100:6839/3921737538] conn(0x55860bf42f90 0x55860bf41d50 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.538+0000 7f08d6d5eb80 1 --2- 172.21.15.8:0/1118280459 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55860bf2f350 0x55860bf3ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.538+0000 7f08a4ff9700 0 client.15174 ms_handle_reset on v2:172.21.15.100:6838/3921737538 2023-12-17T12:03:51.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.538+0000 7f08d6d5eb80 1 --2- 172.21.15.8:0/1118280459 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55860bf2db00 0x55860bf37800 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.542 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.538+0000 7f08d6d5eb80 1 --2- 172.21.15.8:0/1118280459 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55860bf2e460 0x55860bf37d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.538+0000 7f08d6d5eb80 1 -- 172.21.15.8:0/1118280459 >> 172.21.15.8:0/1118280459 conn(0x55860bf28670 msgr2=0x55860bf27b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:51.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.538+0000 7f08d6d5eb80 1 -- 172.21.15.8:0/1118280459 shutdown_connections 2023-12-17T12:03:51.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.538+0000 7f08d6d5eb80 1 -- 172.21.15.8:0/1118280459 wait complete. 2023-12-17T12:03:51.543 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.538+0000 7f08d6d5eb80 20 client.15174 trim_cache size 0 max 16384 2023-12-17T12:03:51.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.558+0000 7f08d6d5eb80 1 Processor -- start 2023-12-17T12:03:51.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.558+0000 7f08d6d5eb80 1 -- start start 2023-12-17T12:03:51.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.558+0000 7f08d6d5eb80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55860bf2db00 0x55860bf2f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:51.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.558+0000 7f08d6d5eb80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55860bf2e460 0x55860bf3ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:51.560 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.558+0000 7f08d6d5eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55860bf2f350 0x55860bf358d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:51.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.558+0000 7f08d6d5eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55860bcff650 con 0x55860bf2f350 2023-12-17T12:03:51.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.558+0000 7f08d6d5eb80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55860bf40a90 con 0x55860bf2e460 2023-12-17T12:03:51.561 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.558+0000 7f08d6d5eb80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55860bf38700 con 0x55860bf2db00 2023-12-17T12:03:51.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.558+0000 7f08c099a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55860bf2e460 0x55860bf3ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:51.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.558+0000 7f08c199c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55860bf2f350 0x55860bf358d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:51.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.558+0000 7f08c119b700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55860bf2db00 0x55860bf2f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:51.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.558+0000 7f08c099a700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55860bf2e460 0x55860bf3ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.100:3300/0 says I am v2:172.21.15.8:45618/0 (socket says 172.21.15.8:45618) 2023-12-17T12:03:51.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.558+0000 7f08c099a700 1 -- 172.21.15.8:0/2610150639 learned_addr learned my addr 172.21.15.8:0/2610150639 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:51.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.558+0000 7f08c199c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55860bf2f350 0x55860bf358d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52270/0 (socket says 172.21.15.8:52270) 2023-12-17T12:03:51.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.559+0000 7f08c099a700 1 -- 172.21.15.8:0/2610150639 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55860bf2db00 msgr2=0x55860bf2f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T12:03:51.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.559+0000 7f08c099a700 1 --2- 172.21.15.8:0/2610150639 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55860bf2db00 0x55860bf2f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.559+0000 7f08c099a700 1 -- 172.21.15.8:0/2610150639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55860bf2f350 msgr2=0x55860bf358d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T12:03:51.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.559+0000 7f08c099a700 1 --2- 172.21.15.8:0/2610150639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55860bf2f350 0x55860bf358d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.559+0000 7f08c099a700 1 -- 172.21.15.8:0/2610150639 --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55860be42290 con 0x55860bf2e460 2023-12-17T12:03:51.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.559+0000 7f08c119b700 1 --2- 172.21.15.8:0/2610150639 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55860bf2db00 0x55860bf2f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-17T12:03:51.562 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.559+0000 7f08c099a700 1 --2- 172.21.15.8:0/2610150639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55860bf2e460 0x55860bf3ed40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f08ac096700 tx=0x7f08ac00c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19cd571c88ef1fdb server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:51.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.559+0000 7f08a7fff700 1 -- 172.21.15.8:0/2610150639 <== mon.2 v2:172.21.15.100:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac09a900 con 0x55860bf2e460 2023-12-17T12:03:51.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.559+0000 7f08a7fff700 1 -- 172.21.15.8:0/2610150639 <== mon.2 v2:172.21.15.100:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f08ac09a200 con 0x55860bf2e460 2023-12-17T12:03:51.563 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.559+0000 7f08a7fff700 1 -- 172.21.15.8:0/2610150639 <== mon.2 v2:172.21.15.100:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08ac0a2100 con 0x55860bf2e460 2023-12-17T12:03:51.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.560+0000 7f08d6d5eb80 1 -- 172.21.15.8:0/2610150639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55860bf2e460 msgr2=0x55860bf3ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:51.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.560+0000 7f08d6d5eb80 1 --2- 172.21.15.8:0/2610150639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55860bf2e460 0x55860bf3ed40 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f08ac096700 tx=0x7f08ac00c480 comp rx=0 tx=0).stop 2023-12-17T12:03:51.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.560+0000 7f08d6d5eb80 1 -- 172.21.15.8:0/2610150639 shutdown_connections 2023-12-17T12:03:51.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.560+0000 7f08d6d5eb80 1 --2- 172.21.15.8:0/2610150639 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55860bf2f350 0x55860bf358d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.560+0000 7f08d6d5eb80 1 --2- 172.21.15.8:0/2610150639 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55860bf2db00 0x55860bf2f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.560+0000 7f08d6d5eb80 1 --2- 172.21.15.8:0/2610150639 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55860bf2e460 0x55860bf3ed40 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.565 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.560+0000 7f08d6d5eb80 1 -- 172.21.15.8:0/2610150639 >> 172.21.15.8:0/2610150639 conn(0x55860bf28670 msgr2=0x55860bf28a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:51.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.560+0000 7f08d6d5eb80 1 -- 172.21.15.8:0/2610150639 shutdown_connections 2023-12-17T12:03:51.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.560+0000 7f08d6d5eb80 1 -- 172.21.15.8:0/2610150639 wait complete. 2023-12-17T12:03:51.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.561+0000 7f08d6d5eb80 1 -- start start 2023-12-17T12:03:51.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.561+0000 7f08d6d5eb80 1 Processor -- start 2023-12-17T12:03:51.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.561+0000 7f08d6d5eb80 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55860bf2db00 0x55860bf37800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:51.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.561+0000 7f08d6d5eb80 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55860bf2e460 0x55860bf37d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:51.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.561+0000 7f08d6d5eb80 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55860bf2f350 0x55860bf3dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:51.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.561+0000 7f08d6d5eb80 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x55860bf3e2d0 con 0x55860bf2db00 2023-12-17T12:03:51.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.561+0000 7f08d6d5eb80 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x55860bf3e410 con 0x55860bf2f350 2023-12-17T12:03:51.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.561+0000 7f08d6d5eb80 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x55860bf3e5d0 con 0x55860bf2e460 2023-12-17T12:03:51.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.561+0000 7f08d6d5eb80 10 client.0 _ll_register_callbacks cb 0x55860be283a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-17T12:03:51.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.562+0000 7f08c119b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55860bf2db00 0x55860bf37800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:51.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.562+0000 7f08c119b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55860bf2db00 0x55860bf37800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52282/0 (socket says 172.21.15.8:52282) 2023-12-17T12:03:51.566 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.562+0000 7f08c099a700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55860bf2e460 0x55860bf37d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:51.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.562+0000 7f08c119b700 1 -- 172.21.15.8:0/3674123062 learned_addr learned my addr 172.21.15.8:0/3674123062 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:51.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.562+0000 7f08c199c700 1 --2- 172.21.15.8:0/3674123062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55860bf2f350 0x55860bf3dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:51.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.562+0000 7f08c119b700 1 -- 172.21.15.8:0/3674123062 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55860bf2e460 msgr2=0x55860bf37d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T12:03:51.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.562+0000 7f08c119b700 1 --2- 172.21.15.8:0/3674123062 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55860bf2e460 0x55860bf37d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.562+0000 7f08c119b700 1 -- 172.21.15.8:0/3674123062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55860bf2f350 msgr2=0x55860bf3dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-17T12:03:51.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.562+0000 7f08c119b700 1 --2- 172.21.15.8:0/3674123062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55860bf2f350 0x55860bf3dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.562+0000 7f08c119b700 1 -- 172.21.15.8:0/3674123062 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55860bca9b10 con 0x55860bf2db00 2023-12-17T12:03:51.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.562+0000 7f08c119b700 1 --2- 172.21.15.8:0/3674123062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55860bf2db00 0x55860bf37800 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f08b8006010 tx=0x7f08b8003d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8115aecee8ba8324 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:51.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.562+0000 7f08a4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.8:3300/0 2023-12-17T12:03:51.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.562+0000 7f08a4ff9700 1 -- 172.21.15.8:0/3674123062 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b8029040 con 0x55860bf2db00 2023-12-17T12:03:51.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.563+0000 7f08a4ff9700 1 -- 172.21.15.8:0/3674123062 <== mon.0 v2:172.21.15.8:3300/0 2 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f08b8003760 con 0x55860bf2db00 2023-12-17T12:03:51.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.563+0000 7f08d6d5eb80 1 -- 172.21.15.8:0/3674123062 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f08b801e040 con 0x55860bf2db00 2023-12-17T12:03:51.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.563+0000 7f08a4ff9700 1 -- 172.21.15.8:0/3674123062 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f08b800fc60 con 0x55860bf2db00 2023-12-17T12:03:51.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.563+0000 7f08d6d5eb80 10 client.15180 fetch_fsmap learned FSMap version 27 2023-12-17T12:03:51.567 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.563+0000 7f08d6d5eb80 1 -- 172.21.15.8:0/3674123062 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f08bc1a6090 con 0x55860bf2db00 2023-12-17T12:03:51.568 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.563+0000 7f08a4ff9700 1 -- 172.21.15.8:0/3674123062 <== mon.0 v2:172.21.15.8:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f08b8052020 con 0x55860bf2db00 2023-12-17T12:03:51.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.563+0000 7f08a4ff9700 1 -- 172.21.15.8:0/3674123062 <== mon.0 v2:172.21.15.8:3300/0 5 ==== fsmap(e 27) v1 ==== 7882+0+0 (secure 0 0 0) 0x7f08b803f030 con 0x55860bf2db00 2023-12-17T12:03:51.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.563+0000 7f08d6d5eb80 10 client.15180 fetch_fsmap finished waiting for FSMap version 27 2023-12-17T12:03:51.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.563+0000 7f08d6d5eb80 10 client.15180 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-17T12:03:51.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.563+0000 7f08d6d5eb80 20 client.15180 populate_metadata read hostname 'smithi008' 2023-12-17T12:03:51.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.563+0000 7f08d6d5eb80 1 --2- 172.21.15.8:0/3674123062 >> [v2:172.21.15.100:6838/3921737538,v1:172.21.15.100:6839/3921737538] conn(0x55860bf9d320 0x55860bf99740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:51.569 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.563+0000 7f08d6d5eb80 4 client.15180 mds_command: new command op to 24569 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-17T12:03:51.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.563+0000 7f08d6d5eb80 1 -- 172.21.15.8:0/3674123062 --> [v2:172.21.15.100:6838/3921737538,v1:172.21.15.100:6839/3921737538] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55860be799c0 con 0x55860bf9d320 2023-12-17T12:03:51.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.564+0000 7f08c099a700 1 --2- 172.21.15.8:0/3674123062 >> [v2:172.21.15.100:6838/3921737538,v1:172.21.15.100:6839/3921737538] conn(0x55860bf9d320 0x55860bf99740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:51.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.564+0000 7f08a4ff9700 10 client.15180 ms_handle_connect on v2:172.21.15.100:6838/3921737538 2023-12-17T12:03:51.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.564+0000 7f08c099a700 1 --2- 172.21.15.8:0/3674123062 >> [v2:172.21.15.100:6838/3921737538,v1:172.21.15.100:6839/3921737538] conn(0x55860bf9d320 0x55860bf99740 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e4195acae8de03b server_cookie=8a5cf6df1135d2ee in_seq=0 out_seq=0 2023-12-17T12:03:51.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.565+0000 7f08a4ff9700 1 -- 172.21.15.8:0/3674123062 <== mds.0 v2:172.21.15.100:6838/3921737538 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55860be799c0 con 0x55860bf9d320 2023-12-17T12:03:51.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.565+0000 7f08a4ff9700 10 client.15180 handle_command_reply: tid=0 2023-12-17T12:03:51.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.565+0000 7f08d6d5eb80 1 client.15180 shutdown 2023-12-17T12:03:51.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.565+0000 7f08d6d5eb80 1 -- 172.21.15.8:0/3674123062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55860bf2db00 msgr2=0x55860bf37800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:51.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.565+0000 7f08d6d5eb80 1 --2- 172.21.15.8:0/3674123062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55860bf2db00 0x55860bf37800 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f08b8006010 tx=0x7f08b8003d60 comp rx=0 tx=0).stop 2023-12-17T12:03:51.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.565+0000 7f08d6d5eb80 1 -- 172.21.15.8:0/3674123062 shutdown_connections 2023-12-17T12:03:51.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.565+0000 7f08d6d5eb80 1 --2- 172.21.15.8:0/3674123062 >> [v2:172.21.15.100:6838/3921737538,v1:172.21.15.100:6839/3921737538] conn(0x55860bf9d320 0x55860bf99740 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.565+0000 7f08d6d5eb80 1 --2- 172.21.15.8:0/3674123062 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x55860bf2f350 0x55860bf3dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.565+0000 7f08d6d5eb80 1 --2- 172.21.15.8:0/3674123062 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x55860bf2db00 0x55860bf37800 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.565+0000 7f08d6d5eb80 1 --2- 172.21.15.8:0/3674123062 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55860bf2e460 0x55860bf37d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.565+0000 7f08a4ff9700 0 client.15180 ms_handle_reset on v2:172.21.15.100:6838/3921737538 2023-12-17T12:03:51.570 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.565+0000 7f08d6d5eb80 1 -- 172.21.15.8:0/3674123062 >> 172.21.15.8:0/3674123062 conn(0x55860bf28670 msgr2=0x55860bf35890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:51.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.565+0000 7f08d6d5eb80 1 -- 172.21.15.8:0/3674123062 shutdown_connections 2023-12-17T12:03:51.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.565+0000 7f08d6d5eb80 1 -- 172.21.15.8:0/3674123062 wait complete. 2023-12-17T12:03:51.571 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.565+0000 7f08d6d5eb80 20 client.15180 trim_cache size 0 max 16384 2023-12-17T12:03:51.571 INFO:teuthology.orchestra.run.smithi008.stdout:{ 2023-12-17T12:03:51.571 INFO:teuthology.orchestra.run.smithi008.stdout: "cluster_fsid": "f43f508a-9cd2-11ee-95a5-87774f69a715", 2023-12-17T12:03:51.571 INFO:teuthology.orchestra.run.smithi008.stdout: "whoami": 0, 2023-12-17T12:03:51.571 INFO:teuthology.orchestra.run.smithi008.stdout: "id": 24569, 2023-12-17T12:03:51.571 INFO:teuthology.orchestra.run.smithi008.stdout: "want_state": "up:active", 2023-12-17T12:03:51.571 INFO:teuthology.orchestra.run.smithi008.stdout: "state": "up:active", 2023-12-17T12:03:51.571 INFO:teuthology.orchestra.run.smithi008.stdout: "fs_name": "cephfs", 2023-12-17T12:03:51.571 INFO:teuthology.orchestra.run.smithi008.stdout: "rank_uptime": 60.589664319999997, 2023-12-17T12:03:51.571 INFO:teuthology.orchestra.run.smithi008.stdout: "mdsmap_epoch": 27, 2023-12-17T12:03:51.572 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch": 85, 2023-12-17T12:03:51.572 INFO:teuthology.orchestra.run.smithi008.stdout: "osdmap_epoch_barrier": 83, 2023-12-17T12:03:51.572 INFO:teuthology.orchestra.run.smithi008.stdout: "uptime": 67.409342839999994 2023-12-17T12:03:51.572 INFO:teuthology.orchestra.run.smithi008.stdout:} 2023-12-17T12:03:51.572 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.566+0000 7f08c33ff700 1 -- 172.21.15.8:0/4191688233 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f08a80a1510 msgr2=0x7f08a80a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:51.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.566+0000 7f08c33ff700 1 --2- 172.21.15.8:0/4191688233 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f08a80a1510 0x7f08a80a39d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f08b8009990 tx=0x7f08b8003680 comp rx=0 tx=0).stop 2023-12-17T12:03:51.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.566+0000 7f08c33ff700 1 -- 172.21.15.8:0/4191688233 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08bc102790 msgr2=0x7f08bc0739c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:51.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.566+0000 7f08c33ff700 1 --2- 172.21.15.8:0/4191688233 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08bc102790 0x7f08bc0739c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f08ac00e9a0 tx=0x7f08ac00ecb0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.566+0000 7f08c33ff700 1 -- 172.21.15.8:0/4191688233 shutdown_connections 2023-12-17T12:03:51.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.566+0000 7f08c33ff700 1 --2- 172.21.15.8:0/4191688233 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f08a80a1510 0x7f08a80a39d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.566+0000 7f08c33ff700 1 --2- 172.21.15.8:0/4191688233 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f08bc103130 0x7f08bc073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.566+0000 7f08c33ff700 1 --2- 172.21.15.8:0/4191688233 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08bc1015a0 0x7f08bc075330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.566+0000 7f08c33ff700 1 --2- 172.21.15.8:0/4191688233 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f08bc102790 0x7f08bc0739c0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:51.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.566+0000 7f08c33ff700 1 -- 172.21.15.8:0/4191688233 >> 172.21.15.8:0/4191688233 conn(0x7f08bc0fcb10 msgr2=0x7f08bc105c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:51.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.566+0000 7f08c33ff700 1 -- 172.21.15.8:0/4191688233 shutdown_connections 2023-12-17T12:03:51.573 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:51.566+0000 7f08c33ff700 1 -- 172.21.15.8:0/4191688233 wait complete. 2023-12-17T12:03:51.588 INFO:tasks.cephadm:Setup complete, yielding 2023-12-17T12:03:51.588 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-17T12:03:51.597 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi008.front.sepia.ceph.com 2023-12-17T12:03:51.597 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- bash -c 'ceph orch status' 2023-12-17T12:03:52.118 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:03:52.341 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:52 smithi008 ceph-mon[36830]: pgmap v297: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-12-17T12:03:52.341 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:52 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:03:52.341 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:52 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:03:52.341 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:52 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:03:52.341 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:52 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:03:52.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:52 smithi100 ceph-mon[41266]: pgmap v297: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-12-17T12:03:52.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:52 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:03:52.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:52 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:03:52.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:52 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:03:52.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:52 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:03:52.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:52 smithi186 ceph-mon[41182]: pgmap v297: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-12-17T12:03:52.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:52 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:03:52.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:52 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:03:52.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:52 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:03:52.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:52 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:03:53.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.406+0000 7ff4feb34700 1 -- 172.21.15.8:0/3914032215 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4f8075600 msgr2=0x7ff4f8073a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:53.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.406+0000 7ff4feb34700 1 --2- 172.21.15.8:0/3914032215 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4f8075600 0x7ff4f8073a60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec009990 tx=0x7ff4ec009ca0 comp rx=0 tx=0).stop 2023-12-17T12:03:53.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.406+0000 7ff4feb34700 1 -- 172.21.15.8:0/3914032215 shutdown_connections 2023-12-17T12:03:53.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.406+0000 7ff4feb34700 1 --2- 172.21.15.8:0/3914032215 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4f81094f0 0x7ff4f810b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:53.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.406+0000 7ff4feb34700 1 --2- 172.21.15.8:0/3914032215 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4f8075600 0x7ff4f8073a60 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:53.409 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.406+0000 7ff4feb34700 1 --2- 172.21.15.8:0/3914032215 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4f8074030 0x7ff4f80744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:53.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.406+0000 7ff4feb34700 1 -- 172.21.15.8:0/3914032215 >> 172.21.15.8:0/3914032215 conn(0x7ff4f80fcbe0 msgr2=0x7ff4f80ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:53.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.406+0000 7ff4feb34700 1 -- 172.21.15.8:0/3914032215 shutdown_connections 2023-12-17T12:03:53.410 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.406+0000 7ff4feb34700 1 -- 172.21.15.8:0/3914032215 wait complete. 2023-12-17T12:03:53.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.407+0000 7ff4feb34700 1 Processor -- start 2023-12-17T12:03:53.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.407+0000 7ff4feb34700 1 -- start start 2023-12-17T12:03:53.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.407+0000 7ff4feb34700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4f8074030 0x7ff4f81996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:53.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.407+0000 7ff4feb34700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4f8075600 0x7ff4f8199c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:53.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.408+0000 7ff4feb34700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4f81094f0 0x7ff4f81a0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:53.411 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.408+0000 7ff4feb34700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f81a1220 con 0x7ff4f8074030 2023-12-17T12:03:53.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.408+0000 7ff4feb34700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f81a1360 con 0x7ff4f8075600 2023-12-17T12:03:53.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.408+0000 7ff4feb34700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4f81a14f0 con 0x7ff4f81094f0 2023-12-17T12:03:53.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.408+0000 7ff4fc8d0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4f8074030 0x7ff4f81996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:53.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.408+0000 7ff4fc8d0700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4f8074030 0x7ff4f81996e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52302/0 (socket says 172.21.15.8:52302) 2023-12-17T12:03:53.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.408+0000 7ff4fc8d0700 1 -- 172.21.15.8:0/3500395348 learned_addr learned my addr 172.21.15.8:0/3500395348 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:53.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.408+0000 7ff4f7fff700 1 --2- 172.21.15.8:0/3500395348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4f8075600 0x7ff4f8199c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:53.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.408+0000 7ff4fc8d0700 1 -- 172.21.15.8:0/3500395348 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4f81094f0 msgr2=0x7ff4f81a0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:53.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.408+0000 7ff4fc8d0700 1 --2- 172.21.15.8:0/3500395348 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4f81094f0 0x7ff4f81a0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:53.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.408+0000 7ff4fc8d0700 1 -- 172.21.15.8:0/3500395348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4f8075600 msgr2=0x7ff4f8199c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:53.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.408+0000 7ff4fc8d0700 1 --2- 172.21.15.8:0/3500395348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4f8075600 0x7ff4f8199c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:53.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.408+0000 7ff4fc8d0700 1 -- 172.21.15.8:0/3500395348 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ec0095f0 con 0x7ff4f8074030 2023-12-17T12:03:53.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.408+0000 7ff4fc8d0700 1 --2- 172.21.15.8:0/3500395348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4f8074030 0x7ff4f81996e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec000c00 tx=0x7ff4ec005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:53.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.409+0000 7ff4f5ffb700 1 -- 172.21.15.8:0/3500395348 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec01d070 con 0x7ff4f8074030 2023-12-17T12:03:53.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.409+0000 7ff4feb34700 1 -- 172.21.15.8:0/3500395348 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4f81a1770 con 0x7ff4f8074030 2023-12-17T12:03:53.412 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.409+0000 7ff4f5ffb700 1 -- 172.21.15.8:0/3500395348 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff4ec003f80 con 0x7ff4f8074030 2023-12-17T12:03:53.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.409+0000 7ff4f5ffb700 1 -- 172.21.15.8:0/3500395348 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ec022ba0 con 0x7ff4f8074030 2023-12-17T12:03:53.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.409+0000 7ff4feb34700 1 -- 172.21.15.8:0/3500395348 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4f81a1b80 con 0x7ff4f8074030 2023-12-17T12:03:53.413 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.410+0000 7ff4feb34700 1 -- 172.21.15.8:0/3500395348 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4f81082b0 con 0x7ff4f8074030 2023-12-17T12:03:53.414 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.412+0000 7ff4f5ffb700 1 -- 172.21.15.8:0/3500395348 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7ff4ec003af0 con 0x7ff4f8074030 2023-12-17T12:03:53.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:53 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:03:53.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:53 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:03:53.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:53 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:03:53.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:53 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:03:53.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:53 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:03:53.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.413+0000 7ff4f5ffb700 1 --2- 172.21.15.8:0/3500395348 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7ff4e80a1510 0x7ff4e80a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:53.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.414+0000 7ff4f5ffb700 1 -- 172.21.15.8:0/3500395348 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7ff4ec0ce4f0 con 0x7ff4f8074030 2023-12-17T12:03:53.416 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.414+0000 7ff4f7fff700 1 --2- 172.21.15.8:0/3500395348 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7ff4e80a1510 0x7ff4e80a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:53.417 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.414+0000 7ff4f7fff700 1 --2- 172.21.15.8:0/3500395348 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7ff4e80a1510 0x7ff4e80a39d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8075330 tx=0x7ff4e4007400 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:53.420 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.418+0000 7ff4f5ffb700 1 -- 172.21.15.8:0/3500395348 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7ff4ec097a00 con 0x7ff4f8074030 2023-12-17T12:03:53.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:53 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:03:53.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:53 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:03:53.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:53 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:03:53.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:53 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:03:53.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:53 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:03:53.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:53 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:03:53.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:53 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:03:53.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:53 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-12-17T12:03:53.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:53 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-12-17T12:03:53.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:53 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' 2023-12-17T12:03:53.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.648+0000 7ff4feb34700 1 -- 172.21.15.8:0/3500395348 --> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4f802d3d0 con 0x7ff4e80a1510 2023-12-17T12:03:53.651 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.649+0000 7ff4f5ffb700 1 -- 172.21.15.8:0/3500395348 <== mgr.14154 v2:172.21.15.8:6800/268548699 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7ff4f802d3d0 con 0x7ff4e80a1510 2023-12-17T12:03:53.652 INFO:teuthology.orchestra.run.smithi008.stdout:Backend: cephadm 2023-12-17T12:03:53.652 INFO:teuthology.orchestra.run.smithi008.stdout:Available: Yes 2023-12-17T12:03:53.652 INFO:teuthology.orchestra.run.smithi008.stdout:Paused: No 2023-12-17T12:03:53.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.652+0000 7ff4feb34700 1 -- 172.21.15.8:0/3500395348 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7ff4e80a1510 msgr2=0x7ff4e80a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:53.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.652+0000 7ff4feb34700 1 --2- 172.21.15.8:0/3500395348 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7ff4e80a1510 0x7ff4e80a39d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8075330 tx=0x7ff4e4007400 comp rx=0 tx=0).stop 2023-12-17T12:03:53.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.652+0000 7ff4feb34700 1 -- 172.21.15.8:0/3500395348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4f8074030 msgr2=0x7ff4f81996e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:53.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.652+0000 7ff4feb34700 1 --2- 172.21.15.8:0/3500395348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4f8074030 0x7ff4f81996e0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff4ec000c00 tx=0x7ff4ec005f10 comp rx=0 tx=0).stop 2023-12-17T12:03:53.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.652+0000 7ff4feb34700 1 -- 172.21.15.8:0/3500395348 shutdown_connections 2023-12-17T12:03:53.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.652+0000 7ff4feb34700 1 --2- 172.21.15.8:0/3500395348 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7ff4e80a1510 0x7ff4e80a39d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:53.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.652+0000 7ff4feb34700 1 --2- 172.21.15.8:0/3500395348 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff4f81094f0 0x7ff4f81a0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:53.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.652+0000 7ff4feb34700 1 --2- 172.21.15.8:0/3500395348 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7ff4f8074030 0x7ff4f81996e0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:53.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.652+0000 7ff4feb34700 1 --2- 172.21.15.8:0/3500395348 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7ff4f8075600 0x7ff4f8199c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:53.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.652+0000 7ff4feb34700 1 -- 172.21.15.8:0/3500395348 >> 172.21.15.8:0/3500395348 conn(0x7ff4f80fcbe0 msgr2=0x7ff4f81053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:53.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.652+0000 7ff4feb34700 1 -- 172.21.15.8:0/3500395348 shutdown_connections 2023-12-17T12:03:53.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:53.652+0000 7ff4feb34700 1 -- 172.21.15.8:0/3500395348 wait complete. 2023-12-17T12:03:54.095 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- bash -c 'ceph orch ps' 2023-12-17T12:03:54.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:54 smithi100 ceph-mon[41266]: pgmap v298: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-12-17T12:03:54.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:54 smithi186 ceph-mon[41182]: pgmap v298: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-12-17T12:03:54.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:54 smithi008 ceph-mon[36830]: pgmap v298: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-12-17T12:03:54.521 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:03:55.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:55 smithi100 ceph-mon[41266]: from='client.15186 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:03:55.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:55 smithi186 ceph-mon[41182]: from='client.15186 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:03:55.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:55 smithi008 ceph-mon[36830]: from='client.15186 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:03:55.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.742+0000 7feb0ccb4700 1 -- 172.21.15.8:0/3972177344 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb08102820 msgr2=0x7feb08102c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:55.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.742+0000 7feb0ccb4700 1 --2- 172.21.15.8:0/3972177344 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb08102820 0x7feb08102c80 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7feafc0099c0 tx=0x7feafc009cd0 comp rx=0 tx=0).stop 2023-12-17T12:03:55.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.742+0000 7feb0ccb4700 1 -- 172.21.15.8:0/3972177344 shutdown_connections 2023-12-17T12:03:55.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.742+0000 7feb0ccb4700 1 --2- 172.21.15.8:0/3972177344 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb081031c0 0x7feb08109a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:55.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.742+0000 7feb0ccb4700 1 --2- 172.21.15.8:0/3972177344 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb08101620 0x7feb08101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:55.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.742+0000 7feb0ccb4700 1 --2- 172.21.15.8:0/3972177344 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb08102820 0x7feb08102c80 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:55.745 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.742+0000 7feb0ccb4700 1 -- 172.21.15.8:0/3972177344 >> 172.21.15.8:0/3972177344 conn(0x7feb080fcbe0 msgr2=0x7feb080ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:55.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.742+0000 7feb0ccb4700 1 -- 172.21.15.8:0/3972177344 shutdown_connections 2023-12-17T12:03:55.746 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.742+0000 7feb0ccb4700 1 -- 172.21.15.8:0/3972177344 wait complete. 2023-12-17T12:03:55.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.743+0000 7feb0ccb4700 1 Processor -- start 2023-12-17T12:03:55.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.744+0000 7feb0ccb4700 1 -- start start 2023-12-17T12:03:55.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.744+0000 7feb0ccb4700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb08101620 0x7feb081996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:55.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.744+0000 7feb0ccb4700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb08102820 0x7feb08199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:55.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.744+0000 7feb0ccb4700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb081031c0 0x7feb081a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:55.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.744+0000 7feb0ccb4700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb081a11c0 con 0x7feb08101620 2023-12-17T12:03:55.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.744+0000 7feb0ccb4700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb081a1300 con 0x7feb081031c0 2023-12-17T12:03:55.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.744+0000 7feb0ccb4700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb081a1490 con 0x7feb08102820 2023-12-17T12:03:55.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.744+0000 7feb0659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb08101620 0x7feb081996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:55.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.744+0000 7feb0659c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb08101620 0x7feb081996d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52316/0 (socket says 172.21.15.8:52316) 2023-12-17T12:03:55.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.744+0000 7feb0659c700 1 -- 172.21.15.8:0/3354617211 learned_addr learned my addr 172.21.15.8:0/3354617211 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:55.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.744+0000 7feb05d9b700 1 --2- 172.21.15.8:0/3354617211 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb08102820 0x7feb08199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:55.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.745+0000 7feb06d9d700 1 --2- 172.21.15.8:0/3354617211 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb081031c0 0x7feb081a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:55.748 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.745+0000 7feb0659c700 1 -- 172.21.15.8:0/3354617211 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb08102820 msgr2=0x7feb08199c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:55.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.745+0000 7feb0659c700 1 --2- 172.21.15.8:0/3354617211 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb08102820 0x7feb08199c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:55.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.745+0000 7feb0659c700 1 -- 172.21.15.8:0/3354617211 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb081031c0 msgr2=0x7feb081a0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:55.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.745+0000 7feb0659c700 1 --2- 172.21.15.8:0/3354617211 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb081031c0 0x7feb081a0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:55.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.745+0000 7feb0659c700 1 -- 172.21.15.8:0/3354617211 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feafc0095f0 con 0x7feb08101620 2023-12-17T12:03:55.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.745+0000 7feb0659c700 1 --2- 172.21.15.8:0/3354617211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb08101620 0x7feb081996d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7feaf800d9b0 tx=0x7feaf800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:55.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.745+0000 7feaf77fe700 1 -- 172.21.15.8:0/3354617211 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf8004020 con 0x7feb08101620 2023-12-17T12:03:55.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.745+0000 7feaf77fe700 1 -- 172.21.15.8:0/3354617211 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feaf8009730 con 0x7feb08101620 2023-12-17T12:03:55.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.745+0000 7feb0ccb4700 1 -- 172.21.15.8:0/3354617211 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb081a1770 con 0x7feb08101620 2023-12-17T12:03:55.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.745+0000 7feaf77fe700 1 -- 172.21.15.8:0/3354617211 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaf80039c0 con 0x7feb08101620 2023-12-17T12:03:55.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.745+0000 7feb0ccb4700 1 -- 172.21.15.8:0/3354617211 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb081a1c70 con 0x7feb08101620 2023-12-17T12:03:55.749 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.747+0000 7feb0ccb4700 1 -- 172.21.15.8:0/3354617211 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb0804f290 con 0x7feb08101620 2023-12-17T12:03:55.750 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.748+0000 7feaf77fe700 1 -- 172.21.15.8:0/3354617211 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7feaf80098a0 con 0x7feb08101620 2023-12-17T12:03:55.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.750+0000 7feaf77fe700 1 --2- 172.21.15.8:0/3354617211 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7feaf00a1510 0x7feaf00a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:55.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.750+0000 7feaf77fe700 1 -- 172.21.15.8:0/3354617211 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7feaf80ccc00 con 0x7feb08101620 2023-12-17T12:03:55.752 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.750+0000 7feb05d9b700 1 --2- 172.21.15.8:0/3354617211 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7feaf00a1510 0x7feaf00a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:55.753 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.751+0000 7feb05d9b700 1 --2- 172.21.15.8:0/3354617211 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7feaf00a1510 0x7feaf00a39d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7feafc00b580 tx=0x7feafc005e80 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:55.756 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.754+0000 7feaf77fe700 1 -- 172.21.15.8:0/3354617211 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7feaf8096080 con 0x7feb08101620 2023-12-17T12:03:55.972 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.970+0000 7feb0ccb4700 1 -- 172.21.15.8:0/3354617211 --> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7feb08109710 con 0x7feaf00a1510 2023-12-17T12:03:55.986 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.984+0000 7feaf77fe700 1 -- 172.21.15.8:0/3354617211 <== mgr.14154 v2:172.21.15.8:6800/268548699 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4154 (secure 0 0 0) 0x7feb08109710 con 0x7feaf00a1510 2023-12-17T12:03:55.986 INFO:teuthology.orchestra.run.smithi008.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-12-17T12:03:55.987 INFO:teuthology.orchestra.run.smithi008.stdout:mds.a smithi008 running (74s) 3s ago 74s 17.1M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 8f814409367b 2023-12-17T12:03:55.987 INFO:teuthology.orchestra.run.smithi008.stdout:mds.b smithi100 running (72s) 4s ago 71s 29.1M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 740a9ebc7a19 2023-12-17T12:03:55.987 INFO:teuthology.orchestra.run.smithi008.stdout:mds.c smithi186 running (85s) 4s ago 84s 17.5M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 01f0e96d7602 2023-12-17T12:03:55.987 INFO:teuthology.orchestra.run.smithi008.stdout:mds.d smithi008 running (93s) 3s ago 92s 13.8M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 9328ef9d947c 2023-12-17T12:03:55.987 INFO:teuthology.orchestra.run.smithi008.stdout:mds.e smithi100 running (90s) 4s ago 89s 18.3M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 c048b02a68c2 2023-12-17T12:03:55.987 INFO:teuthology.orchestra.run.smithi008.stdout:mds.f smithi186 running (87s) 4s ago 87s 17.3M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 c89469eb6730 2023-12-17T12:03:55.987 INFO:teuthology.orchestra.run.smithi008.stdout:mds.g smithi008 running (77s) 3s ago 77s 17.2M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 505787166cde 2023-12-17T12:03:55.987 INFO:teuthology.orchestra.run.smithi008.stdout:mds.h smithi100 running (82s) 4s ago 82s 18.7M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 e25781acc9a7 2023-12-17T12:03:55.987 INFO:teuthology.orchestra.run.smithi008.stdout:mds.i smithi186 running (79s) 4s ago 79s 18.2M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 cfa1f1028193 2023-12-17T12:03:55.987 INFO:teuthology.orchestra.run.smithi008.stdout:mds.j smithi008 running (95s) 3s ago 95s 13.8M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 d4a162633fac 2023-12-17T12:03:55.987 INFO:teuthology.orchestra.run.smithi008.stdout:mds.k smithi100 running (98s) 4s ago 97s 17.8M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 124c246cf92c 2023-12-17T12:03:55.987 INFO:teuthology.orchestra.run.smithi008.stdout:mds.l smithi186 running (100s) 4s ago 100s 18.3M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 f74281d83bf7 2023-12-17T12:03:55.988 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.x smithi008 *:9283,8765 running (8m) 3s ago 8m 530M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 a0d35217752d 2023-12-17T12:03:55.988 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.y smithi100 *:8443,8765 running (6m) 4s ago 6m 452M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 a6a95f0d40b9 2023-12-17T12:03:55.988 INFO:teuthology.orchestra.run.smithi008.stdout:mgr.z smithi186 *:8443,8765 running (6m) 4s ago 6m 452M - 19.0.0-119-ga62fda73 0b0a5e4a17a7 4b8d0ec22400 2023-12-17T12:03:55.988 INFO:teuthology.orchestra.run.smithi008.stdout:mon.a smithi008 running (8m) 3s ago 8m 94.5M 2048M 19.0.0-119-ga62fda73 0b0a5e4a17a7 ad84dd1c02c0 2023-12-17T12:03:55.988 INFO:teuthology.orchestra.run.smithi008.stdout:mon.b smithi100 running (6m) 4s ago 6m 61.7M 2048M 19.0.0-119-ga62fda73 0b0a5e4a17a7 3477e24ddac0 2023-12-17T12:03:55.988 INFO:teuthology.orchestra.run.smithi008.stdout:mon.c smithi186 running (6m) 4s ago 6m 62.2M 2048M 19.0.0-119-ga62fda73 0b0a5e4a17a7 0393eb081df9 2023-12-17T12:03:55.988 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 smithi008 running (6m) 3s ago 6m 68.2M 4319M 19.0.0-119-ga62fda73 0b0a5e4a17a7 f3de5800670a 2023-12-17T12:03:55.988 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 smithi100 running (5m) 4s ago 5m 74.9M 4317M 19.0.0-119-ga62fda73 0b0a5e4a17a7 1a2c0029c3fc 2023-12-17T12:03:55.988 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 smithi186 running (5m) 4s ago 5m 73.3M 4317M 19.0.0-119-ga62fda73 0b0a5e4a17a7 e78513623e77 2023-12-17T12:03:55.988 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 smithi008 running (4m) 3s ago 4m 62.5M 4319M 19.0.0-119-ga62fda73 0b0a5e4a17a7 126d0fa06c82 2023-12-17T12:03:55.988 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 smithi100 running (4m) 4s ago 4m 61.0M 4317M 19.0.0-119-ga62fda73 0b0a5e4a17a7 539de4b1976c 2023-12-17T12:03:55.988 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 smithi186 running (4m) 4s ago 4m 64.9M 4317M 19.0.0-119-ga62fda73 0b0a5e4a17a7 909d233da422 2023-12-17T12:03:55.988 INFO:teuthology.orchestra.run.smithi008.stdout:osd.6 smithi008 running (3m) 3s ago 3m 61.4M 4319M 19.0.0-119-ga62fda73 0b0a5e4a17a7 145a4c4d0dca 2023-12-17T12:03:55.988 INFO:teuthology.orchestra.run.smithi008.stdout:osd.7 smithi100 running (3m) 4s ago 3m 62.6M 4317M 19.0.0-119-ga62fda73 0b0a5e4a17a7 5e29d24759b5 2023-12-17T12:03:55.989 INFO:teuthology.orchestra.run.smithi008.stdout:osd.8 smithi186 running (3m) 4s ago 3m 60.0M 4317M 19.0.0-119-ga62fda73 0b0a5e4a17a7 038dc194fde5 2023-12-17T12:03:55.989 INFO:teuthology.orchestra.run.smithi008.stdout:osd.9 smithi008 running (2m) 3s ago 2m 56.7M 4319M 19.0.0-119-ga62fda73 0b0a5e4a17a7 29e4167cf565 2023-12-17T12:03:55.989 INFO:teuthology.orchestra.run.smithi008.stdout:osd.10 smithi100 running (2m) 4s ago 2m 62.2M 4317M 19.0.0-119-ga62fda73 0b0a5e4a17a7 8f236117918b 2023-12-17T12:03:55.989 INFO:teuthology.orchestra.run.smithi008.stdout:osd.11 smithi186 running (118s) 4s ago 118s 51.8M 4317M 19.0.0-119-ga62fda73 0b0a5e4a17a7 e6dbfa3eda3f 2023-12-17T12:03:55.989 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.986+0000 7feb0ccb4700 1 -- 172.21.15.8:0/3354617211 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7feaf00a1510 msgr2=0x7feaf00a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:55.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.986+0000 7feb0ccb4700 1 --2- 172.21.15.8:0/3354617211 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7feaf00a1510 0x7feaf00a39d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7feafc00b580 tx=0x7feafc005e80 comp rx=0 tx=0).stop 2023-12-17T12:03:55.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.986+0000 7feb0ccb4700 1 -- 172.21.15.8:0/3354617211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb08101620 msgr2=0x7feb081996d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:55.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.986+0000 7feb0ccb4700 1 --2- 172.21.15.8:0/3354617211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb08101620 0x7feb081996d0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7feaf800d9b0 tx=0x7feaf800dcc0 comp rx=0 tx=0).stop 2023-12-17T12:03:55.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.986+0000 7feb0ccb4700 1 -- 172.21.15.8:0/3354617211 shutdown_connections 2023-12-17T12:03:55.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.986+0000 7feb0ccb4700 1 --2- 172.21.15.8:0/3354617211 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7feaf00a1510 0x7feaf00a39d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:55.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.986+0000 7feb0ccb4700 1 --2- 172.21.15.8:0/3354617211 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7feb081031c0 0x7feb081a0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:55.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.986+0000 7feb0ccb4700 1 --2- 172.21.15.8:0/3354617211 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7feb08101620 0x7feb081996d0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:55.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.987+0000 7feb0ccb4700 1 --2- 172.21.15.8:0/3354617211 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb08102820 0x7feb08199c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:55.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.987+0000 7feb0ccb4700 1 -- 172.21.15.8:0/3354617211 >> 172.21.15.8:0/3354617211 conn(0x7feb080fcbe0 msgr2=0x7feb08107ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:55.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.987+0000 7feb0ccb4700 1 -- 172.21.15.8:0/3354617211 shutdown_connections 2023-12-17T12:03:55.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:55.987+0000 7feb0ccb4700 1 -- 172.21.15.8:0/3354617211 wait complete. 2023-12-17T12:03:56.372 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:56 smithi008 ceph-mon[36830]: pgmap v299: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-12-17T12:03:56.407 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- bash -c 'ceph orch ls' 2023-12-17T12:03:56.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:56 smithi100 ceph-mon[41266]: pgmap v299: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-12-17T12:03:56.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:56 smithi186 ceph-mon[41182]: pgmap v299: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-12-17T12:03:56.832 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:03:57.364 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:57 smithi008 ceph-mon[36830]: from='client.15192 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:03:57.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:57 smithi100 ceph-mon[41266]: from='client.15192 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:03:57.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:57 smithi186 ceph-mon[41182]: from='client.15192 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:03:58.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.001+0000 7fea57333700 1 -- 172.21.15.8:0/660757629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea50101620 msgr2=0x7fea50101a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:58.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.001+0000 7fea57333700 1 --2- 172.21.15.8:0/660757629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea50101620 0x7fea50101a40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fea4c0099c0 tx=0x7fea4c009cd0 comp rx=0 tx=0).stop 2023-12-17T12:03:58.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.001+0000 7fea57333700 1 -- 172.21.15.8:0/660757629 shutdown_connections 2023-12-17T12:03:58.004 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.001+0000 7fea57333700 1 --2- 172.21.15.8:0/660757629 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea501031c0 0x7fea50109a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:58.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.001+0000 7fea57333700 1 --2- 172.21.15.8:0/660757629 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea50101620 0x7fea50101a40 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:58.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.001+0000 7fea57333700 1 --2- 172.21.15.8:0/660757629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea50102820 0x7fea50102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:58.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.001+0000 7fea57333700 1 -- 172.21.15.8:0/660757629 >> 172.21.15.8:0/660757629 conn(0x7fea500fcbe0 msgr2=0x7fea500ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:58.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.001+0000 7fea57333700 1 -- 172.21.15.8:0/660757629 shutdown_connections 2023-12-17T12:03:58.005 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.001+0000 7fea57333700 1 -- 172.21.15.8:0/660757629 wait complete. 2023-12-17T12:03:58.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.002+0000 7fea57333700 1 Processor -- start 2023-12-17T12:03:58.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.003+0000 7fea57333700 1 -- start start 2023-12-17T12:03:58.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.003+0000 7fea57333700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea50101620 0x7fea50199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:58.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.003+0000 7fea57333700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea50102820 0x7fea50199cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:58.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.003+0000 7fea57333700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea501031c0 0x7fea501a0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:58.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.003+0000 7fea57333700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea501a1270 con 0x7fea50101620 2023-12-17T12:03:58.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.003+0000 7fea57333700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea501a13b0 con 0x7fea501031c0 2023-12-17T12:03:58.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.003+0000 7fea57333700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea501a1540 con 0x7fea50102820 2023-12-17T12:03:58.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.003+0000 7fea550cf700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea50101620 0x7fea50199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:58.007 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.003+0000 7fea550cf700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea50101620 0x7fea50199780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52338/0 (socket says 172.21.15.8:52338) 2023-12-17T12:03:58.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.003+0000 7fea550cf700 1 -- 172.21.15.8:0/1379029371 learned_addr learned my addr 172.21.15.8:0/1379029371 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:03:58.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.003+0000 7fea548ce700 1 --2- 172.21.15.8:0/1379029371 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea50102820 0x7fea50199cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:58.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.004+0000 7fea550cf700 1 -- 172.21.15.8:0/1379029371 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea50102820 msgr2=0x7fea50199cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:58.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.004+0000 7fea550cf700 1 --2- 172.21.15.8:0/1379029371 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea50102820 0x7fea50199cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:58.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.004+0000 7fea550cf700 1 -- 172.21.15.8:0/1379029371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea501031c0 msgr2=0x7fea501a0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:58.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.004+0000 7fea558d0700 1 --2- 172.21.15.8:0/1379029371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea501031c0 0x7fea501a0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:58.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.004+0000 7fea550cf700 1 --2- 172.21.15.8:0/1379029371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea501031c0 0x7fea501a0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:58.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.004+0000 7fea550cf700 1 -- 172.21.15.8:0/1379029371 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea4c0095f0 con 0x7fea50101620 2023-12-17T12:03:58.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.004+0000 7fea558d0700 1 --2- 172.21.15.8:0/1379029371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea501031c0 0x7fea501a0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T12:03:58.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.004+0000 7fea550cf700 1 --2- 172.21.15.8:0/1379029371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea50101620 0x7fea50199780 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fea4c0098e0 tx=0x7fea4c00fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:58.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.004+0000 7fea467fc700 1 -- 172.21.15.8:0/1379029371 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c01d070 con 0x7fea50101620 2023-12-17T12:03:58.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.004+0000 7fea467fc700 1 -- 172.21.15.8:0/1379029371 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fea4c00bd10 con 0x7fea50101620 2023-12-17T12:03:58.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.004+0000 7fea57333700 1 -- 172.21.15.8:0/1379029371 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea501a17c0 con 0x7fea50101620 2023-12-17T12:03:58.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.004+0000 7fea467fc700 1 -- 172.21.15.8:0/1379029371 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea4c004bd0 con 0x7fea50101620 2023-12-17T12:03:58.008 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.004+0000 7fea57333700 1 -- 172.21.15.8:0/1379029371 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea501a1c30 con 0x7fea50101620 2023-12-17T12:03:58.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.005+0000 7fea57333700 1 -- 172.21.15.8:0/1379029371 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea5004f290 con 0x7fea50101620 2023-12-17T12:03:58.009 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.007+0000 7fea467fc700 1 -- 172.21.15.8:0/1379029371 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7fea4c004d30 con 0x7fea50101620 2023-12-17T12:03:58.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.009+0000 7fea467fc700 1 --2- 172.21.15.8:0/1379029371 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fea3c0a1590 0x7fea3c0a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:03:58.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.009+0000 7fea467fc700 1 -- 172.21.15.8:0/1379029371 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fea4c0cdd10 con 0x7fea50101620 2023-12-17T12:03:58.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.009+0000 7fea548ce700 1 --2- 172.21.15.8:0/1379029371 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fea3c0a1590 0x7fea3c0a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:03:58.011 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.009+0000 7fea548ce700 1 --2- 172.21.15.8:0/1379029371 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fea3c0a1590 0x7fea3c0a3a50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fea40009c60 tx=0x7fea40009260 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:03:58.014 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.012+0000 7fea467fc700 1 -- 172.21.15.8:0/1379029371 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fea4c0d3020 con 0x7fea50101620 2023-12-17T12:03:58.239 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.236+0000 7fea57333700 1 -- 172.21.15.8:0/1379029371 --> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fea50109730 con 0x7fea3c0a1590 2023-12-17T12:03:58.245 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.243+0000 7fea467fc700 1 -- 172.21.15.8:0/1379029371 <== mgr.14154 v2:172.21.15.8:6800/268548699 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+985 (secure 0 0 0) 0x7fea50109730 con 0x7fea3c0a1590 2023-12-17T12:03:58.245 INFO:teuthology.orchestra.run.smithi008.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-12-17T12:03:58.245 INFO:teuthology.orchestra.run.smithi008.stdout:mds.all 12/12 6s ago 105s smithi008=a;smithi008=d;smithi008=g;smithi008=j;smithi100=b;smithi100=e;smithi100=h;smithi100=k;smithi186=c;smithi186=f;smithi186=i;smithi186=l;count:12 2023-12-17T12:03:58.246 INFO:teuthology.orchestra.run.smithi008.stdout:mgr 3/3 6s ago 6m smithi008=x;smithi100=y;smithi186=z;count:3 2023-12-17T12:03:58.246 INFO:teuthology.orchestra.run.smithi008.stdout:mon 3/3 6s ago 6m smithi008:172.21.15.8=a;smithi100:172.21.15.100=b;smithi186:172.21.15.186=c;count:3 2023-12-17T12:03:58.246 INFO:teuthology.orchestra.run.smithi008.stdout:osd 12 6s ago - 2023-12-17T12:03:58.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.245+0000 7fea57333700 1 -- 172.21.15.8:0/1379029371 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fea3c0a1590 msgr2=0x7fea3c0a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:58.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.245+0000 7fea57333700 1 --2- 172.21.15.8:0/1379029371 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fea3c0a1590 0x7fea3c0a3a50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fea40009c60 tx=0x7fea40009260 comp rx=0 tx=0).stop 2023-12-17T12:03:58.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.245+0000 7fea57333700 1 -- 172.21.15.8:0/1379029371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea50101620 msgr2=0x7fea50199780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:03:58.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.245+0000 7fea57333700 1 --2- 172.21.15.8:0/1379029371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea50101620 0x7fea50199780 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fea4c0098e0 tx=0x7fea4c00fa00 comp rx=0 tx=0).stop 2023-12-17T12:03:58.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.245+0000 7fea57333700 1 -- 172.21.15.8:0/1379029371 shutdown_connections 2023-12-17T12:03:58.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.245+0000 7fea57333700 1 --2- 172.21.15.8:0/1379029371 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fea3c0a1590 0x7fea3c0a3a50 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:58.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.245+0000 7fea57333700 1 --2- 172.21.15.8:0/1379029371 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fea501031c0 0x7fea501a0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:58.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.245+0000 7fea57333700 1 --2- 172.21.15.8:0/1379029371 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fea50101620 0x7fea50199780 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:58.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.245+0000 7fea57333700 1 --2- 172.21.15.8:0/1379029371 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea50102820 0x7fea50199cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:03:58.248 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.245+0000 7fea57333700 1 -- 172.21.15.8:0/1379029371 >> 172.21.15.8:0/1379029371 conn(0x7fea500fcbe0 msgr2=0x7fea50108010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:03:58.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.246+0000 7fea57333700 1 -- 172.21.15.8:0/1379029371 shutdown_connections 2023-12-17T12:03:58.249 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:03:58.246+0000 7fea57333700 1 -- 172.21.15.8:0/1379029371 wait complete. 2023-12-17T12:03:58.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:58 smithi100 ceph-mon[41266]: pgmap v300: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-12-17T12:03:58.438 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:58 smithi008 ceph-mon[36830]: pgmap v300: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-12-17T12:03:58.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:58 smithi186 ceph-mon[41182]: pgmap v300: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2023-12-17T12:03:58.762 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- bash -c 'ceph orch host ls' 2023-12-17T12:03:59.189 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:03:59.357 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:03:59 smithi008 ceph-mon[36830]: from='client.15198 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:03:59.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:03:59 smithi100 ceph-mon[41266]: from='client.15198 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:03:59.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:03:59 smithi186 ceph-mon[41182]: from='client.15198 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:04:00.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:00 smithi100 ceph-mon[41266]: pgmap v301: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-12-17T12:04:00.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.426+0000 7fe226669700 1 -- 172.21.15.8:0/3886156601 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe220101620 msgr2=0x7fe220101a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:00.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.426+0000 7fe226669700 1 --2- 172.21.15.8:0/3886156601 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe220101620 0x7fe220101a40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fe2100099c0 tx=0x7fe210009cd0 comp rx=0 tx=0).stop 2023-12-17T12:04:00.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.426+0000 7fe226669700 1 -- 172.21.15.8:0/3886156601 shutdown_connections 2023-12-17T12:04:00.429 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.426+0000 7fe226669700 1 --2- 172.21.15.8:0/3886156601 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe2201031c0 0x7fe220109a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:00.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.426+0000 7fe226669700 1 --2- 172.21.15.8:0/3886156601 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe220101620 0x7fe220101a40 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:00.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.426+0000 7fe226669700 1 --2- 172.21.15.8:0/3886156601 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe220102820 0x7fe220102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:00.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.426+0000 7fe226669700 1 -- 172.21.15.8:0/3886156601 >> 172.21.15.8:0/3886156601 conn(0x7fe2200fcbe0 msgr2=0x7fe2200ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:00.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.427+0000 7fe226669700 1 -- 172.21.15.8:0/3886156601 shutdown_connections 2023-12-17T12:04:00.430 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.427+0000 7fe226669700 1 -- 172.21.15.8:0/3886156601 wait complete. 2023-12-17T12:04:00.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.427+0000 7fe226669700 1 Processor -- start 2023-12-17T12:04:00.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.428+0000 7fe226669700 1 -- start start 2023-12-17T12:04:00.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.428+0000 7fe226669700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe220101620 0x7fe220075320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:00.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.428+0000 7fe226669700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe220102820 0x7fe2200739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:00.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.428+0000 7fe226669700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2201031c0 0x7fe220073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:00.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.428+0000 7fe226669700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2200746a0 con 0x7fe2201031c0 2023-12-17T12:04:00.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.428+0000 7fe226669700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe220074810 con 0x7fe220102820 2023-12-17T12:04:00.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.428+0000 7fe226669700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2201a14c0 con 0x7fe220101620 2023-12-17T12:04:00.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.428+0000 7fe224c06700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2201031c0 0x7fe220073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:00.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.428+0000 7fe224c06700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2201031c0 0x7fe220073f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:52358/0 (socket says 172.21.15.8:52358) 2023-12-17T12:04:00.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.428+0000 7fe224c06700 1 -- 172.21.15.8:0/1508184311 learned_addr learned my addr 172.21.15.8:0/1508184311 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:04:00.432 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.429+0000 7fe21ffff700 1 --2- 172.21.15.8:0/1508184311 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe220101620 0x7fe220075320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:00.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.429+0000 7fe21f7fe700 1 --2- 172.21.15.8:0/1508184311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe220102820 0x7fe2200739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:00.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.429+0000 7fe224c06700 1 -- 172.21.15.8:0/1508184311 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe220101620 msgr2=0x7fe220075320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:00.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.429+0000 7fe224c06700 1 --2- 172.21.15.8:0/1508184311 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe220101620 0x7fe220075320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:00.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.429+0000 7fe224c06700 1 -- 172.21.15.8:0/1508184311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe220102820 msgr2=0x7fe2200739c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:00.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.429+0000 7fe224c06700 1 --2- 172.21.15.8:0/1508184311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe220102820 0x7fe2200739c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:00.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.429+0000 7fe224c06700 1 -- 172.21.15.8:0/1508184311 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2100095f0 con 0x7fe2201031c0 2023-12-17T12:04:00.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.429+0000 7fe224c06700 1 --2- 172.21.15.8:0/1508184311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2201031c0 0x7fe220073f00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe218007d70 tx=0x7fe21800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:00.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.429+0000 7fe21d7fa700 1 -- 172.21.15.8:0/1508184311 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21800ad40 con 0x7fe2201031c0 2023-12-17T12:04:00.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.429+0000 7fe21d7fa700 1 -- 172.21.15.8:0/1508184311 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe2180128b0 con 0x7fe2201031c0 2023-12-17T12:04:00.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.429+0000 7fe226669700 1 -- 172.21.15.8:0/1508184311 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2201a1750 con 0x7fe2201031c0 2023-12-17T12:04:00.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.429+0000 7fe21d7fa700 1 -- 172.21.15.8:0/1508184311 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2180116b0 con 0x7fe2201031c0 2023-12-17T12:04:00.433 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.430+0000 7fe226669700 1 -- 172.21.15.8:0/1508184311 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2201a1c50 con 0x7fe2201031c0 2023-12-17T12:04:00.434 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.431+0000 7fe226669700 1 -- 172.21.15.8:0/1508184311 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe220108b50 con 0x7fe2201031c0 2023-12-17T12:04:00.435 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.433+0000 7fe21d7fa700 1 -- 172.21.15.8:0/1508184311 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7fe218012a20 con 0x7fe2201031c0 2023-12-17T12:04:00.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.434+0000 7fe21d7fa700 1 --2- 172.21.15.8:0/1508184311 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fe2080a1510 0x7fe2080a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:00.436 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.434+0000 7fe21d7fa700 1 -- 172.21.15.8:0/1508184311 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fe2180cd170 con 0x7fe2201031c0 2023-12-17T12:04:00.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.434+0000 7fe21ffff700 1 --2- 172.21.15.8:0/1508184311 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fe2080a1510 0x7fe2080a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:00.437 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.435+0000 7fe21ffff700 1 --2- 172.21.15.8:0/1508184311 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fe2080a1510 0x7fe2080a39d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe210009990 tx=0x7fe21001a040 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:00.441 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.438+0000 7fe21d7fa700 1 -- 172.21.15.8:0/1508184311 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe218096700 con 0x7fe2201031c0 2023-12-17T12:04:00.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:00 smithi186 ceph-mon[41182]: pgmap v301: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-12-17T12:04:00.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:00 smithi008 ceph-mon[36830]: pgmap v301: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2023-12-17T12:04:00.659 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.657+0000 7fe226669700 1 -- 172.21.15.8:0/1508184311 --> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe220061a10 con 0x7fe2080a1510 2023-12-17T12:04:00.661 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.658+0000 7fe21d7fa700 1 -- 172.21.15.8:0/1508184311 <== mgr.14154 v2:172.21.15.8:6800/268548699 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7fe220061a10 con 0x7fe2080a1510 2023-12-17T12:04:00.661 INFO:teuthology.orchestra.run.smithi008.stdout:HOST ADDR LABELS STATUS 2023-12-17T12:04:00.661 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008 172.21.15.8 2023-12-17T12:04:00.661 INFO:teuthology.orchestra.run.smithi008.stdout:smithi100 172.21.15.100 2023-12-17T12:04:00.661 INFO:teuthology.orchestra.run.smithi008.stdout:smithi186 172.21.15.186 2023-12-17T12:04:00.661 INFO:teuthology.orchestra.run.smithi008.stdout:3 hosts in cluster 2023-12-17T12:04:00.663 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.661+0000 7fe226669700 1 -- 172.21.15.8:0/1508184311 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fe2080a1510 msgr2=0x7fe2080a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:00.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.661+0000 7fe226669700 1 --2- 172.21.15.8:0/1508184311 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fe2080a1510 0x7fe2080a39d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe210009990 tx=0x7fe21001a040 comp rx=0 tx=0).stop 2023-12-17T12:04:00.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.661+0000 7fe226669700 1 -- 172.21.15.8:0/1508184311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2201031c0 msgr2=0x7fe220073f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:00.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.661+0000 7fe226669700 1 --2- 172.21.15.8:0/1508184311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2201031c0 0x7fe220073f00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe218007d70 tx=0x7fe21800a340 comp rx=0 tx=0).stop 2023-12-17T12:04:00.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.661+0000 7fe226669700 1 -- 172.21.15.8:0/1508184311 shutdown_connections 2023-12-17T12:04:00.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.661+0000 7fe226669700 1 --2- 172.21.15.8:0/1508184311 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fe2080a1510 0x7fe2080a39d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:00.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.661+0000 7fe226669700 1 --2- 172.21.15.8:0/1508184311 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe2201031c0 0x7fe220073f00 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:00.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.661+0000 7fe226669700 1 --2- 172.21.15.8:0/1508184311 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe220101620 0x7fe220075320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:00.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.661+0000 7fe226669700 1 --2- 172.21.15.8:0/1508184311 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe220102820 0x7fe2200739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:00.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.661+0000 7fe226669700 1 -- 172.21.15.8:0/1508184311 >> 172.21.15.8:0/1508184311 conn(0x7fe2200fcbe0 msgr2=0x7fe220105c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:00.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.661+0000 7fe226669700 1 -- 172.21.15.8:0/1508184311 shutdown_connections 2023-12-17T12:04:00.664 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:00.661+0000 7fe226669700 1 -- 172.21.15.8:0/1508184311 wait complete. 2023-12-17T12:04:01.081 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- bash -c 'ceph orch device ls' 2023-12-17T12:04:01.507 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:04:02.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.764+0000 7fa16013d700 1 -- 172.21.15.8:0/192496891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1581049d0 msgr2=0x7fa158106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:02.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.764+0000 7fa16013d700 1 --2- 172.21.15.8:0/192496891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1581049d0 0x7fa158106dc0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fa148009990 tx=0x7fa148009ca0 comp rx=0 tx=0).stop 2023-12-17T12:04:02.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.764+0000 7fa16013d700 1 -- 172.21.15.8:0/192496891 shutdown_connections 2023-12-17T12:04:02.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.764+0000 7fa16013d700 1 --2- 172.21.15.8:0/192496891 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa158107300 0x7fa158109770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:02.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.764+0000 7fa16013d700 1 --2- 172.21.15.8:0/192496891 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1581020a0 0x7fa158104490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:02.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.764+0000 7fa16013d700 1 --2- 172.21.15.8:0/192496891 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa1581049d0 0x7fa158106dc0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:02.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.764+0000 7fa16013d700 1 -- 172.21.15.8:0/192496891 >> 172.21.15.8:0/192496891 conn(0x7fa1580fbad0 msgr2=0x7fa1580fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:02.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.764+0000 7fa16013d700 1 -- 172.21.15.8:0/192496891 shutdown_connections 2023-12-17T12:04:02.767 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.764+0000 7fa16013d700 1 -- 172.21.15.8:0/192496891 wait complete. 2023-12-17T12:04:02.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.765+0000 7fa16013d700 1 Processor -- start 2023-12-17T12:04:02.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.765+0000 7fa16013d700 1 -- start start 2023-12-17T12:04:02.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.765+0000 7fa16013d700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1581020a0 0x7fa1581019b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:02.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.765+0000 7fa16013d700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1581049d0 0x7fa158100050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:02.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.766+0000 7fa16013d700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa158107300 0x7fa158100590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:02.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.766+0000 7fa16013d700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa158100d30 con 0x7fa158107300 2023-12-17T12:04:02.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.766+0000 7fa16013d700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa158100ea0 con 0x7fa1581049d0 2023-12-17T12:04:02.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.766+0000 7fa16013d700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1581a1500 con 0x7fa1581020a0 2023-12-17T12:04:02.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.766+0000 7fa15e6da700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa158107300 0x7fa158100590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:02.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.766+0000 7fa15e6da700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa158107300 0x7fa158100590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49632/0 (socket says 172.21.15.8:49632) 2023-12-17T12:04:02.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.766+0000 7fa15e6da700 1 -- 172.21.15.8:0/1791831468 learned_addr learned my addr 172.21.15.8:0/1791831468 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:04:02.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.766+0000 7fa15d6d8700 1 --2- 172.21.15.8:0/1791831468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1581049d0 0x7fa158100050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:02.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.766+0000 7fa15ded9700 1 --2- 172.21.15.8:0/1791831468 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1581020a0 0x7fa1581019b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:02.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.766+0000 7fa15e6da700 1 -- 172.21.15.8:0/1791831468 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1581020a0 msgr2=0x7fa1581019b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:02.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.766+0000 7fa15e6da700 1 --2- 172.21.15.8:0/1791831468 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1581020a0 0x7fa1581019b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:02.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.766+0000 7fa15e6da700 1 -- 172.21.15.8:0/1791831468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1581049d0 msgr2=0x7fa158100050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:02.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.766+0000 7fa15e6da700 1 --2- 172.21.15.8:0/1791831468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1581049d0 0x7fa158100050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:02.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.766+0000 7fa15e6da700 1 -- 172.21.15.8:0/1791831468 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1480095f0 con 0x7fa158107300 2023-12-17T12:04:02.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.767+0000 7fa15e6da700 1 --2- 172.21.15.8:0/1791831468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa158107300 0x7fa158100590 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa1500094f0 tx=0x7fa15000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:02.770 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.767+0000 7fa14effd700 1 -- 172.21.15.8:0/1791831468 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15000ddd0 con 0x7fa158107300 2023-12-17T12:04:02.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.767+0000 7fa14effd700 1 -- 172.21.15.8:0/1791831468 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa15000f040 con 0x7fa158107300 2023-12-17T12:04:02.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.767+0000 7fa16013d700 1 -- 172.21.15.8:0/1791831468 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1581a1790 con 0x7fa158107300 2023-12-17T12:04:02.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.767+0000 7fa14effd700 1 -- 172.21.15.8:0/1791831468 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa150005a00 con 0x7fa158107300 2023-12-17T12:04:02.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.767+0000 7fa16013d700 1 -- 172.21.15.8:0/1791831468 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1581a1c40 con 0x7fa158107300 2023-12-17T12:04:02.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.768+0000 7fa16013d700 1 -- 172.21.15.8:0/1791831468 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1580fd650 con 0x7fa158107300 2023-12-17T12:04:02.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.770+0000 7fa14effd700 1 -- 172.21.15.8:0/1791831468 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7fa150004f40 con 0x7fa158107300 2023-12-17T12:04:02.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.771+0000 7fa14effd700 1 --2- 172.21.15.8:0/1791831468 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fa1440a1510 0x7fa1440a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:02.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.771+0000 7fa14effd700 1 -- 172.21.15.8:0/1791831468 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7fa1500cc8b0 con 0x7fa158107300 2023-12-17T12:04:02.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.772+0000 7fa15ded9700 1 --2- 172.21.15.8:0/1791831468 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fa1440a1510 0x7fa1440a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:02.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.772+0000 7fa15ded9700 1 --2- 172.21.15.8:0/1791831468 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fa1440a1510 0x7fa1440a39d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa154005950 tx=0x7fa1540058e0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:02.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.775+0000 7fa14effd700 1 -- 172.21.15.8:0/1791831468 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fa15004f2f0 con 0x7fa158107300 2023-12-17T12:04:02.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:02 smithi100 ceph-mon[41266]: from='client.15204 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:04:02.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:02 smithi100 ceph-mon[41266]: pgmap v302: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-12-17T12:04:02.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:02 smithi186 ceph-mon[41182]: from='client.15204 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:04:02.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:02 smithi186 ceph-mon[41182]: pgmap v302: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-12-17T12:04:02.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:02 smithi008 ceph-mon[36830]: from='client.15204 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:04:02.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:02 smithi008 ceph-mon[36830]: pgmap v302: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2023-12-17T12:04:02.997 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.995+0000 7fa16013d700 1 -- 172.21.15.8:0/1791831468 --> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fa158061a10 con 0x7fa1440a1510 2023-12-17T12:04:02.999 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.997+0000 7fa14effd700 1 -- 172.21.15.8:0/1791831468 <== mgr.14154 v2:172.21.15.8:6800/268548699 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7fa158061a10 con 0x7fa1440a1510 2023-12-17T12:04:02.999 INFO:teuthology.orchestra.run.smithi008.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-12-17T12:04:02.999 INFO:teuthology.orchestra.run.smithi008.stdout:smithi008 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7476004A480DGN 447G No 2m ago Has a FileSystem, LVM detected 2023-12-17T12:04:02.999 INFO:teuthology.orchestra.run.smithi008.stdout:smithi100 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400WR400BGN 372G No 2m ago Has a FileSystem, LVM detected 2023-12-17T12:04:02.999 INFO:teuthology.orchestra.run.smithi008.stdout:smithi186 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300CB400BGN 372G No 118s ago Has a FileSystem, LVM detected 2023-12-17T12:04:03.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.999+0000 7fa16013d700 1 -- 172.21.15.8:0/1791831468 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fa1440a1510 msgr2=0x7fa1440a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:03.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.999+0000 7fa16013d700 1 --2- 172.21.15.8:0/1791831468 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fa1440a1510 0x7fa1440a39d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fa154005950 tx=0x7fa1540058e0 comp rx=0 tx=0).stop 2023-12-17T12:04:03.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.999+0000 7fa16013d700 1 -- 172.21.15.8:0/1791831468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa158107300 msgr2=0x7fa158100590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:03.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.999+0000 7fa16013d700 1 --2- 172.21.15.8:0/1791831468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa158107300 0x7fa158100590 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fa1500094f0 tx=0x7fa15000d3b0 comp rx=0 tx=0).stop 2023-12-17T12:04:03.001 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.999+0000 7fa16013d700 1 -- 172.21.15.8:0/1791831468 shutdown_connections 2023-12-17T12:04:03.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.999+0000 7fa16013d700 1 --2- 172.21.15.8:0/1791831468 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fa1440a1510 0x7fa1440a39d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:03.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.999+0000 7fa16013d700 1 --2- 172.21.15.8:0/1791831468 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fa158107300 0x7fa158100590 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:03.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.999+0000 7fa16013d700 1 --2- 172.21.15.8:0/1791831468 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1581020a0 0x7fa1581019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:03.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.999+0000 7fa16013d700 1 --2- 172.21.15.8:0/1791831468 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fa1581049d0 0x7fa158100050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:03.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.999+0000 7fa16013d700 1 -- 172.21.15.8:0/1791831468 >> 172.21.15.8:0/1791831468 conn(0x7fa1580fbad0 msgr2=0x7fa158103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:03.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.999+0000 7fa16013d700 1 -- 172.21.15.8:0/1791831468 shutdown_connections 2023-12-17T12:04:03.002 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:02.999+0000 7fa16013d700 1 -- 172.21.15.8:0/1791831468 wait complete. 2023-12-17T12:04:03.438 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-12-17T12:04:03.447 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi008.front.sepia.ceph.com 2023-12-17T12:04:03.448 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- bash -c 'ceph fs dump' 2023-12-17T12:04:03.895 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:04:04.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:04 smithi008 ceph-mon[36830]: from='client.15210 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:04:04.745 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:04 smithi008 ceph-mon[36830]: pgmap v303: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2023-12-17T12:04:04.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:04 smithi100 ceph-mon[41266]: from='client.15210 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:04:04.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:04 smithi100 ceph-mon[41266]: pgmap v303: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2023-12-17T12:04:04.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:04 smithi186 ceph-mon[41182]: from='client.15210 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-12-17T12:04:04.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:04 smithi186 ceph-mon[41182]: pgmap v303: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2023-12-17T12:04:05.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.075+0000 7f69d0f53700 1 -- 172.21.15.8:0/2391362032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69cc1031c0 msgr2=0x7f69cc109a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:05.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.075+0000 7f69d0f53700 1 --2- 172.21.15.8:0/2391362032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69cc1031c0 0x7f69cc109a70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f69c400b0d0 tx=0x7f69c400b3e0 comp rx=0 tx=0).stop 2023-12-17T12:04:05.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.075+0000 7f69d0f53700 1 -- 172.21.15.8:0/2391362032 shutdown_connections 2023-12-17T12:04:05.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.075+0000 7f69d0f53700 1 --2- 172.21.15.8:0/2391362032 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69cc1031c0 0x7f69cc109a70 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:05.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.075+0000 7f69d0f53700 1 --2- 172.21.15.8:0/2391362032 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69cc101620 0x7f69cc101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:05.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.075+0000 7f69d0f53700 1 --2- 172.21.15.8:0/2391362032 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69cc102820 0x7f69cc102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:05.078 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.075+0000 7f69d0f53700 1 -- 172.21.15.8:0/2391362032 >> 172.21.15.8:0/2391362032 conn(0x7f69cc0fcbe0 msgr2=0x7f69cc0ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:05.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.075+0000 7f69d0f53700 1 -- 172.21.15.8:0/2391362032 shutdown_connections 2023-12-17T12:04:05.079 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.075+0000 7f69d0f53700 1 -- 172.21.15.8:0/2391362032 wait complete. 2023-12-17T12:04:05.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.076+0000 7f69d0f53700 1 Processor -- start 2023-12-17T12:04:05.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.076+0000 7f69d0f53700 1 -- start start 2023-12-17T12:04:05.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.077+0000 7f69d0f53700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69cc101620 0x7f69cc1997a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:05.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.077+0000 7f69d0f53700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69cc102820 0x7f69cc199ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:05.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.077+0000 7f69d0f53700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69cc1031c0 0x7f69cc1a0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:05.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.077+0000 7f69d0f53700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc1a12e0 con 0x7f69cc101620 2023-12-17T12:04:05.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.077+0000 7f69d0f53700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc1a1420 con 0x7f69cc1031c0 2023-12-17T12:04:05.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.077+0000 7f69d0f53700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69cc1a15b0 con 0x7f69cc102820 2023-12-17T12:04:05.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.077+0000 7f69ca59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69cc101620 0x7f69cc1997a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:05.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.077+0000 7f69ca59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69cc101620 0x7f69cc1997a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49660/0 (socket says 172.21.15.8:49660) 2023-12-17T12:04:05.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.077+0000 7f69ca59c700 1 -- 172.21.15.8:0/730680302 learned_addr learned my addr 172.21.15.8:0/730680302 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:04:05.081 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.077+0000 7f69c9d9b700 1 --2- 172.21.15.8:0/730680302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69cc102820 0x7f69cc199ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:05.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.077+0000 7f69ca59c700 1 -- 172.21.15.8:0/730680302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69cc102820 msgr2=0x7f69cc199ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:05.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.077+0000 7f69ca59c700 1 --2- 172.21.15.8:0/730680302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69cc102820 0x7f69cc199ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:05.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.077+0000 7f69ca59c700 1 -- 172.21.15.8:0/730680302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69cc1031c0 msgr2=0x7f69cc1a0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:05.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.077+0000 7f69ca59c700 1 --2- 172.21.15.8:0/730680302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69cc1031c0 0x7f69cc1a0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:05.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.077+0000 7f69ca59c700 1 -- 172.21.15.8:0/730680302 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69c4009d00 con 0x7f69cc101620 2023-12-17T12:04:05.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.078+0000 7f69ca59c700 1 --2- 172.21.15.8:0/730680302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69cc101620 0x7f69cc1997a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f69bc00d9b0 tx=0x7f69bc00dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:05.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.078+0000 7f69bb7fe700 1 -- 172.21.15.8:0/730680302 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc00be80 con 0x7f69cc101620 2023-12-17T12:04:05.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.078+0000 7f69bb7fe700 1 -- 172.21.15.8:0/730680302 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f69bc0044b0 con 0x7f69cc101620 2023-12-17T12:04:05.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.078+0000 7f69d0f53700 1 -- 172.21.15.8:0/730680302 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69cc1a1890 con 0x7f69cc101620 2023-12-17T12:04:05.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.078+0000 7f69bb7fe700 1 -- 172.21.15.8:0/730680302 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69bc003aa0 con 0x7f69cc101620 2023-12-17T12:04:05.082 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.078+0000 7f69d0f53700 1 -- 172.21.15.8:0/730680302 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69cc1a1de0 con 0x7f69cc101620 2023-12-17T12:04:05.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.079+0000 7f69d0f53700 1 -- 172.21.15.8:0/730680302 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69cc04f290 con 0x7f69cc101620 2023-12-17T12:04:05.083 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.081+0000 7f69bb7fe700 1 -- 172.21.15.8:0/730680302 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f69bc009940 con 0x7f69cc101620 2023-12-17T12:04:05.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.082+0000 7f69bb7fe700 1 --2- 172.21.15.8:0/730680302 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f69b40a1590 0x7f69b40a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:05.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.083+0000 7f69bb7fe700 1 -- 172.21.15.8:0/730680302 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f69bc0ccbb0 con 0x7f69cc101620 2023-12-17T12:04:05.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.083+0000 7f69c9d9b700 1 --2- 172.21.15.8:0/730680302 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f69b40a1590 0x7f69b40a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:05.085 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.083+0000 7f69c9d9b700 1 --2- 172.21.15.8:0/730680302 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f69b40a1590 0x7f69b40a3a50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f69c0005fd0 tx=0x7f69c000a560 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:05.089 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.087+0000 7f69bb7fe700 1 -- 172.21.15.8:0/730680302 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f69bc096030 con 0x7f69cc101620 2023-12-17T12:04:05.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.339+0000 7f69d0f53700 1 -- 172.21.15.8:0/730680302 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f69cc10cf70 con 0x7f69cc101620 2023-12-17T12:04:05.342 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.340+0000 7f69bb7fe700 1 -- 172.21.15.8:0/730680302 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 27 v27) v1 ==== 76+0+2957 (secure 0 0 0) 0x7f69bc099650 con 0x7f69cc101620 2023-12-17T12:04:05.342 INFO:teuthology.orchestra.run.smithi008.stdout:e27 2023-12-17T12:04:05.342 INFO:teuthology.orchestra.run.smithi008.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-12-17T12:04:05.343 INFO:teuthology.orchestra.run.smithi008.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-12-17T12:04:05.343 INFO:teuthology.orchestra.run.smithi008.stdout:legacy client fscid: 1 2023-12-17T12:04:05.343 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:04:05.343 INFO:teuthology.orchestra.run.smithi008.stdout:Filesystem 'cephfs' (1) 2023-12-17T12:04:05.343 INFO:teuthology.orchestra.run.smithi008.stdout:fs_name cephfs 2023-12-17T12:04:05.343 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 27 2023-12-17T12:04:05.343 INFO:teuthology.orchestra.run.smithi008.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-12-17T12:04:05.343 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-12-17T12:02:50.176951+0000 2023-12-17T12:04:05.343 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-12-17T12:02:58.040005+0000 2023-12-17T12:04:05.343 INFO:teuthology.orchestra.run.smithi008.stdout:tableserver 0 2023-12-17T12:04:05.343 INFO:teuthology.orchestra.run.smithi008.stdout:root 0 2023-12-17T12:04:05.343 INFO:teuthology.orchestra.run.smithi008.stdout:session_timeout 300 2023-12-17T12:04:05.343 INFO:teuthology.orchestra.run.smithi008.stdout:session_autoclose 300 2023-12-17T12:04:05.344 INFO:teuthology.orchestra.run.smithi008.stdout:max_file_size 1099511627776 2023-12-17T12:04:05.344 INFO:teuthology.orchestra.run.smithi008.stdout:max_xattr_size 65536 2023-12-17T12:04:05.344 INFO:teuthology.orchestra.run.smithi008.stdout:required_client_features {} 2023-12-17T12:04:05.344 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure 0 2023-12-17T12:04:05.344 INFO:teuthology.orchestra.run.smithi008.stdout:last_failure_osd_epoch 0 2023-12-17T12:04:05.344 INFO:teuthology.orchestra.run.smithi008.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments} 2023-12-17T12:04:05.344 INFO:teuthology.orchestra.run.smithi008.stdout:max_mds 5 2023-12-17T12:04:05.344 INFO:teuthology.orchestra.run.smithi008.stdout:in 0,1,2,3,4 2023-12-17T12:04:05.344 INFO:teuthology.orchestra.run.smithi008.stdout:up {0=24569,1=24541,2=24503,3=24470,4=24451} 2023-12-17T12:04:05.344 INFO:teuthology.orchestra.run.smithi008.stdout:failed 2023-12-17T12:04:05.344 INFO:teuthology.orchestra.run.smithi008.stdout:damaged 2023-12-17T12:04:05.344 INFO:teuthology.orchestra.run.smithi008.stdout:stopped 2023-12-17T12:04:05.344 INFO:teuthology.orchestra.run.smithi008.stdout:data_pools [3] 2023-12-17T12:04:05.344 INFO:teuthology.orchestra.run.smithi008.stdout:metadata_pool 2 2023-12-17T12:04:05.345 INFO:teuthology.orchestra.run.smithi008.stdout:inline_data disabled 2023-12-17T12:04:05.345 INFO:teuthology.orchestra.run.smithi008.stdout:balancer 2023-12-17T12:04:05.345 INFO:teuthology.orchestra.run.smithi008.stdout:bal_rank_mask -1 2023-12-17T12:04:05.345 INFO:teuthology.orchestra.run.smithi008.stdout:standby_count_wanted 0 2023-12-17T12:04:05.345 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.b{0:24569} state up:active seq 3 addr [v2:172.21.15.100:6838/3921737538,v1:172.21.15.100:6839/3921737538] compat {c=[1],r=[1],i=[fff]}] 2023-12-17T12:04:05.345 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.h{0:24530} state up:standby-replay seq 1 addr [v2:172.21.15.100:6836/4176831844,v1:172.21.15.100:6837/4176831844] compat {c=[1],r=[1],i=[fff]}] 2023-12-17T12:04:05.345 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.i{1:24541} state up:active seq 6 addr [v2:172.21.15.186:6838/91602342,v1:172.21.15.186:6839/91602342] compat {c=[1],r=[1],i=[fff]}] 2023-12-17T12:04:05.345 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.c{1:24520} state up:standby-replay seq 1 addr [v2:172.21.15.186:6836/822451724,v1:172.21.15.186:6837/822451724] compat {c=[1],r=[1],i=[fff]}] 2023-12-17T12:04:05.345 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.e{2:24503} state up:active seq 9 addr [v2:172.21.15.100:6834/2140351853,v1:172.21.15.100:6835/2140351853] compat {c=[1],r=[1],i=[fff]}] 2023-12-17T12:04:05.345 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.a{2:14691} state up:standby-replay seq 1 addr [v2:172.21.15.8:6840/338406768,v1:172.21.15.8:6841/338406768] compat {c=[1],r=[1],i=[fff]}] 2023-12-17T12:04:05.345 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.k{3:24470} state up:active seq 11 addr [v2:172.21.15.100:6832/305815776,v1:172.21.15.100:6833/305815776] compat {c=[1],r=[1],i=[fff]}] 2023-12-17T12:04:05.345 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.g{3:14679} state up:standby-replay seq 1 addr [v2:172.21.15.8:6838/487046247,v1:172.21.15.8:6839/487046247] compat {c=[1],r=[1],i=[fff]}] 2023-12-17T12:04:05.345 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.l{4:24451} state up:active seq 12 addr [v2:172.21.15.186:6832/582753561,v1:172.21.15.186:6833/582753561] compat {c=[1],r=[1],i=[fff]}] 2023-12-17T12:04:05.345 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.f{4:14640} state up:standby-replay seq 1 addr [v2:172.21.15.186:6834/2765387309,v1:172.21.15.186:6835/2765387309] compat {c=[1],r=[1],i=[fff]}] 2023-12-17T12:04:05.346 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:04:05.346 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:04:05.346 INFO:teuthology.orchestra.run.smithi008.stdout:Standby daemons: 2023-12-17T12:04:05.346 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:04:05.346 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.j{-1:14604} state up:standby seq 1 addr [v2:172.21.15.8:6834/2669069079,v1:172.21.15.8:6835/2669069079] compat {c=[1],r=[1],i=[fff]}] 2023-12-17T12:04:05.346 INFO:teuthology.orchestra.run.smithi008.stdout:[mds.d{-1:14616} state up:standby seq 1 addr [v2:172.21.15.8:6836/4241050553,v1:172.21.15.8:6837/4241050553] compat {c=[1],r=[1],i=[fff]}] 2023-12-17T12:04:05.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.342+0000 7f69d0f53700 1 -- 172.21.15.8:0/730680302 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f69b40a1590 msgr2=0x7f69b40a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:05.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.342+0000 7f69d0f53700 1 --2- 172.21.15.8:0/730680302 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f69b40a1590 0x7f69b40a3a50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f69c0005fd0 tx=0x7f69c000a560 comp rx=0 tx=0).stop 2023-12-17T12:04:05.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.342+0000 7f69d0f53700 1 -- 172.21.15.8:0/730680302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69cc101620 msgr2=0x7f69cc1997a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:05.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.342+0000 7f69d0f53700 1 --2- 172.21.15.8:0/730680302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69cc101620 0x7f69cc1997a0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f69bc00d9b0 tx=0x7f69bc00dd70 comp rx=0 tx=0).stop 2023-12-17T12:04:05.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.342+0000 7f69d0f53700 1 -- 172.21.15.8:0/730680302 shutdown_connections 2023-12-17T12:04:05.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.342+0000 7f69d0f53700 1 --2- 172.21.15.8:0/730680302 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f69b40a1590 0x7f69b40a3a50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:05.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.342+0000 7f69d0f53700 1 --2- 172.21.15.8:0/730680302 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f69cc1031c0 0x7f69cc1a0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:05.347 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.342+0000 7f69d0f53700 1 --2- 172.21.15.8:0/730680302 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f69cc101620 0x7f69cc1997a0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:05.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.342+0000 7f69d0f53700 1 --2- 172.21.15.8:0/730680302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69cc102820 0x7f69cc199ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:05.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.342+0000 7f69d0f53700 1 -- 172.21.15.8:0/730680302 >> 172.21.15.8:0/730680302 conn(0x7f69cc0fcbe0 msgr2=0x7f69cc073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:05.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.342+0000 7f69d0f53700 1 -- 172.21.15.8:0/730680302 shutdown_connections 2023-12-17T12:04:05.348 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:05.343+0000 7f69d0f53700 1 -- 172.21.15.8:0/730680302 wait complete. 2023-12-17T12:04:05.348 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 27 2023-12-17T12:04:05.810 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:a62fda73efba5520d409bb5a21bd8373289dda5d shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 -- bash -c 'ceph osd dump' 2023-12-17T12:04:06.234 INFO:teuthology.orchestra.run.smithi008.stderr:Inferring config /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/mon.a/config 2023-12-17T12:04:06.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:06 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/730680302' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-17T12:04:06.245 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:06 smithi008 ceph-mon[36830]: pgmap v304: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-12-17T12:04:06.415 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:06 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/730680302' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-17T12:04:06.416 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:06 smithi100 ceph-mon[41266]: pgmap v304: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-12-17T12:04:06.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:06 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/730680302' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-12-17T12:04:06.475 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:06 smithi186 ceph-mon[41182]: pgmap v304: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2023-12-17T12:04:07.467 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.464+0000 7f79c814f700 1 -- 172.21.15.8:0/2830765526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79c0102820 msgr2=0x7f79c0102c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:07.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.464+0000 7f79c814f700 1 --2- 172.21.15.8:0/2830765526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79c0102820 0x7f79c0102c80 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f79b00099c0 tx=0x7f79b0009cd0 comp rx=0 tx=0).stop 2023-12-17T12:04:07.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.464+0000 7f79c814f700 1 -- 172.21.15.8:0/2830765526 shutdown_connections 2023-12-17T12:04:07.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.465+0000 7f79c814f700 1 --2- 172.21.15.8:0/2830765526 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79c01031c0 0x7f79c0109a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:07.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.465+0000 7f79c814f700 1 --2- 172.21.15.8:0/2830765526 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79c0101620 0x7f79c0101a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:07.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.465+0000 7f79c814f700 1 --2- 172.21.15.8:0/2830765526 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79c0102820 0x7f79c0102c80 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:07.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.465+0000 7f79c814f700 1 -- 172.21.15.8:0/2830765526 >> 172.21.15.8:0/2830765526 conn(0x7f79c00fcbe0 msgr2=0x7f79c00ff000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:07.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.465+0000 7f79c814f700 1 -- 172.21.15.8:0/2830765526 shutdown_connections 2023-12-17T12:04:07.468 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.465+0000 7f79c814f700 1 -- 172.21.15.8:0/2830765526 wait complete. 2023-12-17T12:04:07.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.466+0000 7f79c814f700 1 Processor -- start 2023-12-17T12:04:07.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.466+0000 7f79c814f700 1 -- start start 2023-12-17T12:04:07.470 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.466+0000 7f79c814f700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79c0101620 0x7f79c00752d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:07.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.466+0000 7f79c814f700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79c0102820 0x7f79c00739c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:07.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.466+0000 7f79c814f700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79c01031c0 0x7f79c0073f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:07.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.466+0000 7f79c814f700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c00745e0 con 0x7f79c0101620 2023-12-17T12:04:07.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.466+0000 7f79c814f700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c0074750 con 0x7f79c0102820 2023-12-17T12:04:07.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.466+0000 7f79c814f700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79c01a1540 con 0x7f79c01031c0 2023-12-17T12:04:07.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.467+0000 7f79c5eeb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79c0101620 0x7f79c00752d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:07.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.467+0000 7f79c5eeb700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79c0101620 0x7f79c00752d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49676/0 (socket says 172.21.15.8:49676) 2023-12-17T12:04:07.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.467+0000 7f79c5eeb700 1 -- 172.21.15.8:0/3383767399 learned_addr learned my addr 172.21.15.8:0/3383767399 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:04:07.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.467+0000 7f79c56ea700 1 --2- 172.21.15.8:0/3383767399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79c0102820 0x7f79c00739c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:07.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.467+0000 7f79c66ec700 1 --2- 172.21.15.8:0/3383767399 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79c01031c0 0x7f79c0073f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:07.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.467+0000 7f79c5eeb700 1 -- 172.21.15.8:0/3383767399 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79c01031c0 msgr2=0x7f79c0073f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:07.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.467+0000 7f79c5eeb700 1 --2- 172.21.15.8:0/3383767399 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79c01031c0 0x7f79c0073f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:07.471 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.467+0000 7f79c5eeb700 1 -- 172.21.15.8:0/3383767399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79c0102820 msgr2=0x7f79c00739c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:07.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.467+0000 7f79c5eeb700 1 --2- 172.21.15.8:0/3383767399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79c0102820 0x7f79c00739c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:07.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.467+0000 7f79c5eeb700 1 -- 172.21.15.8:0/3383767399 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b00095f0 con 0x7f79c0101620 2023-12-17T12:04:07.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.467+0000 7f79c66ec700 1 --2- 172.21.15.8:0/3383767399 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79c01031c0 0x7f79c0073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T12:04:07.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.467+0000 7f79c5eeb700 1 --2- 172.21.15.8:0/3383767399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79c0101620 0x7f79c00752d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f79bc00d980 tx=0x7f79bc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:07.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.468+0000 7f79b6ffd700 1 -- 172.21.15.8:0/3383767399 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc004020 con 0x7f79c0101620 2023-12-17T12:04:07.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.468+0000 7f79b6ffd700 1 -- 172.21.15.8:0/3383767399 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f79bc009730 con 0x7f79c0101620 2023-12-17T12:04:07.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.468+0000 7f79b6ffd700 1 -- 172.21.15.8:0/3383767399 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79bc003a00 con 0x7f79c0101620 2023-12-17T12:04:07.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.468+0000 7f79c814f700 1 -- 172.21.15.8:0/3383767399 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79c01a17a0 con 0x7f79c0101620 2023-12-17T12:04:07.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.468+0000 7f79c814f700 1 -- 172.21.15.8:0/3383767399 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79c01a1c20 con 0x7f79c0101620 2023-12-17T12:04:07.472 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.469+0000 7f79c814f700 1 -- 172.21.15.8:0/3383767399 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79c0108b50 con 0x7f79c0101620 2023-12-17T12:04:07.473 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.471+0000 7f79b6ffd700 1 -- 172.21.15.8:0/3383767399 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f79bc0098a0 con 0x7f79c0101620 2023-12-17T12:04:07.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.474+0000 7f79b6ffd700 1 --2- 172.21.15.8:0/3383767399 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f79ac0a1510 0x7f79ac0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:07.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.474+0000 7f79b6ffd700 1 -- 172.21.15.8:0/3383767399 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f79bc0ccf70 con 0x7f79c0101620 2023-12-17T12:04:07.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.474+0000 7f79c56ea700 1 --2- 172.21.15.8:0/3383767399 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f79ac0a1510 0x7f79ac0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:07.476 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.474+0000 7f79c56ea700 1 --2- 172.21.15.8:0/3383767399 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f79ac0a1510 0x7f79ac0a39d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f79b000b580 tx=0x7f79b0005e80 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:07.478 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.476+0000 7f79b6ffd700 1 -- 172.21.15.8:0/3383767399 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f79bc0963f0 con 0x7f79c0101620 2023-12-17T12:04:07.690 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.688+0000 7f79c814f700 1 -- 172.21.15.8:0/3383767399 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7f79c010cd20 con 0x7f79c0101620 2023-12-17T12:04:07.691 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.688+0000 7f79b6ffd700 1 -- 172.21.15.8:0/3383767399 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v85) v1 ==== 56+0+5302 (secure 0 0 0) 0x7f79bc099a10 con 0x7f79c0101620 2023-12-17T12:04:07.691 INFO:teuthology.orchestra.run.smithi008.stdout:epoch 85 2023-12-17T12:04:07.691 INFO:teuthology.orchestra.run.smithi008.stdout:fsid f43f508a-9cd2-11ee-95a5-87774f69a715 2023-12-17T12:04:07.691 INFO:teuthology.orchestra.run.smithi008.stdout:created 2023-12-17T11:55:30.666634+0000 2023-12-17T12:04:07.691 INFO:teuthology.orchestra.run.smithi008.stdout:modified 2023-12-17T12:03:28.446977+0000 2023-12-17T12:04:07.691 INFO:teuthology.orchestra.run.smithi008.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-12-17T12:04:07.691 INFO:teuthology.orchestra.run.smithi008.stdout:crush_version 26 2023-12-17T12:04:07.691 INFO:teuthology.orchestra.run.smithi008.stdout:full_ratio 0.95 2023-12-17T12:04:07.692 INFO:teuthology.orchestra.run.smithi008.stdout:backfillfull_ratio 0.9 2023-12-17T12:04:07.692 INFO:teuthology.orchestra.run.smithi008.stdout:nearfull_ratio 0.85 2023-12-17T12:04:07.692 INFO:teuthology.orchestra.run.smithi008.stdout:require_min_compat_client luminous 2023-12-17T12:04:07.692 INFO:teuthology.orchestra.run.smithi008.stdout:min_compat_client luminous 2023-12-17T12:04:07.692 INFO:teuthology.orchestra.run.smithi008.stdout:require_osd_release reef 2023-12-17T12:04:07.692 INFO:teuthology.orchestra.run.smithi008.stdout:stretch_mode_enabled false 2023-12-17T12:04:07.692 INFO:teuthology.orchestra.run.smithi008.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2023-12-17T12:04:07.692 INFO:teuthology.orchestra.run.smithi008.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 82 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2023-12-17T12:04:07.692 INFO:teuthology.orchestra.run.smithi008.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 83 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2023-12-17T12:04:07.692 INFO:teuthology.orchestra.run.smithi008.stdout:max_osd 12 2023-12-17T12:04:07.692 INFO:teuthology.orchestra.run.smithi008.stdout:osd.0 up in weight 1 up_from 8 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.8:6802/297519189,v1:172.21.15.8:6803/297519189] [v2:172.21.15.8:6804/297519189,v1:172.21.15.8:6805/297519189] exists,up c1f8acaf-a47b-4b74-a78d-e0b6be49a10e 2023-12-17T12:04:07.692 INFO:teuthology.orchestra.run.smithi008.stdout:osd.1 up in weight 1 up_from 13 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6800/2496516573,v1:172.21.15.100:6801/2496516573] [v2:172.21.15.100:6802/2496516573,v1:172.21.15.100:6803/2496516573] exists,up d7138889-77de-43ba-b36b-7628f6f66bee 2023-12-17T12:04:07.692 INFO:teuthology.orchestra.run.smithi008.stdout:osd.2 up in weight 1 up_from 18 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.186:6800/2454925270,v1:172.21.15.186:6801/2454925270] [v2:172.21.15.186:6802/2454925270,v1:172.21.15.186:6803/2454925270] exists,up ff452a6b-a11e-47be-9eaf-ec1001b51447 2023-12-17T12:04:07.692 INFO:teuthology.orchestra.run.smithi008.stdout:osd.3 up in weight 1 up_from 25 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.8:6810/1141622701,v1:172.21.15.8:6811/1141622701] [v2:172.21.15.8:6812/1141622701,v1:172.21.15.8:6813/1141622701] exists,up d19ab765-df7b-48c7-9012-8a3ac7d81aca 2023-12-17T12:04:07.692 INFO:teuthology.orchestra.run.smithi008.stdout:osd.4 up in weight 1 up_from 33 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6808/1902152516,v1:172.21.15.100:6809/1902152516] [v2:172.21.15.100:6810/1902152516,v1:172.21.15.100:6811/1902152516] exists,up 8ecc3a01-f19a-40a7-93a2-8870116afe6f 2023-12-17T12:04:07.693 INFO:teuthology.orchestra.run.smithi008.stdout:osd.5 up in weight 1 up_from 38 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.186:6808/648349934,v1:172.21.15.186:6809/648349934] [v2:172.21.15.186:6810/648349934,v1:172.21.15.186:6811/648349934] exists,up ac057cc9-2a27-4216-a7ae-fc60d9796eea 2023-12-17T12:04:07.693 INFO:teuthology.orchestra.run.smithi008.stdout:osd.6 up in weight 1 up_from 45 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.8:6818/3266909294,v1:172.21.15.8:6819/3266909294] [v2:172.21.15.8:6820/3266909294,v1:172.21.15.8:6821/3266909294] exists,up bb5325e0-fe12-4bbc-96a9-86c228106a7c 2023-12-17T12:04:07.693 INFO:teuthology.orchestra.run.smithi008.stdout:osd.7 up in weight 1 up_from 50 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6816/1631494583,v1:172.21.15.100:6817/1631494583] [v2:172.21.15.100:6818/1631494583,v1:172.21.15.100:6819/1631494583] exists,up 48939d99-29dd-436b-b9f1-fdfe1ee26315 2023-12-17T12:04:07.693 INFO:teuthology.orchestra.run.smithi008.stdout:osd.8 up in weight 1 up_from 58 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.186:6816/3569004799,v1:172.21.15.186:6817/3569004799] [v2:172.21.15.186:6818/3569004799,v1:172.21.15.186:6819/3569004799] exists,up e3414f7f-7665-406f-89ec-79cbb3d3e274 2023-12-17T12:04:07.693 INFO:teuthology.orchestra.run.smithi008.stdout:osd.9 up in weight 1 up_from 65 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.8:6826/3980647643,v1:172.21.15.8:6827/3980647643] [v2:172.21.15.8:6828/3980647643,v1:172.21.15.8:6829/3980647643] exists,up b04f519d-6e44-4158-b6e1-aa4d64be3404 2023-12-17T12:04:07.693 INFO:teuthology.orchestra.run.smithi008.stdout:osd.10 up in weight 1 up_from 70 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.100:6824/34112410,v1:172.21.15.100:6825/34112410] [v2:172.21.15.100:6826/34112410,v1:172.21.15.100:6827/34112410] exists,up 779fde04-620b-4b44-bd35-39be1470eec4 2023-12-17T12:04:07.693 INFO:teuthology.orchestra.run.smithi008.stdout:osd.11 up in weight 1 up_from 78 up_thru 81 down_at 0 last_clean_interval [0,0) [v2:172.21.15.186:6824/3779371472,v1:172.21.15.186:6825/3779371472] [v2:172.21.15.186:6826/3779371472,v1:172.21.15.186:6827/3779371472] exists,up 6bbcb42f-aa99-44e4-9c3f-d818423eb5b0 2023-12-17T12:04:07.693 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 2.8 [2,11] 2023-12-17T12:04:07.693 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 3.11 [4,8] 2023-12-17T12:04:07.693 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 3.12 [3,9] 2023-12-17T12:04:07.693 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 3.19 [3,6] 2023-12-17T12:04:07.694 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 3.21 [4,6] 2023-12-17T12:04:07.694 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 3.26 [1,9] 2023-12-17T12:04:07.694 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 3.31 [4,7] 2023-12-17T12:04:07.694 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 3.33 [5,9] 2023-12-17T12:04:07.694 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 3.39 [5,8] 2023-12-17T12:04:07.694 INFO:teuthology.orchestra.run.smithi008.stdout:pg_upmap_items 3.3a [4,7] 2023-12-17T12:04:07.694 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:0/4074020814 expires 2023-12-18T11:56:27.362306+0000 2023-12-17T12:04:07.694 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:6801/222068650 expires 2023-12-18T11:56:27.362306+0000 2023-12-17T12:04:07.694 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:6801/4187398661 expires 2023-12-18T11:56:00.731492+0000 2023-12-17T12:04:07.694 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:6800/222068650 expires 2023-12-18T11:56:27.362306+0000 2023-12-17T12:04:07.694 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:6800/4187398661 expires 2023-12-18T11:56:00.731492+0000 2023-12-17T12:04:07.694 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:0/2964092603 expires 2023-12-18T11:56:27.362306+0000 2023-12-17T12:04:07.694 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:0/35186087 expires 2023-12-18T11:56:00.731492+0000 2023-12-17T12:04:07.694 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:0/1429868241 expires 2023-12-18T11:56:00.731492+0000 2023-12-17T12:04:07.694 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:0/174719729 expires 2023-12-18T11:56:00.731492+0000 2023-12-17T12:04:07.694 INFO:teuthology.orchestra.run.smithi008.stdout:blocklist 172.21.15.8:0/2106317618 expires 2023-12-18T11:56:27.362306+0000 2023-12-17T12:04:07.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.691+0000 7f79c814f700 1 -- 172.21.15.8:0/3383767399 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f79ac0a1510 msgr2=0x7f79ac0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:07.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.691+0000 7f79c814f700 1 --2- 172.21.15.8:0/3383767399 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f79ac0a1510 0x7f79ac0a39d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f79b000b580 tx=0x7f79b0005e80 comp rx=0 tx=0).stop 2023-12-17T12:04:07.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.691+0000 7f79c814f700 1 -- 172.21.15.8:0/3383767399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79c0101620 msgr2=0x7f79c00752d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:07.695 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.691+0000 7f79c814f700 1 --2- 172.21.15.8:0/3383767399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79c0101620 0x7f79c00752d0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f79bc00d980 tx=0x7f79bc00dc90 comp rx=0 tx=0).stop 2023-12-17T12:04:07.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.691+0000 7f79c814f700 1 -- 172.21.15.8:0/3383767399 shutdown_connections 2023-12-17T12:04:07.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.691+0000 7f79c814f700 1 --2- 172.21.15.8:0/3383767399 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f79ac0a1510 0x7f79ac0a39d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:07.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.691+0000 7f79c814f700 1 --2- 172.21.15.8:0/3383767399 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f79c01031c0 0x7f79c0073f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:07.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.691+0000 7f79c814f700 1 --2- 172.21.15.8:0/3383767399 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f79c0101620 0x7f79c00752d0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:07.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.691+0000 7f79c814f700 1 --2- 172.21.15.8:0/3383767399 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f79c0102820 0x7f79c00739c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:07.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.691+0000 7f79c814f700 1 -- 172.21.15.8:0/3383767399 >> 172.21.15.8:0/3383767399 conn(0x7f79c00fcbe0 msgr2=0x7f79c0105c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:07.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.691+0000 7f79c814f700 1 -- 172.21.15.8:0/3383767399 shutdown_connections 2023-12-17T12:04:07.696 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:07.691+0000 7f79c814f700 1 -- 172.21.15.8:0/3383767399 wait complete. 2023-12-17T12:04:08.080 INFO:teuthology.run_tasks:Running task fs.ready... 2023-12-17T12:04:08.089 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 82, in run_one_task task = get_task(taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 35, in get_task module = _import('tasks', module_name, task_name, fail_on_import_error=True) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 54, in _import module = __import__( ModuleNotFoundError: No module named 'tasks.fs' 2023-12-17T12:04:08.152 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=07e4202d99c84f2b84d592a0b99091ca Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 82, in run_one_task task = get_task(taskname) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 35, in get_task module = _import('tasks', module_name, task_name, fail_on_import_error=True) File "/home/teuthworker/src/git.ceph.com_teuthology_5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73/teuthology/run_tasks.py", line 54, in _import module = __import__( ModuleNotFoundError: No module named 'tasks.fs' 2023-12-17T12:04:08.154 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-12-17T12:04:08.162 INFO:tasks.cephadm:Teardown begin 2023-12-17T12:04:08.163 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-17T12:04:08.163 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-17T12:04:08.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.371+0000 7f314e3ff700 1 -- 172.21.15.8:0/1228733790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3148102690 msgr2=0x7f3148102af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:08.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.371+0000 7f314e3ff700 1 --2- 172.21.15.8:0/1228733790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3148102690 0x7f3148102af0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f313c0099c0 tx=0x7f313c009cd0 comp rx=0 tx=0).stop 2023-12-17T12:04:08.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.371+0000 7f314e3ff700 1 -- 172.21.15.8:0/1228733790 shutdown_connections 2023-12-17T12:04:08.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.371+0000 7f314e3ff700 1 --2- 172.21.15.8:0/1228733790 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3148103030 0x7f31481098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:08.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.371+0000 7f314e3ff700 1 --2- 172.21.15.8:0/1228733790 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f31481014a0 0x7f31481018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:08.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.371+0000 7f314e3ff700 1 --2- 172.21.15.8:0/1228733790 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f3148102690 0x7f3148102af0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:08.374 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.371+0000 7f314e3ff700 1 -- 172.21.15.8:0/1228733790 >> 172.21.15.8:0/1228733790 conn(0x7f31480fca10 msgr2=0x7f31480fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:08.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.371+0000 7f314e3ff700 1 -- 172.21.15.8:0/1228733790 shutdown_connections 2023-12-17T12:04:08.375 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.371+0000 7f314e3ff700 1 -- 172.21.15.8:0/1228733790 wait complete. 2023-12-17T12:04:08.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.372+0000 7f314e3ff700 1 Processor -- start 2023-12-17T12:04:08.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.372+0000 7f314e3ff700 1 -- start start 2023-12-17T12:04:08.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.372+0000 7f314e3ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31481014a0 0x7f3148199560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:08.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.372+0000 7f314e3ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3148102690 0x7f3148199aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:08.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.372+0000 7f314e3ff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3148103030 0x7f31481a0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:08.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.373+0000 7f314e3ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31481a1090 con 0x7f31481014a0 2023-12-17T12:04:08.377 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.373+0000 7f314e3ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31481a11d0 con 0x7f3148102690 2023-12-17T12:04:08.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.373+0000 7f314e3ff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31481a1360 con 0x7f3148103030 2023-12-17T12:04:08.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.373+0000 7f3147fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31481014a0 0x7f3148199560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:08.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.373+0000 7f3147fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31481014a0 0x7f3148199560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49698/0 (socket says 172.21.15.8:49698) 2023-12-17T12:04:08.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.373+0000 7f3147fff700 1 -- 172.21.15.8:0/3664465645 learned_addr learned my addr 172.21.15.8:0/3664465645 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:04:08.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.373+0000 7f314c99c700 1 --2- 172.21.15.8:0/3664465645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3148103030 0x7f31481a0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:08.378 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.373+0000 7f31477fe700 1 --2- 172.21.15.8:0/3664465645 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3148102690 0x7f3148199aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:08.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.373+0000 7f3147fff700 1 -- 172.21.15.8:0/3664465645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3148103030 msgr2=0x7f31481a0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:08.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.373+0000 7f3147fff700 1 --2- 172.21.15.8:0/3664465645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3148103030 0x7f31481a0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:08.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.373+0000 7f3147fff700 1 -- 172.21.15.8:0/3664465645 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3148102690 msgr2=0x7f3148199aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:08.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.373+0000 7f3147fff700 1 --2- 172.21.15.8:0/3664465645 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3148102690 0x7f3148199aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:08.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.373+0000 7f3147fff700 1 -- 172.21.15.8:0/3664465645 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f313c0095f0 con 0x7f31481014a0 2023-12-17T12:04:08.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.373+0000 7f3147fff700 1 --2- 172.21.15.8:0/3664465645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31481014a0 0x7f3148199560 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f313800d980 tx=0x7f313800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:08.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.374+0000 7f31457fa700 1 -- 172.21.15.8:0/3664465645 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3138004020 con 0x7f31481014a0 2023-12-17T12:04:08.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.374+0000 7f314e3ff700 1 -- 172.21.15.8:0/3664465645 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31481a1640 con 0x7f31481014a0 2023-12-17T12:04:08.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.374+0000 7f31457fa700 1 -- 172.21.15.8:0/3664465645 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3138009730 con 0x7f31481014a0 2023-12-17T12:04:08.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.374+0000 7f31457fa700 1 -- 172.21.15.8:0/3664465645 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31380039c0 con 0x7f31481014a0 2023-12-17T12:04:08.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.374+0000 7f314e3ff700 1 -- 172.21.15.8:0/3664465645 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31481a1b50 con 0x7f31481014a0 2023-12-17T12:04:08.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.375+0000 7f314e3ff700 1 -- 172.21.15.8:0/3664465645 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3148068230 con 0x7f31481014a0 2023-12-17T12:04:08.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.378+0000 7f31457fa700 1 -- 172.21.15.8:0/3664465645 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f31380098a0 con 0x7f31481014a0 2023-12-17T12:04:08.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.380+0000 7f31457fa700 1 --2- 172.21.15.8:0/3664465645 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f31300a1510 0x7f31300a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:08.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.380+0000 7f31457fa700 1 -- 172.21.15.8:0/3664465645 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f31380ccf80 con 0x7f31481014a0 2023-12-17T12:04:08.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.380+0000 7f31477fe700 1 --2- 172.21.15.8:0/3664465645 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f31300a1510 0x7f31300a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:08.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.381+0000 7f31477fe700 1 --2- 172.21.15.8:0/3664465645 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f31300a1510 0x7f31300a39d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f313c00c010 tx=0x7f313c005fb0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:08.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.382+0000 7f31457fa700 1 -- 172.21.15.8:0/3664465645 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f3138096400 con 0x7f31481014a0 2023-12-17T12:04:08.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.648+0000 7f314e3ff700 1 -- 172.21.15.8:0/3664465645 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f314810cbc0 con 0x7f31481014a0 2023-12-17T12:04:08.650 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.648+0000 7f31457fa700 1 -- 172.21.15.8:0/3664465645 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11347 (secure 0 0 0) 0x7f3138099a20 con 0x7f31481014a0 2023-12-17T12:04:08.651 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:04:08.651 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2669069079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2669069079},{"type":"v1","addr":"172.21.15.8:6835","nonce":2669069079}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/4241050553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":4241050553},{"type":"v1","addr":"172.21.15.8:6837","nonce":4241050553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-17T12:02:50.176951+0000","modified":"2023-12-17T12:02:58.040005+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24569,"mds_1":24541,"mds_2":24503,"mds_3":24470,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14640":{"gid":14640,"name":"f","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/2765387309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2765387309},{"type":"v1","addr":"172.21.15.186:6835","nonce":2765387309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14679":{"gid":14679,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/487046247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":487046247},{"type":"v1","addr":"172.21.15.8:6839","nonce":487046247}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14691":{"gid":14691,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6841/338406768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":338406768},{"type":"v1","addr":"172.21.15.8:6841","nonce":338406768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24451":{"gid":24451,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.186:6833/582753561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":582753561},{"type":"v1","addr":"172.21.15.186:6833","nonce":582753561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24470":{"gid":24470,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.100:6833/305815776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":305815776},{"type":"v1","addr":"172.21.15.100:6833","nonce":305815776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24503":{"gid":24503,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6835/2140351853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2140351853},{"type":"v1","addr":"172.21.15.100:6835","nonce":2140351853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24520":{"gid":24520,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/822451724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":822451724},{"type":"v1","addr":"172.21.15.186:6837","nonce":822451724}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24530":{"gid":24530,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6837/4176831844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":4176831844},{"type":"v1","addr":"172.21.15.100:6837","nonce":4176831844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.186:6839/91602342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":91602342},{"type":"v1","addr":"172.21.15.186:6839","nonce":91602342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24569":{"gid":24569,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6839/3921737538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3921737538},{"type":"v1","addr":"172.21.15.100:6839","nonce":3921737538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-17T12:04:08.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.651+0000 7f314e3ff700 1 -- 172.21.15.8:0/3664465645 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f31300a1510 msgr2=0x7f31300a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:08.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.651+0000 7f314e3ff700 1 --2- 172.21.15.8:0/3664465645 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f31300a1510 0x7f31300a39d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f313c00c010 tx=0x7f313c005fb0 comp rx=0 tx=0).stop 2023-12-17T12:04:08.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.651+0000 7f314e3ff700 1 -- 172.21.15.8:0/3664465645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31481014a0 msgr2=0x7f3148199560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:08.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.651+0000 7f314e3ff700 1 --2- 172.21.15.8:0/3664465645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31481014a0 0x7f3148199560 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f313800d980 tx=0x7f313800dc90 comp rx=0 tx=0).stop 2023-12-17T12:04:08.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.651+0000 7f314e3ff700 1 -- 172.21.15.8:0/3664465645 shutdown_connections 2023-12-17T12:04:08.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.651+0000 7f314e3ff700 1 --2- 172.21.15.8:0/3664465645 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f31300a1510 0x7f31300a39d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:08.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.651+0000 7f314e3ff700 1 --2- 172.21.15.8:0/3664465645 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3148103030 0x7f31481a0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:08.654 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.651+0000 7f314e3ff700 1 --2- 172.21.15.8:0/3664465645 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f31481014a0 0x7f3148199560 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:08.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.651+0000 7f314e3ff700 1 --2- 172.21.15.8:0/3664465645 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f3148102690 0x7f3148199aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:08.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.651+0000 7f314e3ff700 1 -- 172.21.15.8:0/3664465645 >> 172.21.15.8:0/3664465645 conn(0x7f31480fca10 msgr2=0x7f3148073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:08.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.651+0000 7f314e3ff700 1 -- 172.21.15.8:0/3664465645 shutdown_connections 2023-12-17T12:04:08.655 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.651+0000 7f314e3ff700 1 -- 172.21.15.8:0/3664465645 wait complete. 2023-12-17T12:04:08.655 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 27 2023-12-17T12:04:08.672 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-17T12:04:08.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.874+0000 7f5b13bff700 1 -- 172.21.15.8:0/1866876199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b0c1014a0 msgr2=0x7f5b0c1018c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:08.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.874+0000 7f5b13bff700 1 --2- 172.21.15.8:0/1866876199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b0c1014a0 0x7f5b0c1018c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f5b080099c0 tx=0x7f5b08009cd0 comp rx=0 tx=0).stop 2023-12-17T12:04:08.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.874+0000 7f5b13bff700 1 -- 172.21.15.8:0/1866876199 shutdown_connections 2023-12-17T12:04:08.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.874+0000 7f5b13bff700 1 --2- 172.21.15.8:0/1866876199 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b0c103030 0x7f5b0c1098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:08.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.874+0000 7f5b13bff700 1 --2- 172.21.15.8:0/1866876199 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b0c1014a0 0x7f5b0c1018c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:08.877 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.874+0000 7f5b13bff700 1 --2- 172.21.15.8:0/1866876199 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b0c102690 0x7f5b0c102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:08.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.874+0000 7f5b13bff700 1 -- 172.21.15.8:0/1866876199 >> 172.21.15.8:0/1866876199 conn(0x7f5b0c0fca10 msgr2=0x7f5b0c0fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:08.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.874+0000 7f5b13bff700 1 -- 172.21.15.8:0/1866876199 shutdown_connections 2023-12-17T12:04:08.878 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.874+0000 7f5b13bff700 1 -- 172.21.15.8:0/1866876199 wait complete. 2023-12-17T12:04:08.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.875+0000 7f5b13bff700 1 Processor -- start 2023-12-17T12:04:08.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.875+0000 7f5b13bff700 1 -- start start 2023-12-17T12:04:08.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.876+0000 7f5b13bff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b0c1014a0 0x7f5b0c199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:08.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.876+0000 7f5b13bff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b0c102690 0x7f5b0c199ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:08.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.876+0000 7f5b13bff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b0c103030 0x7f5b0c1a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:08.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.876+0000 7f5b13bff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c1a10c0 con 0x7f5b0c1014a0 2023-12-17T12:04:08.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.876+0000 7f5b13bff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c1a1200 con 0x7f5b0c103030 2023-12-17T12:04:08.880 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.876+0000 7f5b13bff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c1a1390 con 0x7f5b0c102690 2023-12-17T12:04:08.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.876+0000 7f5b1199b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b0c1014a0 0x7f5b0c199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:08.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.876+0000 7f5b1199b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b0c1014a0 0x7f5b0c199590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49714/0 (socket says 172.21.15.8:49714) 2023-12-17T12:04:08.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.876+0000 7f5b1199b700 1 -- 172.21.15.8:0/1190557881 learned_addr learned my addr 172.21.15.8:0/1190557881 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:04:08.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.876+0000 7f5b1219c700 1 --2- 172.21.15.8:0/1190557881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b0c103030 0x7f5b0c1a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:08.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.876+0000 7f5b1119a700 1 --2- 172.21.15.8:0/1190557881 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b0c102690 0x7f5b0c199ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:08.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.876+0000 7f5b1199b700 1 -- 172.21.15.8:0/1190557881 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b0c102690 msgr2=0x7f5b0c199ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:08.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.876+0000 7f5b1199b700 1 --2- 172.21.15.8:0/1190557881 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b0c102690 0x7f5b0c199ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:08.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.876+0000 7f5b1199b700 1 -- 172.21.15.8:0/1190557881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b0c103030 msgr2=0x7f5b0c1a0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:08.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.876+0000 7f5b1199b700 1 --2- 172.21.15.8:0/1190557881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b0c103030 0x7f5b0c1a0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:08.881 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.876+0000 7f5b1199b700 1 -- 172.21.15.8:0/1190557881 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b080095f0 con 0x7f5b0c1014a0 2023-12-17T12:04:08.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.876+0000 7f5b1219c700 1 --2- 172.21.15.8:0/1190557881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b0c103030 0x7f5b0c1a0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-17T12:04:08.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.877+0000 7f5b1199b700 1 --2- 172.21.15.8:0/1190557881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b0c1014a0 0x7f5b0c199590 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5b08009f50 tx=0x7f5b08003b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:08.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.877+0000 7f5b02ffd700 1 -- 172.21.15.8:0/1190557881 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0801d070 con 0x7f5b0c1014a0 2023-12-17T12:04:08.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.877+0000 7f5b02ffd700 1 -- 172.21.15.8:0/1190557881 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5b0800bda0 con 0x7f5b0c1014a0 2023-12-17T12:04:08.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.877+0000 7f5b02ffd700 1 -- 172.21.15.8:0/1190557881 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b08022dc0 con 0x7f5b0c1014a0 2023-12-17T12:04:08.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.877+0000 7f5b13bff700 1 -- 172.21.15.8:0/1190557881 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b0c1a1610 con 0x7f5b0c1014a0 2023-12-17T12:04:08.882 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.877+0000 7f5b13bff700 1 -- 172.21.15.8:0/1190557881 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b0c1a19e0 con 0x7f5b0c1014a0 2023-12-17T12:04:08.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.878+0000 7f5b13bff700 1 -- 172.21.15.8:0/1190557881 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b0c068230 con 0x7f5b0c1014a0 2023-12-17T12:04:08.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.880+0000 7f5b02ffd700 1 -- 172.21.15.8:0/1190557881 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f5b08004000 con 0x7f5b0c1014a0 2023-12-17T12:04:08.883 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.881+0000 7f5b02ffd700 1 --2- 172.21.15.8:0/1190557881 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f5af80a1510 0x7f5af80a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:08.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.881+0000 7f5b02ffd700 1 -- 172.21.15.8:0/1190557881 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f5b080ce3e0 con 0x7f5b0c1014a0 2023-12-17T12:04:08.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.881+0000 7f5b1119a700 1 --2- 172.21.15.8:0/1190557881 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f5af80a1510 0x7f5af80a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:08.884 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.882+0000 7f5b1119a700 1 --2- 172.21.15.8:0/1190557881 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f5af80a1510 0x7f5af80a39d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5afc00bbd0 tx=0x7f5afc00b5b0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:08.887 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:08.885+0000 7f5b02ffd700 1 -- 172.21.15.8:0/1190557881 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f5b080978f0 con 0x7f5b0c1014a0 2023-12-17T12:04:08.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:08 smithi100 ceph-mon[41266]: pgmap v305: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2023-12-17T12:04:08.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:08 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/3383767399' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-12-17T12:04:08.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:08 smithi186 ceph-mon[41182]: pgmap v305: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2023-12-17T12:04:08.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:08 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/3383767399' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-12-17T12:04:08.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:08 smithi008 ceph-mon[36830]: pgmap v305: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2023-12-17T12:04:08.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:08 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/3383767399' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-12-17T12:04:09.151 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.149+0000 7f5b13bff700 1 -- 172.21.15.8:0/1190557881 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b0c10cbb0 con 0x7f5b0c1014a0 2023-12-17T12:04:09.152 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.150+0000 7f5b02ffd700 1 -- 172.21.15.8:0/1190557881 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+11347 (secure 0 0 0) 0x7f5b0809af10 con 0x7f5b0c1014a0 2023-12-17T12:04:09.152 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:04:09.152 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14604,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6835/2669069079","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6834","nonce":2669069079},{"type":"v1","addr":"172.21.15.8:6835","nonce":2669069079}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":4},{"gid":14616,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.8:6837/4241050553","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6836","nonce":4241050553},{"type":"v1","addr":"172.21.15.8:6837","nonce":4241050553}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-12-17T12:02:50.176951+0000","modified":"2023-12-17T12:02:58.040005+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24569,"mds_1":24541,"mds_2":24503,"mds_3":24470,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14640":{"gid":14640,"name":"f","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6835/2765387309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":2765387309},{"type":"v1","addr":"172.21.15.186:6835","nonce":2765387309}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14679":{"gid":14679,"name":"g","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6839/487046247","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6838","nonce":487046247},{"type":"v1","addr":"172.21.15.8:6839","nonce":487046247}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_14691":{"gid":14691,"name":"a","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.8:6841/338406768","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6840","nonce":338406768},{"type":"v1","addr":"172.21.15.8:6841","nonce":338406768}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24451":{"gid":24451,"name":"l","rank":4,"incarnation":25,"state":"up:active","state_seq":12,"addr":"172.21.15.186:6833/582753561","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":582753561},{"type":"v1","addr":"172.21.15.186:6833","nonce":582753561}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24470":{"gid":24470,"name":"k","rank":3,"incarnation":23,"state":"up:active","state_seq":11,"addr":"172.21.15.100:6833/305815776","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6832","nonce":305815776},{"type":"v1","addr":"172.21.15.100:6833","nonce":305815776}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24503":{"gid":24503,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":9,"addr":"172.21.15.100:6835/2140351853","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6834","nonce":2140351853},{"type":"v1","addr":"172.21.15.100:6835","nonce":2140351853}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24520":{"gid":24520,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.186:6837/822451724","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6836","nonce":822451724},{"type":"v1","addr":"172.21.15.186:6837","nonce":822451724}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24530":{"gid":24530,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.100:6837/4176831844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6836","nonce":4176831844},{"type":"v1","addr":"172.21.15.100:6837","nonce":4176831844}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24541":{"gid":24541,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.186:6839/91602342","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6838","nonce":91602342},{"type":"v1","addr":"172.21.15.186:6839","nonce":91602342}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}},"gid_24569":{"gid":24569,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.100:6839/3921737538","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6838","nonce":3921737538},{"type":"v1","addr":"172.21.15.100:6839","nonce":3921737538}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-17T12:04:09.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.152+0000 7f5b13bff700 1 -- 172.21.15.8:0/1190557881 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f5af80a1510 msgr2=0x7f5af80a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:09.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.152+0000 7f5b13bff700 1 --2- 172.21.15.8:0/1190557881 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f5af80a1510 0x7f5af80a39d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5afc00bbd0 tx=0x7f5afc00b5b0 comp rx=0 tx=0).stop 2023-12-17T12:04:09.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.152+0000 7f5b13bff700 1 -- 172.21.15.8:0/1190557881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b0c1014a0 msgr2=0x7f5b0c199590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:09.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.152+0000 7f5b13bff700 1 --2- 172.21.15.8:0/1190557881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b0c1014a0 0x7f5b0c199590 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f5b08009f50 tx=0x7f5b08003b00 comp rx=0 tx=0).stop 2023-12-17T12:04:09.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.153+0000 7f5b13bff700 1 -- 172.21.15.8:0/1190557881 shutdown_connections 2023-12-17T12:04:09.155 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.153+0000 7f5b13bff700 1 --2- 172.21.15.8:0/1190557881 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f5af80a1510 0x7f5af80a39d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:09.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.153+0000 7f5b13bff700 1 --2- 172.21.15.8:0/1190557881 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f5b0c103030 0x7f5b0c1a0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:09.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.153+0000 7f5b13bff700 1 --2- 172.21.15.8:0/1190557881 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f5b0c1014a0 0x7f5b0c199590 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:09.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.153+0000 7f5b13bff700 1 --2- 172.21.15.8:0/1190557881 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b0c102690 0x7f5b0c199ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:09.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.153+0000 7f5b13bff700 1 -- 172.21.15.8:0/1190557881 >> 172.21.15.8:0/1190557881 conn(0x7f5b0c0fca10 msgr2=0x7f5b0c107eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:09.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.153+0000 7f5b13bff700 1 -- 172.21.15.8:0/1190557881 shutdown_connections 2023-12-17T12:04:09.156 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.153+0000 7f5b13bff700 1 -- 172.21.15.8:0/1190557881 wait complete. 2023-12-17T12:04:09.157 INFO:teuthology.orchestra.run.smithi008.stderr:dumped fsmap epoch 27 2023-12-17T12:04:09.174 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-17T12:04:09.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.377+0000 7f5102fff700 1 -- 172.21.15.8:0/1684571010 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50fc103030 msgr2=0x7f50fc1098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:09.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.377+0000 7f5102fff700 1 --2- 172.21.15.8:0/1684571010 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50fc103030 0x7f50fc1098e0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f50f400b0d0 tx=0x7f50f400b3e0 comp rx=0 tx=0).stop 2023-12-17T12:04:09.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.377+0000 7f5102fff700 1 -- 172.21.15.8:0/1684571010 shutdown_connections 2023-12-17T12:04:09.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.377+0000 7f5102fff700 1 --2- 172.21.15.8:0/1684571010 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50fc103030 0x7f50fc1098e0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:09.379 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.377+0000 7f5102fff700 1 --2- 172.21.15.8:0/1684571010 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50fc1014a0 0x7f50fc1018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:09.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.377+0000 7f5102fff700 1 --2- 172.21.15.8:0/1684571010 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50fc102690 0x7f50fc102af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:09.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.377+0000 7f5102fff700 1 -- 172.21.15.8:0/1684571010 >> 172.21.15.8:0/1684571010 conn(0x7f50fc0fca10 msgr2=0x7f50fc0fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:09.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.377+0000 7f5102fff700 1 -- 172.21.15.8:0/1684571010 shutdown_connections 2023-12-17T12:04:09.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.377+0000 7f5102fff700 1 -- 172.21.15.8:0/1684571010 wait complete. 2023-12-17T12:04:09.380 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.378+0000 7f5102fff700 1 Processor -- start 2023-12-17T12:04:09.381 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.378+0000 7f5102fff700 1 -- start start 2023-12-17T12:04:09.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.379+0000 7f5102fff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50fc1014a0 0x7f50fc1996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:09.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.379+0000 7f5102fff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50fc102690 0x7f50fc199c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:09.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.379+0000 7f5102fff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50fc103030 0x7f50fc1a0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:09.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.379+0000 7f5102fff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50fc1a11c0 con 0x7f50fc103030 2023-12-17T12:04:09.382 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.379+0000 7f5102fff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50fc1a1300 con 0x7f50fc102690 2023-12-17T12:04:09.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.379+0000 7f5102fff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50fc1a1490 con 0x7f50fc1014a0 2023-12-17T12:04:09.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.379+0000 7f510159c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50fc103030 0x7f50fc1a0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:09.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.379+0000 7f510159c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50fc103030 0x7f50fc1a0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49738/0 (socket says 172.21.15.8:49738) 2023-12-17T12:04:09.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.379+0000 7f510159c700 1 -- 172.21.15.8:0/2085238077 learned_addr learned my addr 172.21.15.8:0/2085238077 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:04:09.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.379+0000 7f50fbfff700 1 --2- 172.21.15.8:0/2085238077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50fc102690 0x7f50fc199c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:09.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.379+0000 7f5100d9b700 1 --2- 172.21.15.8:0/2085238077 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50fc1014a0 0x7f50fc1996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:09.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.380+0000 7f510159c700 1 -- 172.21.15.8:0/2085238077 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50fc1014a0 msgr2=0x7f50fc1996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:09.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.380+0000 7f510159c700 1 --2- 172.21.15.8:0/2085238077 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50fc1014a0 0x7f50fc1996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:09.383 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.380+0000 7f510159c700 1 -- 172.21.15.8:0/2085238077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50fc102690 msgr2=0x7f50fc199c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:09.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.380+0000 7f510159c700 1 --2- 172.21.15.8:0/2085238077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50fc102690 0x7f50fc199c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:09.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.380+0000 7f510159c700 1 -- 172.21.15.8:0/2085238077 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f4009d00 con 0x7f50fc103030 2023-12-17T12:04:09.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.380+0000 7f510159c700 1 --2- 172.21.15.8:0/2085238077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50fc103030 0x7f50fc1a0bf0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f50f4007b60 tx=0x7f50f4009440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:09.384 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.380+0000 7f50f9ffb700 1 -- 172.21.15.8:0/2085238077 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f400e040 con 0x7f50fc103030 2023-12-17T12:04:09.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.380+0000 7f5102fff700 1 -- 172.21.15.8:0/2085238077 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50fc1a1710 con 0x7f50fc103030 2023-12-17T12:04:09.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.380+0000 7f50f9ffb700 1 -- 172.21.15.8:0/2085238077 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f50f4012d90 con 0x7f50fc103030 2023-12-17T12:04:09.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.380+0000 7f50f9ffb700 1 -- 172.21.15.8:0/2085238077 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f401de80 con 0x7f50fc103030 2023-12-17T12:04:09.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.380+0000 7f5102fff700 1 -- 172.21.15.8:0/2085238077 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50fc1a1b90 con 0x7f50fc103030 2023-12-17T12:04:09.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.381+0000 7f5102fff700 1 -- 172.21.15.8:0/2085238077 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50fc068230 con 0x7f50fc103030 2023-12-17T12:04:09.385 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.383+0000 7f50f9ffb700 1 -- 172.21.15.8:0/2085238077 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f50f4012900 con 0x7f50fc103030 2023-12-17T12:04:09.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.385+0000 7f50f9ffb700 1 --2- 172.21.15.8:0/2085238077 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f50ec0a1510 0x7f50ec0a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:09.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.385+0000 7f50f9ffb700 1 -- 172.21.15.8:0/2085238077 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f50f40ced00 con 0x7f50fc103030 2023-12-17T12:04:09.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.385+0000 7f5100d9b700 1 --2- 172.21.15.8:0/2085238077 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f50ec0a1510 0x7f50ec0a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:09.387 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.385+0000 7f5100d9b700 1 --2- 172.21.15.8:0/2085238077 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f50ec0a1510 0x7f50ec0a39d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f50f0005950 tx=0x7f50f00058e0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:09.390 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.388+0000 7f50f9ffb700 1 -- 172.21.15.8:0/2085238077 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f50f4098210 con 0x7f50fc103030 2023-12-17T12:04:09.607 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.605+0000 7f5102fff700 1 -- 172.21.15.8:0/2085238077 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f50fc10cdd0 con 0x7f50fc103030 2023-12-17T12:04:09.608 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.606+0000 7f50f9ffb700 1 -- 172.21.15.8:0/2085238077 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22518 (secure 0 0 0) 0x7f50f409b830 con 0x7f50fc103030 2023-12-17T12:04:09.609 INFO:teuthology.orchestra.run.smithi008.stdout: 2023-12-17T12:04:09.609 INFO:teuthology.orchestra.run.smithi008.stdout:{"epoch":85,"fsid":"f43f508a-9cd2-11ee-95a5-87774f69a715","created":"2023-12-17T11:55:30.666634+0000","modified":"2023-12-17T12:03:28.446977+0000","last_up_change":"2023-12-17T12:02:04.656573+0000","last_in_change":"2023-12-17T12:01:45.526832+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-17T11:58:43.972745+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-17T12:02:48.278153+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-17T12:02:49.637968+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c1f8acaf-a47b-4b74-a78d-e0b6be49a10e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6802","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6803","nonce":297519189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6804","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6805","nonce":297519189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6808","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6809","nonce":297519189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6806","nonce":297519189},{"type":"v1","addr":"172.21.15.8:6807","nonce":297519189}]},"public_addr":"172.21.15.8:6803/297519189","cluster_addr":"172.21.15.8:6805/297519189","heartbeat_back_addr":"172.21.15.8:6809/297519189","heartbeat_front_addr":"172.21.15.8:6807/297519189","state":["exists","up"]},{"osd":1,"uuid":"d7138889-77de-43ba-b36b-7628f6f66bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6800","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6801","nonce":2496516573}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6802","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6803","nonce":2496516573}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6806","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6807","nonce":2496516573}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6804","nonce":2496516573},{"type":"v1","addr":"172.21.15.100:6805","nonce":2496516573}]},"public_addr":"172.21.15.100:6801/2496516573","cluster_addr":"172.21.15.100:6803/2496516573","heartbeat_back_addr":"172.21.15.100:6807/2496516573","heartbeat_front_addr":"172.21.15.100:6805/2496516573","state":["exists","up"]},{"osd":2,"uuid":"ff452a6b-a11e-47be-9eaf-ec1001b51447","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6801","nonce":2454925270}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6803","nonce":2454925270}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6807","nonce":2454925270}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":2454925270},{"type":"v1","addr":"172.21.15.186:6805","nonce":2454925270}]},"public_addr":"172.21.15.186:6801/2454925270","cluster_addr":"172.21.15.186:6803/2454925270","heartbeat_back_addr":"172.21.15.186:6807/2454925270","heartbeat_front_addr":"172.21.15.186:6805/2454925270","state":["exists","up"]},{"osd":3,"uuid":"d19ab765-df7b-48c7-9012-8a3ac7d81aca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6810","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6811","nonce":1141622701}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6812","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6813","nonce":1141622701}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6816","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6817","nonce":1141622701}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6814","nonce":1141622701},{"type":"v1","addr":"172.21.15.8:6815","nonce":1141622701}]},"public_addr":"172.21.15.8:6811/1141622701","cluster_addr":"172.21.15.8:6813/1141622701","heartbeat_back_addr":"172.21.15.8:6817/1141622701","heartbeat_front_addr":"172.21.15.8:6815/1141622701","state":["exists","up"]},{"osd":4,"uuid":"8ecc3a01-f19a-40a7-93a2-8870116afe6f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6808","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6809","nonce":1902152516}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6810","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6811","nonce":1902152516}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6814","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6815","nonce":1902152516}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6812","nonce":1902152516},{"type":"v1","addr":"172.21.15.100:6813","nonce":1902152516}]},"public_addr":"172.21.15.100:6809/1902152516","cluster_addr":"172.21.15.100:6811/1902152516","heartbeat_back_addr":"172.21.15.100:6815/1902152516","heartbeat_front_addr":"172.21.15.100:6813/1902152516","state":["exists","up"]},{"osd":5,"uuid":"ac057cc9-2a27-4216-a7ae-fc60d9796eea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6809","nonce":648349934}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6811","nonce":648349934}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6815","nonce":648349934}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":648349934},{"type":"v1","addr":"172.21.15.186:6813","nonce":648349934}]},"public_addr":"172.21.15.186:6809/648349934","cluster_addr":"172.21.15.186:6811/648349934","heartbeat_back_addr":"172.21.15.186:6815/648349934","heartbeat_front_addr":"172.21.15.186:6813/648349934","state":["exists","up"]},{"osd":6,"uuid":"bb5325e0-fe12-4bbc-96a9-86c228106a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6818","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6819","nonce":3266909294}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6820","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6821","nonce":3266909294}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6824","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6825","nonce":3266909294}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6822","nonce":3266909294},{"type":"v1","addr":"172.21.15.8:6823","nonce":3266909294}]},"public_addr":"172.21.15.8:6819/3266909294","cluster_addr":"172.21.15.8:6821/3266909294","heartbeat_back_addr":"172.21.15.8:6825/3266909294","heartbeat_front_addr":"172.21.15.8:6823/3266909294","state":["exists","up"]},{"osd":7,"uuid":"48939d99-29dd-436b-b9f1-fdfe1ee26315","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6816","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6817","nonce":1631494583}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6818","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6819","nonce":1631494583}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6822","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6823","nonce":1631494583}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6820","nonce":1631494583},{"type":"v1","addr":"172.21.15.100:6821","nonce":1631494583}]},"public_addr":"172.21.15.100:6817/1631494583","cluster_addr":"172.21.15.100:6819/1631494583","heartbeat_back_addr":"172.21.15.100:6823/1631494583","heartbeat_front_addr":"172.21.15.100:6821/1631494583","state":["exists","up"]},{"osd":8,"uuid":"e3414f7f-7665-406f-89ec-79cbb3d3e274","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":58,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6817","nonce":3569004799}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6819","nonce":3569004799}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6823","nonce":3569004799}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":3569004799},{"type":"v1","addr":"172.21.15.186:6821","nonce":3569004799}]},"public_addr":"172.21.15.186:6817/3569004799","cluster_addr":"172.21.15.186:6819/3569004799","heartbeat_back_addr":"172.21.15.186:6823/3569004799","heartbeat_front_addr":"172.21.15.186:6821/3569004799","state":["exists","up"]},{"osd":9,"uuid":"b04f519d-6e44-4158-b6e1-aa4d64be3404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":65,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6826","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6827","nonce":3980647643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6828","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6829","nonce":3980647643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6832","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6833","nonce":3980647643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.8:6830","nonce":3980647643},{"type":"v1","addr":"172.21.15.8:6831","nonce":3980647643}]},"public_addr":"172.21.15.8:6827/3980647643","cluster_addr":"172.21.15.8:6829/3980647643","heartbeat_back_addr":"172.21.15.8:6833/3980647643","heartbeat_front_addr":"172.21.15.8:6831/3980647643","state":["exists","up"]},{"osd":10,"uuid":"779fde04-620b-4b44-bd35-39be1470eec4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6824","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6825","nonce":34112410}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6826","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6827","nonce":34112410}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6830","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6831","nonce":34112410}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.100:6828","nonce":34112410},{"type":"v1","addr":"172.21.15.100:6829","nonce":34112410}]},"public_addr":"172.21.15.100:6825/34112410","cluster_addr":"172.21.15.100:6827/34112410","heartbeat_back_addr":"172.21.15.100:6831/34112410","heartbeat_front_addr":"172.21.15.100:6829/34112410","state":["exists","up"]},{"osd":11,"uuid":"6bbcb42f-aa99-44e4-9c3f-d818423eb5b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":78,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6825","nonce":3779371472}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6827","nonce":3779371472}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6831","nonce":3779371472}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":3779371472},{"type":"v1","addr":"172.21.15.186:6829","nonce":3779371472}]},"public_addr":"172.21.15.186:6825/3779371472","cluster_addr":"172.21.15.186:6827/3779371472","heartbeat_back_addr":"172.21.15.186:6831/3779371472","heartbeat_front_addr":"172.21.15.186:6829/3779371472","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:57:56.955667+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:58:18.433916+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:58:40.589590+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:59:03.635858+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:59:25.544564+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T11:59:48.171593+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:00:10.876885+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:00:32.920759+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:00:55.273330+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:01:18.131720+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:01:40.259620+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-17T12:02:02.776536+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"3.11","mappings":[{"from":4,"to":8}]},{"pgid":"3.12","mappings":[{"from":3,"to":9}]},{"pgid":"3.19","mappings":[{"from":3,"to":6}]},{"pgid":"3.21","mappings":[{"from":4,"to":6}]},{"pgid":"3.26","mappings":[{"from":1,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":7}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"3.39","mappings":[{"from":5,"to":8}]},{"pgid":"3.3a","mappings":[{"from":4,"to":7}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.8:0/4074020814":"2023-12-18T11:56:27.362306+0000","172.21.15.8:6801/222068650":"2023-12-18T11:56:27.362306+0000","172.21.15.8:6801/4187398661":"2023-12-18T11:56:00.731492+0000","172.21.15.8:6800/222068650":"2023-12-18T11:56:27.362306+0000","172.21.15.8:6800/4187398661":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/2964092603":"2023-12-18T11:56:27.362306+0000","172.21.15.8:0/35186087":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/1429868241":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/174719729":"2023-12-18T11:56:00.731492+0000","172.21.15.8:0/2106317618":"2023-12-18T11:56:27.362306+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-17T12:04:09.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.608+0000 7f5102fff700 1 -- 172.21.15.8:0/2085238077 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f50ec0a1510 msgr2=0x7f50ec0a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:09.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.609+0000 7f5102fff700 1 --2- 172.21.15.8:0/2085238077 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f50ec0a1510 0x7f50ec0a39d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f50f0005950 tx=0x7f50f00058e0 comp rx=0 tx=0).stop 2023-12-17T12:04:09.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.609+0000 7f5102fff700 1 -- 172.21.15.8:0/2085238077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50fc103030 msgr2=0x7f50fc1a0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:09.611 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.609+0000 7f5102fff700 1 --2- 172.21.15.8:0/2085238077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50fc103030 0x7f50fc1a0bf0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f50f4007b60 tx=0x7f50f4009440 comp rx=0 tx=0).stop 2023-12-17T12:04:09.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.609+0000 7f5102fff700 1 -- 172.21.15.8:0/2085238077 shutdown_connections 2023-12-17T12:04:09.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.609+0000 7f5102fff700 1 --2- 172.21.15.8:0/2085238077 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f50ec0a1510 0x7f50ec0a39d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:09.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.609+0000 7f5102fff700 1 --2- 172.21.15.8:0/2085238077 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f50fc103030 0x7f50fc1a0bf0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:09.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.609+0000 7f5102fff700 1 --2- 172.21.15.8:0/2085238077 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f50fc1014a0 0x7f50fc1996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:09.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.609+0000 7f5102fff700 1 --2- 172.21.15.8:0/2085238077 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f50fc102690 0x7f50fc199c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:09.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.609+0000 7f5102fff700 1 -- 172.21.15.8:0/2085238077 >> 172.21.15.8:0/2085238077 conn(0x7f50fc0fca10 msgr2=0x7f50fc073800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:09.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.609+0000 7f5102fff700 1 -- 172.21.15.8:0/2085238077 shutdown_connections 2023-12-17T12:04:09.612 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.609+0000 7f5102fff700 1 -- 172.21.15.8:0/2085238077 wait complete. 2023-12-17T12:04:09.631 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-17T12:04:09.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.835+0000 7f4798bff700 1 -- 172.21.15.8:0/733915851 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4794109460 msgr2=0x7f479410b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:09.837 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.835+0000 7f4798bff700 1 --2- 172.21.15.8:0/733915851 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4794109460 0x7f479410b8f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f478c00b0a0 tx=0x7f478c00b3b0 comp rx=0 tx=0).stop 2023-12-17T12:04:09.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.835+0000 7f4798bff700 1 -- 172.21.15.8:0/733915851 shutdown_connections 2023-12-17T12:04:09.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.835+0000 7f4798bff700 1 --2- 172.21.15.8:0/733915851 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4794109460 0x7f479410b8f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:09.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.835+0000 7f4798bff700 1 --2- 172.21.15.8:0/733915851 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4794075610 0x7f4794073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:09.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.835+0000 7f4798bff700 1 --2- 172.21.15.8:0/733915851 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4794074030 0x7f47940744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:09.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.835+0000 7f4798bff700 1 -- 172.21.15.8:0/733915851 >> 172.21.15.8:0/733915851 conn(0x7f47940fcb10 msgr2=0x7f47940fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:09.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.835+0000 7f4798bff700 1 -- 172.21.15.8:0/733915851 shutdown_connections 2023-12-17T12:04:09.838 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.835+0000 7f4798bff700 1 -- 172.21.15.8:0/733915851 wait complete. 2023-12-17T12:04:09.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.836+0000 7f4798bff700 1 Processor -- start 2023-12-17T12:04:09.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.836+0000 7f4798bff700 1 -- start start 2023-12-17T12:04:09.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.836+0000 7f4798bff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4794074030 0x7f4794199770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:09.840 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.836+0000 7f4798bff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4794075610 0x7f4794199cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:09.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.836+0000 7f4798bff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4794109460 0x7f47941a0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:09.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.836+0000 7f4798bff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47941a12a0 con 0x7f4794074030 2023-12-17T12:04:09.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.836+0000 7f4798bff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47941a13e0 con 0x7f4794075610 2023-12-17T12:04:09.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.836+0000 7f4798bff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47941a1570 con 0x7f4794109460 2023-12-17T12:04:09.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.837+0000 7f479259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4794074030 0x7f4794199770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:09.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.837+0000 7f479259c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4794074030 0x7f4794199770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49766/0 (socket says 172.21.15.8:49766) 2023-12-17T12:04:09.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.837+0000 7f479259c700 1 -- 172.21.15.8:0/3179183095 learned_addr learned my addr 172.21.15.8:0/3179183095 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:04:09.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.837+0000 7f4792d9d700 1 --2- 172.21.15.8:0/3179183095 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4794109460 0x7f47941a0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:09.841 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.837+0000 7f478bfff700 1 --2- 172.21.15.8:0/3179183095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4794075610 0x7f4794199cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:09.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.837+0000 7f479259c700 1 -- 172.21.15.8:0/3179183095 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4794109460 msgr2=0x7f47941a0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:09.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.837+0000 7f479259c700 1 --2- 172.21.15.8:0/3179183095 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4794109460 0x7f47941a0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:09.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.837+0000 7f479259c700 1 -- 172.21.15.8:0/3179183095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4794075610 msgr2=0x7f4794199cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:09.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.837+0000 7f479259c700 1 --2- 172.21.15.8:0/3179183095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4794075610 0x7f4794199cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:09.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.837+0000 7f479259c700 1 -- 172.21.15.8:0/3179183095 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478c009d00 con 0x7f4794074030 2023-12-17T12:04:09.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.837+0000 7f478bfff700 1 --2- 172.21.15.8:0/3179183095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4794075610 0x7f4794199cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T12:04:09.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.837+0000 7f479259c700 1 --2- 172.21.15.8:0/3179183095 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4794074030 0x7f4794199770 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f478400d980 tx=0x7f478400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:09.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.837+0000 7f478b7fe700 1 -- 172.21.15.8:0/3179183095 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4784004220 con 0x7f4794074030 2023-12-17T12:04:09.842 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.838+0000 7f478b7fe700 1 -- 172.21.15.8:0/3179183095 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4784007640 con 0x7f4794074030 2023-12-17T12:04:09.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.838+0000 7f4798bff700 1 -- 172.21.15.8:0/3179183095 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47941a1850 con 0x7f4794074030 2023-12-17T12:04:09.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.838+0000 7f478b7fe700 1 -- 172.21.15.8:0/3179183095 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47840055e0 con 0x7f4794074030 2023-12-17T12:04:09.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.838+0000 7f4798bff700 1 -- 172.21.15.8:0/3179183095 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47941a1db0 con 0x7f4794074030 2023-12-17T12:04:09.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.839+0000 7f4798bff700 1 -- 172.21.15.8:0/3179183095 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4794108220 con 0x7f4794074030 2023-12-17T12:04:09.843 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.841+0000 7f478b7fe700 1 -- 172.21.15.8:0/3179183095 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f4784004750 con 0x7f4794074030 2023-12-17T12:04:09.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.842+0000 7f478b7fe700 1 --2- 172.21.15.8:0/3179183095 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f47800a1590 0x7f47800a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:09.844 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.842+0000 7f478b7fe700 1 -- 172.21.15.8:0/3179183095 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 8269+0+0 (secure 0 0 0) 0x7f47840ccc90 con 0x7f4794074030 2023-12-17T12:04:09.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.843+0000 7f478bfff700 1 --2- 172.21.15.8:0/3179183095 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f47800a1590 0x7f47800a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:09.845 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.843+0000 7f478bfff700 1 --2- 172.21.15.8:0/3179183095 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f47800a1590 0x7f47800a3a50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f477c005fd0 tx=0x7f477c005f00 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:09.848 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:09.847+0000 7f478b7fe700 1 -- 172.21.15.8:0/3179183095 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f4784096110 con 0x7f4794074030 2023-12-17T12:04:09.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:09 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/3664465645' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:04:09.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:09 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/1190557881' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:04:09.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:09 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/3664465645' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:04:09.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:09 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/1190557881' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:04:09.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:09 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/3664465645' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:04:09.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:09 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/1190557881' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-12-17T12:04:10.109 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.107+0000 7f4798bff700 1 -- 172.21.15.8:0/3179183095 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f4794068310 con 0x7f4794074030 2023-12-17T12:04:10.112 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.110+0000 7f478b7fe700 1 -- 172.21.15.8:0/3179183095 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v28) v1 ==== 161+0+0 (secure 0 0 0) 0x7f4784016020 con 0x7f4794074030 2023-12-17T12:04:10.115 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.113+0000 7f4798bff700 1 -- 172.21.15.8:0/3179183095 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f47800a1590 msgr2=0x7f47800a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.113+0000 7f4798bff700 1 --2- 172.21.15.8:0/3179183095 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f47800a1590 0x7f47800a3a50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f477c005fd0 tx=0x7f477c005f00 comp rx=0 tx=0).stop 2023-12-17T12:04:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.113+0000 7f4798bff700 1 -- 172.21.15.8:0/3179183095 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4794074030 msgr2=0x7f4794199770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.113+0000 7f4798bff700 1 --2- 172.21.15.8:0/3179183095 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4794074030 0x7f4794199770 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f478400d980 tx=0x7f478400dc90 comp rx=0 tx=0).stop 2023-12-17T12:04:10.116 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.114+0000 7f4798bff700 1 -- 172.21.15.8:0/3179183095 shutdown_connections 2023-12-17T12:04:10.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.114+0000 7f4798bff700 1 --2- 172.21.15.8:0/3179183095 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f47800a1590 0x7f47800a3a50 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:10.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.114+0000 7f4798bff700 1 --2- 172.21.15.8:0/3179183095 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4794109460 0x7f47941a0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:10.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.114+0000 7f4798bff700 1 --2- 172.21.15.8:0/3179183095 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f4794074030 0x7f4794199770 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:10.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.114+0000 7f4798bff700 1 --2- 172.21.15.8:0/3179183095 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f4794075610 0x7f4794199cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:10.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.114+0000 7f4798bff700 1 -- 172.21.15.8:0/3179183095 >> 172.21.15.8:0/3179183095 conn(0x7f47940fcb10 msgr2=0x7f4794105360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:10.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.114+0000 7f4798bff700 1 -- 172.21.15.8:0/3179183095 shutdown_connections 2023-12-17T12:04:10.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.114+0000 7f4798bff700 1 -- 172.21.15.8:0/3179183095 wait complete. 2023-12-17T12:04:10.118 INFO:teuthology.orchestra.run.smithi008.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-17T12:04:10.137 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-17T12:04:10.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.352+0000 7f9c06bff700 1 -- 172.21.15.8:0/2020858897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c001049d0 msgr2=0x7f9c00106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:10.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.352+0000 7f9c06bff700 1 --2- 172.21.15.8:0/2020858897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c001049d0 0x7f9c00106dc0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f9bec009990 tx=0x7f9bec009ca0 comp rx=0 tx=0).stop 2023-12-17T12:04:10.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.352+0000 7f9c06bff700 1 -- 172.21.15.8:0/2020858897 shutdown_connections 2023-12-17T12:04:10.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.352+0000 7f9c06bff700 1 --2- 172.21.15.8:0/2020858897 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c00107300 0x7f9c001096f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:10.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.352+0000 7f9c06bff700 1 --2- 172.21.15.8:0/2020858897 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c001020a0 0x7f9c00104490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:10.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.352+0000 7f9c06bff700 1 --2- 172.21.15.8:0/2020858897 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c001049d0 0x7f9c00106dc0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:10.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.352+0000 7f9c06bff700 1 -- 172.21.15.8:0/2020858897 >> 172.21.15.8:0/2020858897 conn(0x7f9c000fb9f0 msgr2=0x7f9c000fde30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:10.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.352+0000 7f9c06bff700 1 -- 172.21.15.8:0/2020858897 shutdown_connections 2023-12-17T12:04:10.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.352+0000 7f9c06bff700 1 -- 172.21.15.8:0/2020858897 wait complete. 2023-12-17T12:04:10.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.353+0000 7f9c06bff700 1 Processor -- start 2023-12-17T12:04:10.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.353+0000 7f9c06bff700 1 -- start start 2023-12-17T12:04:10.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.354+0000 7f9c06bff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c001020a0 0x7f9c00197430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:10.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.354+0000 7f9c06bff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c001049d0 0x7f9c00197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:10.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.354+0000 7f9c06bff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c00107300 0x7f9c0019e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:10.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.354+0000 7f9c06bff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0019ef60 con 0x7f9c001020a0 2023-12-17T12:04:10.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.354+0000 7f9c06bff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0019f0a0 con 0x7f9c001049d0 2023-12-17T12:04:10.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.354+0000 7f9c06bff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c0019f230 con 0x7f9c00107300 2023-12-17T12:04:10.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.354+0000 7f9c0499b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c001020a0 0x7f9c00197430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:10.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.354+0000 7f9c0499b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c001020a0 0x7f9c00197430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:49800/0 (socket says 172.21.15.8:49800) 2023-12-17T12:04:10.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.354+0000 7f9c0499b700 1 -- 172.21.15.8:0/916591242 learned_addr learned my addr 172.21.15.8:0/916591242 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:04:10.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.354+0000 7f9bfffff700 1 --2- 172.21.15.8:0/916591242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c001049d0 0x7f9c00197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:10.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.354+0000 7f9c0519c700 1 --2- 172.21.15.8:0/916591242 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c00107300 0x7f9c0019e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:10.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.354+0000 7f9c0499b700 1 -- 172.21.15.8:0/916591242 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c00107300 msgr2=0x7f9c0019e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:10.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.354+0000 7f9c0499b700 1 --2- 172.21.15.8:0/916591242 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c00107300 0x7f9c0019e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:10.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.354+0000 7f9c0499b700 1 -- 172.21.15.8:0/916591242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c001049d0 msgr2=0x7f9c00197970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:10.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.354+0000 7f9c0499b700 1 --2- 172.21.15.8:0/916591242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c001049d0 0x7f9c00197970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:10.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.354+0000 7f9c0499b700 1 -- 172.21.15.8:0/916591242 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bec0095f0 con 0x7f9c001020a0 2023-12-17T12:04:10.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.354+0000 7f9c0499b700 1 --2- 172.21.15.8:0/916591242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c001020a0 0x7f9c00197430 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9bf400d950 tx=0x7f9bf400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:10.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.355+0000 7f9bfdffb700 1 -- 172.21.15.8:0/916591242 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf4009940 con 0x7f9c001020a0 2023-12-17T12:04:10.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.355+0000 7f9bfdffb700 1 -- 172.21.15.8:0/916591242 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9bf4010460 con 0x7f9c001020a0 2023-12-17T12:04:10.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.355+0000 7f9c06bff700 1 -- 172.21.15.8:0/916591242 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c0019f510 con 0x7f9c001020a0 2023-12-17T12:04:10.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.355+0000 7f9bfdffb700 1 -- 172.21.15.8:0/916591242 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf400f620 con 0x7f9c001020a0 2023-12-17T12:04:10.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.355+0000 7f9c06bff700 1 -- 172.21.15.8:0/916591242 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c0019fa70 con 0x7f9c001020a0 2023-12-17T12:04:10.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.356+0000 7f9c06bff700 1 -- 172.21.15.8:0/916591242 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c000fd570 con 0x7f9c001020a0 2023-12-17T12:04:10.360 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.358+0000 7f9bfdffb700 1 -- 172.21.15.8:0/916591242 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f9bf40105d0 con 0x7f9c001020a0 2023-12-17T12:04:10.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.359+0000 7f9bfdffb700 1 --2- 172.21.15.8:0/916591242 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f9bf00a1590 0x7f9bf00a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:10.361 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.359+0000 7f9bfdffb700 1 -- 172.21.15.8:0/916591242 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8699+0+0 (secure 0 0 0) 0x7f9bf40ccea0 con 0x7f9c001020a0 2023-12-17T12:04:10.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.359+0000 7f9bfffff700 1 --2- 172.21.15.8:0/916591242 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f9bf00a1590 0x7f9bf00a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:10.362 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.360+0000 7f9bfffff700 1 --2- 172.21.15.8:0/916591242 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f9bf00a1590 0x7f9bf00a3a50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9bec003780 tx=0x7f9bec005fb0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:10.366 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.364+0000 7f9bfdffb700 1 -- 172.21.15.8:0/916591242 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f9bf4096170 con 0x7f9c001020a0 2023-12-17T12:04:10.415 INFO:journalctl@ceph.mds.e.smithi100.stdout:Dec 17 12:04:10 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-e[75734]: ignoring --setuser ceph since I am not root 2023-12-17T12:04:10.415 INFO:journalctl@ceph.mds.e.smithi100.stdout:Dec 17 12:04:10 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-e[75734]: ignoring --setgroup ceph since I am not root 2023-12-17T12:04:10.415 INFO:journalctl@ceph.mds.e.smithi100.stdout:Dec 17 12:04:10 smithi100 ceph-mds[75757]: -- 172.21.15.100:0/175734996 <== mon.0 v2:172.21.15.8:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564b218bb520 con 0x564b21893000 2023-12-17T12:04:10.416 INFO:journalctl@ceph.mds.e.smithi100.stdout:Dec 17 12:04:10 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-e[75734]: starting mds.e at 2023-12-17T12:04:10.416 INFO:journalctl@ceph.mds.h.smithi100.stdout:Dec 17 12:04:10 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-h[76074]: ignoring --setuser ceph since I am not root 2023-12-17T12:04:10.416 INFO:journalctl@ceph.mds.h.smithi100.stdout:Dec 17 12:04:10 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-h[76074]: ignoring --setgroup ceph since I am not root 2023-12-17T12:04:10.416 INFO:journalctl@ceph.mds.h.smithi100.stdout:Dec 17 12:04:10 smithi100 ceph-mds[76097]: -- 172.21.15.100:0/263263344 <== mon.1 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560a153ed520 con 0x560a153c4800 2023-12-17T12:04:10.416 INFO:journalctl@ceph.mds.h.smithi100.stdout:Dec 17 12:04:10 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-h[76074]: starting mds.h at 2023-12-17T12:04:10.417 INFO:journalctl@ceph.mds.k.smithi100.stdout:Dec 17 12:04:10 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-k[75393]: ignoring --setuser ceph since I am not root 2023-12-17T12:04:10.417 INFO:journalctl@ceph.mds.k.smithi100.stdout:Dec 17 12:04:10 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-k[75393]: ignoring --setgroup ceph since I am not root 2023-12-17T12:04:10.417 INFO:journalctl@ceph.mds.k.smithi100.stdout:Dec 17 12:04:10 smithi100 ceph-mds[75416]: -- 172.21.15.100:0/4292680244 <== mon.0 v2:172.21.15.8:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555b1cae3520 con 0x555b1cabac00 2023-12-17T12:04:10.417 INFO:journalctl@ceph.mds.k.smithi100.stdout:Dec 17 12:04:10 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-k[75393]: starting mds.k at 2023-12-17T12:04:10.417 INFO:journalctl@ceph.mds.b.smithi100.stdout:Dec 17 12:04:10 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-b[76415]: -5067> 2023-12-17T12:02:59.445+0000 7f06b8dcd700 -1 mds.pinger is_rank_lagging: rank=3 was never sent ping request. 2023-12-17T12:04:10.417 INFO:journalctl@ceph.mds.b.smithi100.stdout:Dec 17 12:04:10 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-b[76415]: -5065> 2023-12-17T12:02:59.445+0000 7f06b8dcd700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2023-12-17T12:04:10.418 INFO:journalctl@ceph.mds.b.smithi100.stdout:Dec 17 12:04:10 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-b[76415]: ignoring --setuser ceph since I am not root 2023-12-17T12:04:10.418 INFO:journalctl@ceph.mds.b.smithi100.stdout:Dec 17 12:04:10 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-b[76415]: ignoring --setgroup ceph since I am not root 2023-12-17T12:04:10.418 INFO:journalctl@ceph.mds.b.smithi100.stdout:Dec 17 12:04:10 smithi100 ceph-mds[76438]: -- 172.21.15.100:0/689101904 <== mon.0 v2:172.21.15.8:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5650ef7ef520 con 0x5650ef7c6800 2023-12-17T12:04:10.418 INFO:journalctl@ceph.mds.b.smithi100.stdout:Dec 17 12:04:10 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-b[76415]: starting mds.b at 2023-12-17T12:04:10.475 INFO:journalctl@ceph.mds.c.smithi186.stdout:Dec 17 12:04:10 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-c[77338]: ignoring --setuser ceph since I am not root 2023-12-17T12:04:10.475 INFO:journalctl@ceph.mds.c.smithi186.stdout:Dec 17 12:04:10 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-c[77338]: ignoring --setgroup ceph since I am not root 2023-12-17T12:04:10.475 INFO:journalctl@ceph.mds.c.smithi186.stdout:Dec 17 12:04:10 smithi186 ceph-mds[77361]: -- 172.21.15.186:0/2778350616 <== mon.1 v2:172.21.15.186:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5573d2a11520 con 0x5573d29e8800 2023-12-17T12:04:10.476 INFO:journalctl@ceph.mds.c.smithi186.stdout:Dec 17 12:04:10 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-c[77338]: starting mds.c at 2023-12-17T12:04:10.476 INFO:journalctl@ceph.mds.i.smithi186.stdout:Dec 17 12:04:10 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-i[77678]: ignoring --setuser ceph since I am not root 2023-12-17T12:04:10.476 INFO:journalctl@ceph.mds.i.smithi186.stdout:Dec 17 12:04:10 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-i[77678]: ignoring --setgroup ceph since I am not root 2023-12-17T12:04:10.476 INFO:journalctl@ceph.mds.i.smithi186.stdout:Dec 17 12:04:10 smithi186 ceph-mds[77701]: -- 172.21.15.186:0/370923476 <== mon.2 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5618944d9520 con 0x5618944b0c00 2023-12-17T12:04:10.476 INFO:journalctl@ceph.mds.i.smithi186.stdout:Dec 17 12:04:10 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-i[77678]: starting mds.i at 2023-12-17T12:04:10.477 INFO:journalctl@ceph.mds.l.smithi186.stdout:Dec 17 12:04:10 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-l[76659]: ignoring --setuser ceph since I am not root 2023-12-17T12:04:10.477 INFO:journalctl@ceph.mds.l.smithi186.stdout:Dec 17 12:04:10 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-l[76659]: ignoring --setgroup ceph since I am not root 2023-12-17T12:04:10.477 INFO:journalctl@ceph.mds.l.smithi186.stdout:Dec 17 12:04:10 smithi186 ceph-mds[76682]: -- 172.21.15.186:0/3715428719 <== mon.2 v2:172.21.15.100:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55949d7db520 con 0x55949d7b2800 2023-12-17T12:04:10.477 INFO:journalctl@ceph.mds.l.smithi186.stdout:Dec 17 12:04:10 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-l[76659]: starting mds.l at 2023-12-17T12:04:10.477 INFO:journalctl@ceph.mds.f.smithi186.stdout:Dec 17 12:04:10 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-f[76998]: ignoring --setuser ceph since I am not root 2023-12-17T12:04:10.477 INFO:journalctl@ceph.mds.f.smithi186.stdout:Dec 17 12:04:10 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-f[76998]: ignoring --setgroup ceph since I am not root 2023-12-17T12:04:10.478 INFO:journalctl@ceph.mds.f.smithi186.stdout:Dec 17 12:04:10 smithi186 ceph-mds[77021]: -- 172.21.15.186:0/2947231443 <== mon.0 v2:172.21.15.8:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564b24afb520 con 0x564b24ad2800 2023-12-17T12:04:10.478 INFO:journalctl@ceph.mds.f.smithi186.stdout:Dec 17 12:04:10 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-f[76998]: starting mds.f at 2023-12-17T12:04:10.495 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:10 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mon-a[36807]: 2023-12-17T12:04:10.108+0000 7f08eadc9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-17T12:04:10.495 INFO:journalctl@ceph.mds.a.smithi008.stdout:Dec 17 12:04:10 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-a[88210]: ignoring --setuser ceph since I am not root 2023-12-17T12:04:10.495 INFO:journalctl@ceph.mds.a.smithi008.stdout:Dec 17 12:04:10 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-a[88210]: ignoring --setgroup ceph since I am not root 2023-12-17T12:04:10.495 INFO:journalctl@ceph.mds.a.smithi008.stdout:Dec 17 12:04:10 smithi008 ceph-mds[88233]: -- 172.21.15.8:0/1342221143 <== mon.0 v2:172.21.15.8:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55801f443520 con 0x55801f41a800 2023-12-17T12:04:10.496 INFO:journalctl@ceph.mds.a.smithi008.stdout:Dec 17 12:04:10 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-a[88210]: starting mds.a at 2023-12-17T12:04:10.496 INFO:journalctl@ceph.mds.g.smithi008.stdout:Dec 17 12:04:10 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-g[87827]: ignoring --setuser ceph since I am not root 2023-12-17T12:04:10.496 INFO:journalctl@ceph.mds.g.smithi008.stdout:Dec 17 12:04:10 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-g[87827]: ignoring --setgroup ceph since I am not root 2023-12-17T12:04:10.496 INFO:journalctl@ceph.mds.g.smithi008.stdout:Dec 17 12:04:10 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-g[87827]: starting mds.g at 2023-12-17T12:04:10.628 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:10.626+0000 7f9c06bff700 1 -- 172.21.15.8:0/916591242 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9c0010cce0 con 0x7f9c001020a0 2023-12-17T12:04:10.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:10 smithi100 ceph-mon[41266]: pgmap v306: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-12-17T12:04:10.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:10 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/2085238077' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:04:10.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:10 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/3179183095' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-12-17T12:04:10.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:10 smithi100 ceph-mon[41266]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-12-17T12:04:10.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:10 smithi100 ceph-mon[41266]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-17T12:04:10.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:10 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/3179183095' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-12-17T12:04:10.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:10 smithi100 ceph-mon[41266]: osdmap e86: 12 total, 12 up, 12 in 2023-12-17T12:04:10.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:10 smithi100 ceph-mon[41266]: fsmap cephfs:0/5 2 up:standby, 5 failed 2023-12-17T12:04:10.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:10 smithi186 ceph-mon[41182]: pgmap v306: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-12-17T12:04:10.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:10 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/2085238077' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:04:10.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:10 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/3179183095' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-12-17T12:04:10.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:10 smithi186 ceph-mon[41182]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-12-17T12:04:10.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:10 smithi186 ceph-mon[41182]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-17T12:04:10.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:10 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/3179183095' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-12-17T12:04:10.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:10 smithi186 ceph-mon[41182]: osdmap e86: 12 total, 12 up, 12 in 2023-12-17T12:04:10.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:10 smithi186 ceph-mon[41182]: fsmap cephfs:0/5 2 up:standby, 5 failed 2023-12-17T12:04:10.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:10 smithi008 ceph-mon[36830]: pgmap v306: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2023-12-17T12:04:10.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:10 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/2085238077' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-12-17T12:04:10.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:10 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/3179183095' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2023-12-17T12:04:10.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:10 smithi008 ceph-mon[36830]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2023-12-17T12:04:10.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:10 smithi008 ceph-mon[36830]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-17T12:04:10.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:10 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/3179183095' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2023-12-17T12:04:10.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:10 smithi008 ceph-mon[36830]: osdmap e86: 12 total, 12 up, 12 in 2023-12-17T12:04:10.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:10 smithi008 ceph-mon[36830]: fsmap cephfs:0/5 2 up:standby, 5 failed 2023-12-17T12:04:11.114 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.112+0000 7f9bfdffb700 1 -- 172.21.15.8:0/916591242 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v29) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9bf4099790 con 0x7f9c001020a0 2023-12-17T12:04:11.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.115+0000 7f9c06bff700 1 -- 172.21.15.8:0/916591242 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f9bf00a1590 msgr2=0x7f9bf00a3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:11.117 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.115+0000 7f9c06bff700 1 --2- 172.21.15.8:0/916591242 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f9bf00a1590 0x7f9bf00a3a50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9bec003780 tx=0x7f9bec005fb0 comp rx=0 tx=0).stop 2023-12-17T12:04:11.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.115+0000 7f9c06bff700 1 -- 172.21.15.8:0/916591242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c001020a0 msgr2=0x7f9c00197430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:11.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.115+0000 7f9c06bff700 1 --2- 172.21.15.8:0/916591242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c001020a0 0x7f9c00197430 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f9bf400d950 tx=0x7f9bf400dc60 comp rx=0 tx=0).stop 2023-12-17T12:04:11.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.115+0000 7f9c06bff700 1 -- 172.21.15.8:0/916591242 shutdown_connections 2023-12-17T12:04:11.118 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.115+0000 7f9c06bff700 1 --2- 172.21.15.8:0/916591242 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f9bf00a1590 0x7f9bf00a3a50 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:11.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.115+0000 7f9c06bff700 1 --2- 172.21.15.8:0/916591242 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c00107300 0x7f9c0019e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:11.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.115+0000 7f9c06bff700 1 --2- 172.21.15.8:0/916591242 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f9c001020a0 0x7f9c00197430 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:11.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.115+0000 7f9c06bff700 1 --2- 172.21.15.8:0/916591242 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f9c001049d0 0x7f9c00197970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:11.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.115+0000 7f9c06bff700 1 -- 172.21.15.8:0/916591242 >> 172.21.15.8:0/916591242 conn(0x7f9c000fb9f0 msgr2=0x7f9c00103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:11.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.116+0000 7f9c06bff700 1 -- 172.21.15.8:0/916591242 shutdown_connections 2023-12-17T12:04:11.119 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.116+0000 7f9c06bff700 1 -- 172.21.15.8:0/916591242 wait complete. 2023-12-17T12:04:11.142 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-17T12:04:11.350 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.348+0000 7f6034bff700 1 -- 172.21.15.8:0/13795129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6030074030 msgr2=0x7f60300744b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:11.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.348+0000 7f6034bff700 1 --2- 172.21.15.8:0/13795129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6030074030 0x7f60300744b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6024009990 tx=0x7f6024009ca0 comp rx=0 tx=0).stop 2023-12-17T12:04:11.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.348+0000 7f6034bff700 1 -- 172.21.15.8:0/13795129 shutdown_connections 2023-12-17T12:04:11.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.348+0000 7f6034bff700 1 --2- 172.21.15.8:0/13795129 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f603010db70 0x7f603010ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:11.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.348+0000 7f6034bff700 1 --2- 172.21.15.8:0/13795129 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f6030075610 0x7f6030073a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:11.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.348+0000 7f6034bff700 1 --2- 172.21.15.8:0/13795129 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6030074030 0x7f60300744b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:11.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.348+0000 7f6034bff700 1 -- 172.21.15.8:0/13795129 >> 172.21.15.8:0/13795129 conn(0x7f60300fcb10 msgr2=0x7f60300fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:11.351 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.348+0000 7f6034bff700 1 -- 172.21.15.8:0/13795129 shutdown_connections 2023-12-17T12:04:11.352 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.348+0000 7f6034bff700 1 -- 172.21.15.8:0/13795129 wait complete. 2023-12-17T12:04:11.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.349+0000 7f6034bff700 1 Processor -- start 2023-12-17T12:04:11.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.349+0000 7f6034bff700 1 -- start start 2023-12-17T12:04:11.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.350+0000 7f6034bff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6030074030 0x7f603019d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:11.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.350+0000 7f6034bff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6030075610 0x7f603019def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:11.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.350+0000 7f6034bff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f603010db70 0x7f60301a4f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:11.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.350+0000 7f6034bff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60301a54e0 con 0x7f6030074030 2023-12-17T12:04:11.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.350+0000 7f6034bff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60301a5620 con 0x7f603010db70 2023-12-17T12:04:11.354 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.350+0000 7f6034bff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60301a57b0 con 0x7f6030075610 2023-12-17T12:04:11.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.350+0000 7f602e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6030074030 0x7f603019d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:11.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.350+0000 7f602e59c700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6030074030 0x7f603019d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33824/0 (socket says 172.21.15.8:33824) 2023-12-17T12:04:11.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.350+0000 7f602e59c700 1 -- 172.21.15.8:0/150104521 learned_addr learned my addr 172.21.15.8:0/150104521 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:04:11.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.350+0000 7f602dd9b700 1 --2- 172.21.15.8:0/150104521 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6030075610 0x7f603019def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:11.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.350+0000 7f602e59c700 1 -- 172.21.15.8:0/150104521 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6030075610 msgr2=0x7f603019def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:11.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.350+0000 7f602ed9d700 1 --2- 172.21.15.8:0/150104521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f603010db70 0x7f60301a4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:11.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.350+0000 7f602e59c700 1 --2- 172.21.15.8:0/150104521 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6030075610 0x7f603019def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:11.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.350+0000 7f602e59c700 1 -- 172.21.15.8:0/150104521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f603010db70 msgr2=0x7f60301a4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:11.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.350+0000 7f602e59c700 1 --2- 172.21.15.8:0/150104521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f603010db70 0x7f60301a4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:11.355 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.350+0000 7f602e59c700 1 -- 172.21.15.8:0/150104521 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60240095f0 con 0x7f6030074030 2023-12-17T12:04:11.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.350+0000 7f602ed9d700 1 --2- 172.21.15.8:0/150104521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f603010db70 0x7f60301a4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-17T12:04:11.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.351+0000 7f602e59c700 1 --2- 172.21.15.8:0/150104521 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6030074030 0x7f603019d9b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f602000c9b0 tx=0x7f602000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:11.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.351+0000 7f601f7fe700 1 -- 172.21.15.8:0/150104521 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6020007b00 con 0x7f6030074030 2023-12-17T12:04:11.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.351+0000 7f601f7fe700 1 -- 172.21.15.8:0/150104521 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6020007c60 con 0x7f6030074030 2023-12-17T12:04:11.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.351+0000 7f6034bff700 1 -- 172.21.15.8:0/150104521 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60301a5a90 con 0x7f6030074030 2023-12-17T12:04:11.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.351+0000 7f601f7fe700 1 -- 172.21.15.8:0/150104521 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6020018660 con 0x7f6030074030 2023-12-17T12:04:11.356 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.351+0000 7f6034bff700 1 -- 172.21.15.8:0/150104521 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60301a5fa0 con 0x7f6030074030 2023-12-17T12:04:11.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.352+0000 7f6034bff700 1 -- 172.21.15.8:0/150104521 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6030103dd0 con 0x7f6030074030 2023-12-17T12:04:11.357 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.354+0000 7f601f7fe700 1 -- 172.21.15.8:0/150104521 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7f602000f450 con 0x7f6030074030 2023-12-17T12:04:11.358 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.356+0000 7f601f7fe700 1 --2- 172.21.15.8:0/150104521 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f60180a1510 0x7f60180a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:11.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.356+0000 7f601f7fe700 1 -- 172.21.15.8:0/150104521 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8699+0+0 (secure 0 0 0) 0x7f60200cd160 con 0x7f6030074030 2023-12-17T12:04:11.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.357+0000 7f602dd9b700 1 --2- 172.21.15.8:0/150104521 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f60180a1510 0x7f60180a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:11.359 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.357+0000 7f602dd9b700 1 --2- 172.21.15.8:0/150104521 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f60180a1510 0x7f60180a39d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f602400b5c0 tx=0x7f6024005fb0 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:11.363 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.360+0000 7f601f7fe700 1 -- 172.21.15.8:0/150104521 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7f6020096430 con 0x7f6030074030 2023-12-17T12:04:11.576 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:11.574+0000 7f6034bff700 1 -- 172.21.15.8:0/150104521 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6030113540 con 0x7f6030074030 2023-12-17T12:04:11.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:11 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/916591242' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-12-17T12:04:11.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:11 smithi100 ceph-mon[41266]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-12-17T12:04:11.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:11 smithi100 ceph-mon[41266]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-12-17T12:04:11.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:11 smithi100 ceph-mon[41266]: Cluster is now healthy 2023-12-17T12:04:11.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:11 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/916591242' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-12-17T12:04:11.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:11 smithi100 ceph-mon[41266]: mds.? [v2:172.21.15.8:6838/3390683105,v1:172.21.15.8:6840/3390683105] up:boot 2023-12-17T12:04:11.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:11 smithi100 ceph-mon[41266]: mds.? [v2:172.21.15.8:6839/1619229355,v1:172.21.15.8:6841/1619229355] up:boot 2023-12-17T12:04:11.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:11 smithi100 ceph-mon[41266]: mds.? [v2:172.21.15.186:6833/50331255,v1:172.21.15.186:6836/50331255] up:boot 2023-12-17T12:04:11.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:11 smithi100 ceph-mon[41266]: mds.? [v2:172.21.15.186:6832/833822781,v1:172.21.15.186:6837/833822781] up:boot 2023-12-17T12:04:11.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:11 smithi100 ceph-mon[41266]: mds.? [v2:172.21.15.186:6834/1701309086,v1:172.21.15.186:6838/1701309086] up:boot 2023-12-17T12:04:11.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:11 smithi100 ceph-mon[41266]: mds.? [v2:172.21.15.186:6835/1106586478,v1:172.21.15.186:6839/1106586478] up:boot 2023-12-17T12:04:11.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:11 smithi100 ceph-mon[41266]: mds.? [v2:172.21.15.100:6832/2787790591,v1:172.21.15.100:6834/2787790591] up:boot 2023-12-17T12:04:11.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:11 smithi100 ceph-mon[41266]: mds.? [v2:172.21.15.100:6833/1064070139,v1:172.21.15.100:6835/1064070139] up:boot 2023-12-17T12:04:11.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:11 smithi100 ceph-mon[41266]: mds.? [v2:172.21.15.100:6836/3347146608,v1:172.21.15.100:6837/3347146608] up:boot 2023-12-17T12:04:11.917 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:11 smithi100 ceph-mon[41266]: mds.? [v2:172.21.15.100:6838/3095652514,v1:172.21.15.100:6839/3095652514] up:boot 2023-12-17T12:04:11.918 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:11 smithi100 ceph-mon[41266]: fsmap 12 up:standby 2023-12-17T12:04:11.918 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:11 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-12-17T12:04:11.918 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:11 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-12-17T12:04:11.918 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:11 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-12-17T12:04:11.918 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:11 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-12-17T12:04:11.918 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:11 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-12-17T12:04:11.918 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:11 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-12-17T12:04:11.918 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:11 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-12-17T12:04:11.918 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:11 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-12-17T12:04:11.918 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:11 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-12-17T12:04:11.919 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:11 smithi100 ceph-mon[41266]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-12-17T12:04:11.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:11 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/916591242' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-12-17T12:04:11.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:11 smithi186 ceph-mon[41182]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-12-17T12:04:11.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:11 smithi186 ceph-mon[41182]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-12-17T12:04:11.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:11 smithi186 ceph-mon[41182]: Cluster is now healthy 2023-12-17T12:04:11.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:11 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/916591242' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-12-17T12:04:11.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:11 smithi186 ceph-mon[41182]: mds.? [v2:172.21.15.8:6838/3390683105,v1:172.21.15.8:6840/3390683105] up:boot 2023-12-17T12:04:11.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:11 smithi186 ceph-mon[41182]: mds.? [v2:172.21.15.8:6839/1619229355,v1:172.21.15.8:6841/1619229355] up:boot 2023-12-17T12:04:11.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:11 smithi186 ceph-mon[41182]: mds.? [v2:172.21.15.186:6833/50331255,v1:172.21.15.186:6836/50331255] up:boot 2023-12-17T12:04:11.977 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:11 smithi186 ceph-mon[41182]: mds.? [v2:172.21.15.186:6832/833822781,v1:172.21.15.186:6837/833822781] up:boot 2023-12-17T12:04:11.977 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:11 smithi186 ceph-mon[41182]: mds.? [v2:172.21.15.186:6834/1701309086,v1:172.21.15.186:6838/1701309086] up:boot 2023-12-17T12:04:11.977 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:11 smithi186 ceph-mon[41182]: mds.? [v2:172.21.15.186:6835/1106586478,v1:172.21.15.186:6839/1106586478] up:boot 2023-12-17T12:04:11.977 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:11 smithi186 ceph-mon[41182]: mds.? [v2:172.21.15.100:6832/2787790591,v1:172.21.15.100:6834/2787790591] up:boot 2023-12-17T12:04:11.977 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:11 smithi186 ceph-mon[41182]: mds.? [v2:172.21.15.100:6833/1064070139,v1:172.21.15.100:6835/1064070139] up:boot 2023-12-17T12:04:11.977 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:11 smithi186 ceph-mon[41182]: mds.? [v2:172.21.15.100:6836/3347146608,v1:172.21.15.100:6837/3347146608] up:boot 2023-12-17T12:04:11.977 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:11 smithi186 ceph-mon[41182]: mds.? [v2:172.21.15.100:6838/3095652514,v1:172.21.15.100:6839/3095652514] up:boot 2023-12-17T12:04:11.977 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:11 smithi186 ceph-mon[41182]: fsmap 12 up:standby 2023-12-17T12:04:11.977 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:11 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-12-17T12:04:11.978 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:11 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-12-17T12:04:11.978 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:11 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-12-17T12:04:11.978 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:11 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-12-17T12:04:11.978 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:11 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-12-17T12:04:11.978 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:11 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-12-17T12:04:11.978 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:11 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-12-17T12:04:11.978 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:11 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-12-17T12:04:11.978 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:11 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-12-17T12:04:11.978 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:11 smithi186 ceph-mon[41182]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-12-17T12:04:11.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:11 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/916591242' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2023-12-17T12:04:11.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:11 smithi008 ceph-mon[36830]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2023-12-17T12:04:11.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:11 smithi008 ceph-mon[36830]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2023-12-17T12:04:11.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:11 smithi008 ceph-mon[36830]: Cluster is now healthy 2023-12-17T12:04:11.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:11 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/916591242' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2023-12-17T12:04:11.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:11 smithi008 ceph-mon[36830]: mds.? [v2:172.21.15.8:6838/3390683105,v1:172.21.15.8:6840/3390683105] up:boot 2023-12-17T12:04:11.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:11 smithi008 ceph-mon[36830]: mds.? [v2:172.21.15.8:6839/1619229355,v1:172.21.15.8:6841/1619229355] up:boot 2023-12-17T12:04:11.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:11 smithi008 ceph-mon[36830]: mds.? [v2:172.21.15.186:6833/50331255,v1:172.21.15.186:6836/50331255] up:boot 2023-12-17T12:04:11.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:11 smithi008 ceph-mon[36830]: mds.? [v2:172.21.15.186:6832/833822781,v1:172.21.15.186:6837/833822781] up:boot 2023-12-17T12:04:11.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:11 smithi008 ceph-mon[36830]: mds.? [v2:172.21.15.186:6834/1701309086,v1:172.21.15.186:6838/1701309086] up:boot 2023-12-17T12:04:11.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:11 smithi008 ceph-mon[36830]: mds.? [v2:172.21.15.186:6835/1106586478,v1:172.21.15.186:6839/1106586478] up:boot 2023-12-17T12:04:11.996 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:11 smithi008 ceph-mon[36830]: mds.? [v2:172.21.15.100:6832/2787790591,v1:172.21.15.100:6834/2787790591] up:boot 2023-12-17T12:04:11.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:11 smithi008 ceph-mon[36830]: mds.? [v2:172.21.15.100:6833/1064070139,v1:172.21.15.100:6835/1064070139] up:boot 2023-12-17T12:04:11.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:11 smithi008 ceph-mon[36830]: mds.? [v2:172.21.15.100:6836/3347146608,v1:172.21.15.100:6837/3347146608] up:boot 2023-12-17T12:04:11.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:11 smithi008 ceph-mon[36830]: mds.? [v2:172.21.15.100:6838/3095652514,v1:172.21.15.100:6839/3095652514] up:boot 2023-12-17T12:04:11.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:11 smithi008 ceph-mon[36830]: fsmap 12 up:standby 2023-12-17T12:04:11.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:11 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-12-17T12:04:11.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:11 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-12-17T12:04:11.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:11 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-12-17T12:04:11.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:11 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-12-17T12:04:11.997 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:11 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-12-17T12:04:11.998 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:11 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-12-17T12:04:11.998 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:11 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-12-17T12:04:11.998 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:11 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-12-17T12:04:11.998 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:11 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-12-17T12:04:11.998 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:11 smithi008 ceph-mon[36830]: from='mgr.14154 172.21.15.8:0/269821833' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-12-17T12:04:12.525 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.523+0000 7f601f7fe700 1 -- 172.21.15.8:0/150104521 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v87) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6020099a50 con 0x7f6030074030 2023-12-17T12:04:12.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.528+0000 7f6034bff700 1 -- 172.21.15.8:0/150104521 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f60180a1510 msgr2=0x7f60180a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:12.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.528+0000 7f6034bff700 1 --2- 172.21.15.8:0/150104521 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f60180a1510 0x7f60180a39d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f602400b5c0 tx=0x7f6024005fb0 comp rx=0 tx=0).stop 2023-12-17T12:04:12.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.528+0000 7f6034bff700 1 -- 172.21.15.8:0/150104521 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6030074030 msgr2=0x7f603019d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:12.530 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.528+0000 7f6034bff700 1 --2- 172.21.15.8:0/150104521 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6030074030 0x7f603019d9b0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f602000c9b0 tx=0x7f602000cd70 comp rx=0 tx=0).stop 2023-12-17T12:04:12.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.528+0000 7f6034bff700 1 -- 172.21.15.8:0/150104521 shutdown_connections 2023-12-17T12:04:12.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.528+0000 7f6034bff700 1 --2- 172.21.15.8:0/150104521 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7f60180a1510 0x7f60180a39d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:12.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.528+0000 7f6034bff700 1 --2- 172.21.15.8:0/150104521 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7f603010db70 0x7f60301a4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:12.531 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.528+0000 7f6034bff700 1 --2- 172.21.15.8:0/150104521 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7f6030074030 0x7f603019d9b0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:12.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.528+0000 7f6034bff700 1 --2- 172.21.15.8:0/150104521 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6030075610 0x7f603019def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:12.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.528+0000 7f6034bff700 1 -- 172.21.15.8:0/150104521 >> 172.21.15.8:0/150104521 conn(0x7f60300fcb10 msgr2=0x7f6030100f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:12.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.529+0000 7f6034bff700 1 -- 172.21.15.8:0/150104521 shutdown_connections 2023-12-17T12:04:12.532 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.529+0000 7f6034bff700 1 -- 172.21.15.8:0/150104521 wait complete. 2023-12-17T12:04:12.533 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_metadata' removed 2023-12-17T12:04:12.554 DEBUG:teuthology.orchestra.run.smithi008:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-17T12:04:12.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.765+0000 7fe9571ff700 1 -- 172.21.15.8:0/2954197611 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9501015a0 msgr2=0x7fe9501019c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:12.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.765+0000 7fe9571ff700 1 --2- 172.21.15.8:0/2954197611 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9501015a0 0x7fe9501019c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fe9440099c0 tx=0x7fe944009cd0 comp rx=0 tx=0).stop 2023-12-17T12:04:12.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.766+0000 7fe9571ff700 1 -- 172.21.15.8:0/2954197611 shutdown_connections 2023-12-17T12:04:12.768 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.766+0000 7fe9571ff700 1 --2- 172.21.15.8:0/2954197611 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe950103130 0x7fe9501099e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:12.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.766+0000 7fe9571ff700 1 --2- 172.21.15.8:0/2954197611 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9501015a0 0x7fe9501019c0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:12.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.766+0000 7fe9571ff700 1 --2- 172.21.15.8:0/2954197611 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe950102790 0x7fe950102bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:12.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.766+0000 7fe9571ff700 1 -- 172.21.15.8:0/2954197611 >> 172.21.15.8:0/2954197611 conn(0x7fe9500fcb10 msgr2=0x7fe9500fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:12.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.766+0000 7fe9571ff700 1 -- 172.21.15.8:0/2954197611 shutdown_connections 2023-12-17T12:04:12.769 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.766+0000 7fe9571ff700 1 -- 172.21.15.8:0/2954197611 wait complete. 2023-12-17T12:04:12.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.767+0000 7fe9571ff700 1 Processor -- start 2023-12-17T12:04:12.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.767+0000 7fe9571ff700 1 -- start start 2023-12-17T12:04:12.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.767+0000 7fe9571ff700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9501015a0 0x7fe950199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:12.771 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.767+0000 7fe9571ff700 1 --2- >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe950102790 0x7fe950199c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:12.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.767+0000 7fe9571ff700 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe950103130 0x7fe9501a0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:12.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.767+0000 7fe9571ff700 1 -- --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9501a1230 con 0x7fe9501015a0 2023-12-17T12:04:12.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.767+0000 7fe9571ff700 1 -- --> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9501a1370 con 0x7fe950102790 2023-12-17T12:04:12.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.767+0000 7fe9571ff700 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9501a1500 con 0x7fe950103130 2023-12-17T12:04:12.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.767+0000 7fe954f9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9501015a0 0x7fe950199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:12.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.767+0000 7fe954f9b700 1 --2- >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9501015a0 0x7fe950199700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.8:3300/0 says I am v2:172.21.15.8:33842/0 (socket says 172.21.15.8:33842) 2023-12-17T12:04:12.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.767+0000 7fe954f9b700 1 -- 172.21.15.8:0/3975059209 learned_addr learned my addr 172.21.15.8:0/3975059209 (peer_addr_for_me v2:172.21.15.8:0/0) 2023-12-17T12:04:12.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.768+0000 7fe95579c700 1 --2- 172.21.15.8:0/3975059209 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe950103130 0x7fe9501a0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:12.772 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.768+0000 7fe94ffff700 1 --2- 172.21.15.8:0/3975059209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe950102790 0x7fe950199c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:12.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.768+0000 7fe954f9b700 1 -- 172.21.15.8:0/3975059209 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe950103130 msgr2=0x7fe9501a0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:12.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.768+0000 7fe954f9b700 1 --2- 172.21.15.8:0/3975059209 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe950103130 0x7fe9501a0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:12.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.768+0000 7fe954f9b700 1 -- 172.21.15.8:0/3975059209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe950102790 msgr2=0x7fe950199c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:12.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.768+0000 7fe954f9b700 1 --2- 172.21.15.8:0/3975059209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe950102790 0x7fe950199c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:12.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.768+0000 7fe954f9b700 1 -- 172.21.15.8:0/3975059209 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9440095f0 con 0x7fe9501015a0 2023-12-17T12:04:12.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.768+0000 7fe954f9b700 1 --2- 172.21.15.8:0/3975059209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9501015a0 0x7fe950199700 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe944009f50 tx=0x7fe944003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:12.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.768+0000 7fe94dffb700 1 -- 172.21.15.8:0/3975059209 <== mon.0 v2:172.21.15.8:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94401d070 con 0x7fe9501015a0 2023-12-17T12:04:12.773 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.768+0000 7fe94dffb700 1 -- 172.21.15.8:0/3975059209 <== mon.0 v2:172.21.15.8:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe94400bda0 con 0x7fe9501015a0 2023-12-17T12:04:12.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.768+0000 7fe9571ff700 1 -- 172.21.15.8:0/3975059209 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9501a1780 con 0x7fe9501015a0 2023-12-17T12:04:12.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.768+0000 7fe94dffb700 1 -- 172.21.15.8:0/3975059209 <== mon.0 v2:172.21.15.8:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe944022cd0 con 0x7fe9501015a0 2023-12-17T12:04:12.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.769+0000 7fe9571ff700 1 -- 172.21.15.8:0/3975059209 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9501a1ba0 con 0x7fe9501015a0 2023-12-17T12:04:12.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.770+0000 7fe9571ff700 1 -- 172.21.15.8:0/3975059209 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe950068310 con 0x7fe9501015a0 2023-12-17T12:04:12.774 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.772+0000 7fe94dffb700 1 -- 172.21.15.8:0/3975059209 <== mon.0 v2:172.21.15.8:3300/0 4 ==== mgrmap(e 17) v1 ==== 136056+0+0 (secure 0 0 0) 0x7fe944022470 con 0x7fe9501015a0 2023-12-17T12:04:12.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.773+0000 7fe94dffb700 1 --2- 172.21.15.8:0/3975059209 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fe9400a1510 0x7fe9400a39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-17T12:04:12.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.773+0000 7fe94dffb700 1 -- 172.21.15.8:0/3975059209 <== mon.0 v2:172.21.15.8:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8232+0+0 (secure 0 0 0) 0x7fe9440ce9e0 con 0x7fe9501015a0 2023-12-17T12:04:12.775 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.773+0000 7fe94ffff700 1 --2- 172.21.15.8:0/3975059209 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fe9400a1510 0x7fe9400a39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-17T12:04:12.776 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.774+0000 7fe94ffff700 1 --2- 172.21.15.8:0/3975059209 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fe9400a1510 0x7fe9400a39d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe93c005950 tx=0x7fe93c00b410 comp rx=0 tx=0).ready entity=mgr.14154 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-17T12:04:12.777 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.775+0000 7fe94dffb700 1 -- 172.21.15.8:0/3975059209 <== mon.0 v2:172.21.15.8:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180949 (secure 0 0 0) 0x7fe944097f10 con 0x7fe9501015a0 2023-12-17T12:04:12.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:12 smithi100 ceph-mon[41266]: pgmap v308: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-12-17T12:04:12.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:12 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/150104521' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-12-17T12:04:12.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:12 smithi186 ceph-mon[41182]: pgmap v308: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-12-17T12:04:12.975 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:12 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/150104521' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-12-17T12:04:12.990 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:12.988+0000 7fe9571ff700 1 -- 172.21.15.8:0/3975059209 --> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe95010cdc0 con 0x7fe9501015a0 2023-12-17T12:04:12.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:12 smithi008 ceph-mon[36830]: pgmap v308: 97 pgs: 97 active+clean; 641 KiB data, 328 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 9 op/s 2023-12-17T12:04:12.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:12 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/150104521' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2023-12-17T12:04:13.540 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:13.538+0000 7fe94dffb700 1 -- 172.21.15.8:0/3975059209 <== mon.0 v2:172.21.15.8:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v88) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe9440270d0 con 0x7fe9501015a0 2023-12-17T12:04:13.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:13.541+0000 7fe9571ff700 1 -- 172.21.15.8:0/3975059209 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fe9400a1510 msgr2=0x7fe9400a39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:13.544 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:13.541+0000 7fe9571ff700 1 --2- 172.21.15.8:0/3975059209 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fe9400a1510 0x7fe9400a39d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe93c005950 tx=0x7fe93c00b410 comp rx=0 tx=0).stop 2023-12-17T12:04:13.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:13.541+0000 7fe9571ff700 1 -- 172.21.15.8:0/3975059209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9501015a0 msgr2=0x7fe950199700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-17T12:04:13.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:13.541+0000 7fe9571ff700 1 --2- 172.21.15.8:0/3975059209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9501015a0 0x7fe950199700 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fe944009f50 tx=0x7fe944003a50 comp rx=0 tx=0).stop 2023-12-17T12:04:13.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:13.542+0000 7fe9571ff700 1 -- 172.21.15.8:0/3975059209 shutdown_connections 2023-12-17T12:04:13.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:13.542+0000 7fe9571ff700 1 --2- 172.21.15.8:0/3975059209 >> [v2:172.21.15.8:6800/268548699,v1:172.21.15.8:6801/268548699] conn(0x7fe9400a1510 0x7fe9400a39d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:13.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:13.542+0000 7fe9571ff700 1 --2- 172.21.15.8:0/3975059209 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe950103130 0x7fe9501a0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:13.545 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:13.542+0000 7fe9571ff700 1 --2- 172.21.15.8:0/3975059209 >> [v2:172.21.15.8:3300/0,v1:172.21.15.8:6789/0] conn(0x7fe9501015a0 0x7fe950199700 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:13.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:13.542+0000 7fe9571ff700 1 --2- 172.21.15.8:0/3975059209 >> [v2:172.21.15.100:3300/0,v1:172.21.15.100:6789/0] conn(0x7fe950102790 0x7fe950199c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-17T12:04:13.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:13.542+0000 7fe9571ff700 1 -- 172.21.15.8:0/3975059209 >> 172.21.15.8:0/3975059209 conn(0x7fe9500fcb10 msgr2=0x7fe950107f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-17T12:04:13.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:13.542+0000 7fe9571ff700 1 -- 172.21.15.8:0/3975059209 shutdown_connections 2023-12-17T12:04:13.546 INFO:teuthology.orchestra.run.smithi008.stderr:2023-12-17T12:04:13.542+0000 7fe9571ff700 1 -- 172.21.15.8:0/3975059209 wait complete. 2023-12-17T12:04:13.546 INFO:teuthology.orchestra.run.smithi008.stderr:pool 'cephfs_data' removed 2023-12-17T12:04:13.567 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-17T12:04:13.640 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-17T12:04:13.742 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-17T12:04:13.811 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:13 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/150104521' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-12-17T12:04:13.812 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:13 smithi186 ceph-mon[41182]: osdmap e87: 12 total, 12 up, 12 in 2023-12-17T12:04:13.812 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:13 smithi186 ceph-mon[41182]: from='client.? 172.21.15.8:0/3975059209' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-12-17T12:04:13.822 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-12-17T12:04:13.822 DEBUG:teuthology.orchestra.run.smithi008:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-17T12:04:13.875 DEBUG:teuthology.orchestra.run.smithi100:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-17T12:04:13.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:13 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/150104521' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-12-17T12:04:13.915 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:13 smithi100 ceph-mon[41266]: osdmap e87: 12 total, 12 up, 12 in 2023-12-17T12:04:13.916 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:13 smithi100 ceph-mon[41266]: from='client.? 172.21.15.8:0/3975059209' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-12-17T12:04:13.920 DEBUG:teuthology.orchestra.run.smithi186:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-12-17T12:04:13.966 INFO:tasks.cephadm:Stopping all daemons... 2023-12-17T12:04:13.967 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2023-12-17T12:04:13.968 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mon.a 2023-12-17T12:04:13.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:13 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/150104521' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2023-12-17T12:04:13.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:13 smithi008 ceph-mon[36830]: osdmap e87: 12 total, 12 up, 12 in 2023-12-17T12:04:13.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:13 smithi008 ceph-mon[36830]: from='client.? 172.21.15.8:0/3975059209' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2023-12-17T12:04:14.353 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:14 smithi008 systemd[1]: Stopping Ceph mon.a for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:04:14.729 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:14 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mon-a[36807]: 2023-12-17T12:04:14.350+0000 7f08f05d4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:04:14.729 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:14 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mon-a[36807]: 2023-12-17T12:04:14.350+0000 7f08f05d4700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2023-12-17T12:04:14.995 INFO:journalctl@ceph.mon.a.smithi008.stdout:Dec 17 12:04:14 smithi008 bash[99985]: ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mon-a 2023-12-17T12:04:15.263 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mon.a.service' 2023-12-17T12:04:15.409 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-17T12:04:15.410 INFO:tasks.cephadm.mon.a:Stopped mon.a 2023-12-17T12:04:15.410 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2023-12-17T12:04:15.410 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mon.b 2023-12-17T12:04:15.898 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:15 smithi100 systemd[1]: Stopping Ceph mon.b for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:04:16.165 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:15 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mon-b[41243]: 2023-12-17T12:04:15.894+0000 7f7b4bc27700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:04:16.165 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:15 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mon-b[41243]: 2023-12-17T12:04:15.894+0000 7f7b4bc27700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2023-12-17T12:04:16.166 INFO:journalctl@ceph.mon.b.smithi100.stdout:Dec 17 12:04:16 smithi100 bash[78290]: ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mon-b 2023-12-17T12:04:16.536 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mon.b.service' 2023-12-17T12:04:16.657 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-17T12:04:16.657 INFO:tasks.cephadm.mon.c:Stopped mon.b 2023-12-17T12:04:16.657 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2023-12-17T12:04:16.658 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mon.c 2023-12-17T12:04:16.976 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:16 smithi186 systemd[1]: Stopping Ceph mon.c for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:04:17.326 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:17 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mon-c[41156]: 2023-12-17T12:04:17.033+0000 7fe6c741c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:04:17.326 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:17 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mon-c[41156]: 2023-12-17T12:04:17.033+0000 7fe6c741c700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2023-12-17T12:04:17.669 INFO:journalctl@ceph.mon.c.smithi186.stdout:Dec 17 12:04:17 smithi186 bash[79637]: ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mon-c 2023-12-17T12:04:17.695 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mon.c.service' 2023-12-17T12:04:17.800 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-17T12:04:17.801 INFO:tasks.cephadm.mon.c:Stopped mon.c 2023-12-17T12:04:17.801 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2023-12-17T12:04:17.801 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mgr.x 2023-12-17T12:04:18.195 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 12:04:17 smithi008 systemd[1]: Stopping Ceph mgr.x for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:04:18.483 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 12:04:18 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T12:04:18.191+0000 7f5c3486a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:04:18.484 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 12:04:18 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x[37082]: 2023-12-17T12:04:18.191+0000 7f5c3486a700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-12-17T12:04:18.745 INFO:journalctl@ceph.mgr.x.smithi008.stdout:Dec 17 12:04:18 smithi008 bash[100482]: ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-x 2023-12-17T12:04:18.860 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mgr.x.service' 2023-12-17T12:04:18.951 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-17T12:04:18.951 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2023-12-17T12:04:18.952 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2023-12-17T12:04:18.952 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mgr.y 2023-12-17T12:04:19.415 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Dec 17 12:04:19 smithi100 systemd[1]: Stopping Ceph mgr.y for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:04:19.915 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Dec 17 12:04:19 smithi100 bash[78528]: ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-y 2023-12-17T12:04:19.916 INFO:journalctl@ceph.mgr.y.smithi100.stdout:Dec 17 12:04:19 smithi100 systemd[1]: ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mgr.y.service: Main process exited, code=exited, status=143/n/a 2023-12-17T12:04:20.005 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mgr.y.service' 2023-12-17T12:04:20.092 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-17T12:04:20.092 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2023-12-17T12:04:20.092 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2023-12-17T12:04:20.092 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mgr.z 2023-12-17T12:04:20.475 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Dec 17 12:04:20 smithi186 systemd[1]: Stopping Ceph mgr.z for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:04:20.975 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Dec 17 12:04:20 smithi186 bash[79785]: ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mgr-z 2023-12-17T12:04:20.975 INFO:journalctl@ceph.mgr.z.smithi186.stdout:Dec 17 12:04:20 smithi186 systemd[1]: ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mgr.z.service: Main process exited, code=exited, status=143/n/a 2023-12-17T12:04:21.204 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mgr.z.service' 2023-12-17T12:04:21.290 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-17T12:04:21.290 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2023-12-17T12:04:21.291 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-12-17T12:04:21.291 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.0 2023-12-17T12:04:21.677 INFO:journalctl@ceph.osd.0.smithi008.stdout:Dec 17 12:04:21 smithi008 systemd[1]: Stopping Ceph osd.0 for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:04:21.995 INFO:journalctl@ceph.osd.0.smithi008.stdout:Dec 17 12:04:21 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-0[54555]: 2023-12-17T12:04:21.674+0000 7f5ccacc3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:04:21.995 INFO:journalctl@ceph.osd.0.smithi008.stdout:Dec 17 12:04:21 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-0[54555]: 2023-12-17T12:04:21.674+0000 7f5ccacc3700 -1 osd.0 88 *** Got signal Terminated *** 2023-12-17T12:04:21.996 INFO:journalctl@ceph.osd.0.smithi008.stdout:Dec 17 12:04:21 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-0[54555]: 2023-12-17T12:04:21.674+0000 7f5ccacc3700 -1 osd.0 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-17T12:04:27.745 INFO:journalctl@ceph.osd.0.smithi008.stdout:Dec 17 12:04:27 smithi008 bash[100621]: ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-0 2023-12-17T12:04:29.003 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.0.service' 2023-12-17T12:04:29.066 INFO:journalctl@ceph.osd.0.smithi008.stdout:Dec 17 12:04:28 smithi008 systemd[1]: ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.0.service: Succeeded. 2023-12-17T12:04:29.067 INFO:journalctl@ceph.osd.0.smithi008.stdout:Dec 17 12:04:28 smithi008 systemd[1]: Stopped Ceph osd.0 for f43f508a-9cd2-11ee-95a5-87774f69a715. 2023-12-17T12:04:29.094 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-17T12:04:29.095 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-12-17T12:04:29.095 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-12-17T12:04:29.095 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.1 2023-12-17T12:04:29.415 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 17 12:04:29 smithi100 systemd[1]: Stopping Ceph osd.1 for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:04:29.915 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 17 12:04:29 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-1[46308]: 2023-12-17T12:04:29.492+0000 7f3ca94da700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:04:29.915 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 17 12:04:29 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-1[46308]: 2023-12-17T12:04:29.492+0000 7f3ca94da700 -1 osd.1 88 *** Got signal Terminated *** 2023-12-17T12:04:29.916 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 17 12:04:29 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-1[46308]: 2023-12-17T12:04:29.492+0000 7f3ca94da700 -1 osd.1 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-17T12:04:35.415 INFO:journalctl@ceph.osd.1.smithi100.stdout:Dec 17 12:04:35 smithi100 bash[78673]: ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-1 2023-12-17T12:04:36.710 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.1.service' 2023-12-17T12:04:36.799 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-17T12:04:36.799 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-12-17T12:04:36.799 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-12-17T12:04:36.799 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.2 2023-12-17T12:04:37.225 INFO:journalctl@ceph.osd.2.smithi186.stdout:Dec 17 12:04:36 smithi186 systemd[1]: Stopping Ceph osd.2 for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:04:37.725 INFO:journalctl@ceph.osd.2.smithi186.stdout:Dec 17 12:04:37 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-2[46920]: 2023-12-17T12:04:37.231+0000 7f864f62e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:04:37.725 INFO:journalctl@ceph.osd.2.smithi186.stdout:Dec 17 12:04:37 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-2[46920]: 2023-12-17T12:04:37.231+0000 7f864f62e700 -1 osd.2 88 *** Got signal Terminated *** 2023-12-17T12:04:37.726 INFO:journalctl@ceph.osd.2.smithi186.stdout:Dec 17 12:04:37 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-2[46920]: 2023-12-17T12:04:37.231+0000 7f864f62e700 -1 osd.2 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-17T12:04:43.225 INFO:journalctl@ceph.osd.2.smithi186.stdout:Dec 17 12:04:42 smithi186 bash[79930]: ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-2 2023-12-17T12:04:44.476 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.2.service' 2023-12-17T12:04:44.566 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-17T12:04:44.566 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-12-17T12:04:44.566 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-12-17T12:04:44.566 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.3 2023-12-17T12:04:44.966 INFO:journalctl@ceph.osd.3.smithi008.stdout:Dec 17 12:04:44 smithi008 systemd[1]: Stopping Ceph osd.3 for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:04:45.245 INFO:journalctl@ceph.osd.3.smithi008.stdout:Dec 17 12:04:44 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-3[62943]: 2023-12-17T12:04:44.964+0000 7ff7fd25c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:04:45.245 INFO:journalctl@ceph.osd.3.smithi008.stdout:Dec 17 12:04:44 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-3[62943]: 2023-12-17T12:04:44.964+0000 7ff7fd25c700 -1 osd.3 88 *** Got signal Terminated *** 2023-12-17T12:04:45.245 INFO:journalctl@ceph.osd.3.smithi008.stdout:Dec 17 12:04:44 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-3[62943]: 2023-12-17T12:04:44.964+0000 7ff7fd25c700 -1 osd.3 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-17T12:04:48.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:04:48 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:04:48.515+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:04:49.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:04:49 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:04:49.254+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:04:49.745 INFO:journalctl@ceph.osd.3.smithi008.stdout:Dec 17 12:04:49 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-3[62943]: 2023-12-17T12:04:49.374+0000 7ff7f584f700 -1 osd.3 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.980309+0000 front 2023-12-17T12:04:25.980340+0000 (oldest deadline 2023-12-17T12:04:48.880423+0000) 2023-12-17T12:04:49.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:04:49 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:04:49.474+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:04:50.245 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:04:49 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:04:49.878+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.585532+0000 front 2023-12-17T12:04:25.585510+0000 (oldest deadline 2023-12-17T12:04:49.085746+0000) 2023-12-17T12:04:50.475 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:04:50 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:04:50.238+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:04:50.475 INFO:journalctl@ceph.osd.5.smithi186.stdout:Dec 17 12:04:50 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-5[55448]: 2023-12-17T12:04:50.176+0000 7fbc59719700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.762236+0000 front 2023-12-17T12:04:25.762313+0000 (oldest deadline 2023-12-17T12:04:49.862150+0000) 2023-12-17T12:04:50.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:04:50 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:04:50.489+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:04:51.245 INFO:journalctl@ceph.osd.3.smithi008.stdout:Dec 17 12:04:50 smithi008 bash[100882]: ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-3 2023-12-17T12:04:51.246 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:04:50 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:04:50.874+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.585532+0000 front 2023-12-17T12:04:25.585510+0000 (oldest deadline 2023-12-17T12:04:49.085746+0000) 2023-12-17T12:04:51.475 INFO:journalctl@ceph.osd.5.smithi186.stdout:Dec 17 12:04:51 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-5[55448]: 2023-12-17T12:04:51.198+0000 7fbc59719700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.762236+0000 front 2023-12-17T12:04:25.762313+0000 (oldest deadline 2023-12-17T12:04:49.862150+0000) 2023-12-17T12:04:51.475 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:04:51 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:04:51.208+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:04:51.880 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:04:51 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:04:51.514+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:04:52.173 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:04:51 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:04:51.879+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.585532+0000 front 2023-12-17T12:04:25.585510+0000 (oldest deadline 2023-12-17T12:04:49.085746+0000) 2023-12-17T12:04:52.410 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.3.service' 2023-12-17T12:04:52.474 INFO:journalctl@ceph.osd.3.smithi008.stdout:Dec 17 12:04:52 smithi008 systemd[1]: ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.3.service: Succeeded. 2023-12-17T12:04:52.474 INFO:journalctl@ceph.osd.3.smithi008.stdout:Dec 17 12:04:52 smithi008 systemd[1]: Stopped Ceph osd.3 for f43f508a-9cd2-11ee-95a5-87774f69a715. 2023-12-17T12:04:52.475 INFO:journalctl@ceph.osd.5.smithi186.stdout:Dec 17 12:04:52 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-5[55448]: 2023-12-17T12:04:52.155+0000 7fbc59719700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.762236+0000 front 2023-12-17T12:04:25.762313+0000 (oldest deadline 2023-12-17T12:04:49.862150+0000) 2023-12-17T12:04:52.475 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:04:52 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:04:52.201+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:04:52.501 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-17T12:04:52.501 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-12-17T12:04:52.502 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-12-17T12:04:52.502 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.4 2023-12-17T12:04:52.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:04:52 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:04:52.514+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:04:52.874 INFO:journalctl@ceph.osd.4.smithi100.stdout:Dec 17 12:04:52 smithi100 systemd[1]: Stopping Ceph osd.4 for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:04:53.165 INFO:journalctl@ceph.osd.4.smithi100.stdout:Dec 17 12:04:52 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-4[54306]: 2023-12-17T12:04:52.871+0000 7f9686f7a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:04:53.166 INFO:journalctl@ceph.osd.4.smithi100.stdout:Dec 17 12:04:52 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-4[54306]: 2023-12-17T12:04:52.871+0000 7f9686f7a700 -1 osd.4 88 *** Got signal Terminated *** 2023-12-17T12:04:53.166 INFO:journalctl@ceph.osd.4.smithi100.stdout:Dec 17 12:04:52 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-4[54306]: 2023-12-17T12:04:52.871+0000 7f9686f7a700 -1 osd.4 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-17T12:04:53.245 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:04:52 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:04:52.845+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.585532+0000 front 2023-12-17T12:04:25.585510+0000 (oldest deadline 2023-12-17T12:04:49.085746+0000) 2023-12-17T12:04:53.475 INFO:journalctl@ceph.osd.5.smithi186.stdout:Dec 17 12:04:53 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-5[55448]: 2023-12-17T12:04:53.142+0000 7fbc59719700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.762236+0000 front 2023-12-17T12:04:25.762313+0000 (oldest deadline 2023-12-17T12:04:49.862150+0000) 2023-12-17T12:04:53.475 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:04:53 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:04:53.231+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:04:53.838 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:04:53 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:04:53.497+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:04:54.245 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:04:53 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:04:53.836+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.585532+0000 front 2023-12-17T12:04:25.585510+0000 (oldest deadline 2023-12-17T12:04:49.085746+0000) 2023-12-17T12:04:54.475 INFO:journalctl@ceph.osd.5.smithi186.stdout:Dec 17 12:04:54 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-5[55448]: 2023-12-17T12:04:54.185+0000 7fbc59719700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.762236+0000 front 2023-12-17T12:04:25.762313+0000 (oldest deadline 2023-12-17T12:04:49.862150+0000) 2023-12-17T12:04:54.541 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:04:54 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:04:54.208+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:04:54.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:04:54 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:04:54.469+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:04:55.245 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:04:54 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:04:54.806+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.585532+0000 front 2023-12-17T12:04:25.585510+0000 (oldest deadline 2023-12-17T12:04:49.085746+0000) 2023-12-17T12:04:55.475 INFO:journalctl@ceph.osd.5.smithi186.stdout:Dec 17 12:04:55 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-5[55448]: 2023-12-17T12:04:55.203+0000 7fbc59719700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.762236+0000 front 2023-12-17T12:04:25.762313+0000 (oldest deadline 2023-12-17T12:04:49.862150+0000) 2023-12-17T12:04:55.475 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:04:55 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:04:55.200+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:04:55.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:04:55 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:04:55.439+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:04:56.245 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:04:55 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:04:55.804+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.585532+0000 front 2023-12-17T12:04:25.585510+0000 (oldest deadline 2023-12-17T12:04:49.085746+0000) 2023-12-17T12:04:56.475 INFO:journalctl@ceph.osd.5.smithi186.stdout:Dec 17 12:04:56 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-5[55448]: 2023-12-17T12:04:56.237+0000 7fbc59719700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.762236+0000 front 2023-12-17T12:04:25.762313+0000 (oldest deadline 2023-12-17T12:04:49.862150+0000) 2023-12-17T12:04:56.476 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:04:56 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:04:56.081+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.060228+0000 front 2023-12-17T12:04:30.059973+0000 (oldest deadline 2023-12-17T12:04:55.360222+0000) 2023-12-17T12:04:56.476 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:04:56 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:04:56.206+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:04:56.476 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:04:56 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:04:56.206+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:04:56.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:04:56 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:04:56.394+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:04:57.245 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:04:56 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:04:56.815+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.585532+0000 front 2023-12-17T12:04:25.585510+0000 (oldest deadline 2023-12-17T12:04:49.085746+0000) 2023-12-17T12:04:57.245 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:04:56 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:04:56.815+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:31.986979+0000 front 2023-12-17T12:04:31.987152+0000 (oldest deadline 2023-12-17T12:04:56.687070+0000) 2023-12-17T12:04:57.415 INFO:journalctl@ceph.osd.4.smithi100.stdout:Dec 17 12:04:56 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-4[54306]: 2023-12-17T12:04:56.966+0000 7f9682573700 -1 osd.4 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.101874+0000 front 2023-12-17T12:04:34.101829+0000 (oldest deadline 2023-12-17T12:04:56.401913+0000) 2023-12-17T12:04:57.475 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:04:57 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:04:57.071+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.060228+0000 front 2023-12-17T12:04:30.059973+0000 (oldest deadline 2023-12-17T12:04:55.360222+0000) 2023-12-17T12:04:57.475 INFO:journalctl@ceph.osd.5.smithi186.stdout:Dec 17 12:04:57 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-5[55448]: 2023-12-17T12:04:57.205+0000 7fbc59719700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.762236+0000 front 2023-12-17T12:04:25.762313+0000 (oldest deadline 2023-12-17T12:04:49.862150+0000) 2023-12-17T12:04:57.475 INFO:journalctl@ceph.osd.5.smithi186.stdout:Dec 17 12:04:57 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-5[55448]: 2023-12-17T12:04:57.205+0000 7fbc59719700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:33.963523+0000 front 2023-12-17T12:04:33.963434+0000 (oldest deadline 2023-12-17T12:04:56.863475+0000) 2023-12-17T12:04:57.476 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:04:57 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:04:57.176+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:04:57.476 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:04:57 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:04:57.176+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:04:57.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:04:57 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:04:57.385+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:04:58.245 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:04:57 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:04:57.774+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.585532+0000 front 2023-12-17T12:04:25.585510+0000 (oldest deadline 2023-12-17T12:04:49.085746+0000) 2023-12-17T12:04:58.245 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:04:57 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:04:57.774+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:31.986979+0000 front 2023-12-17T12:04:31.987152+0000 (oldest deadline 2023-12-17T12:04:56.687070+0000) 2023-12-17T12:04:58.475 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:04:58 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:04:58.033+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.060228+0000 front 2023-12-17T12:04:30.059973+0000 (oldest deadline 2023-12-17T12:04:55.360222+0000) 2023-12-17T12:04:58.475 INFO:journalctl@ceph.osd.5.smithi186.stdout:Dec 17 12:04:58 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-5[55448]: 2023-12-17T12:04:58.192+0000 7fbc59719700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.762236+0000 front 2023-12-17T12:04:25.762313+0000 (oldest deadline 2023-12-17T12:04:49.862150+0000) 2023-12-17T12:04:58.476 INFO:journalctl@ceph.osd.5.smithi186.stdout:Dec 17 12:04:58 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-5[55448]: 2023-12-17T12:04:58.192+0000 7fbc59719700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:33.963523+0000 front 2023-12-17T12:04:33.963434+0000 (oldest deadline 2023-12-17T12:04:56.863475+0000) 2023-12-17T12:04:58.476 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:04:58 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:04:58.134+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:04:58.476 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:04:58 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:04:58.134+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:04:58.728 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:04:58 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:04:58.406+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:04:58.872 INFO:journalctl@ceph.osd.4.smithi100.stdout:Dec 17 12:04:58 smithi100 bash[78927]: ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-4 2023-12-17T12:04:58.872 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:04:58 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:04:58.471+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:04:58.995 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:04:58 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:04:58.726+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.585532+0000 front 2023-12-17T12:04:25.585510+0000 (oldest deadline 2023-12-17T12:04:49.085746+0000) 2023-12-17T12:04:58.995 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:04:58 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:04:58.726+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:31.986979+0000 front 2023-12-17T12:04:31.987152+0000 (oldest deadline 2023-12-17T12:04:56.687070+0000) 2023-12-17T12:04:59.165 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:04:58 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:04:58.870+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:32.332019+0000 front 2023-12-17T12:04:32.331891+0000 (oldest deadline 2023-12-17T12:04:58.732839+0000) 2023-12-17T12:04:59.475 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:04:59 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:04:59.062+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.060228+0000 front 2023-12-17T12:04:30.059973+0000 (oldest deadline 2023-12-17T12:04:55.360222+0000) 2023-12-17T12:04:59.476 INFO:journalctl@ceph.osd.5.smithi186.stdout:Dec 17 12:04:59 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-5[55448]: 2023-12-17T12:04:59.178+0000 7fbc59719700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.762236+0000 front 2023-12-17T12:04:25.762313+0000 (oldest deadline 2023-12-17T12:04:49.862150+0000) 2023-12-17T12:04:59.476 INFO:journalctl@ceph.osd.5.smithi186.stdout:Dec 17 12:04:59 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-5[55448]: 2023-12-17T12:04:59.178+0000 7fbc59719700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:33.963523+0000 front 2023-12-17T12:04:33.963434+0000 (oldest deadline 2023-12-17T12:04:56.863475+0000) 2023-12-17T12:04:59.476 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:04:59 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:04:59.178+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:04:59.476 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:04:59 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:04:59.178+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:04:59.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:04:59 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:04:59.453+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:04:59.743 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:04:59 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:04:59.357+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:04:59.743 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:04:59 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:04:59.357+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.198555+0000 front 2023-12-17T12:04:34.198648+0000 (oldest deadline 2023-12-17T12:04:58.898492+0000) 2023-12-17T12:04:59.995 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:04:59 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:04:59.741+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.585532+0000 front 2023-12-17T12:04:25.585510+0000 (oldest deadline 2023-12-17T12:04:49.085746+0000) 2023-12-17T12:04:59.995 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:04:59 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:04:59.741+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:31.986979+0000 front 2023-12-17T12:04:31.987152+0000 (oldest deadline 2023-12-17T12:04:56.687070+0000) 2023-12-17T12:05:00.021 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:04:59 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:04:59.906+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:32.332019+0000 front 2023-12-17T12:04:32.331891+0000 (oldest deadline 2023-12-17T12:04:58.732839+0000) 2023-12-17T12:05:00.048 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.4.service' 2023-12-17T12:05:00.136 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-17T12:05:00.136 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-12-17T12:05:00.137 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-12-17T12:05:00.137 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.5 2023-12-17T12:05:00.475 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:00 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:00.024+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.060228+0000 front 2023-12-17T12:04:30.059973+0000 (oldest deadline 2023-12-17T12:04:55.360222+0000) 2023-12-17T12:05:00.475 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:00 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:00.195+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:00.476 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:00 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:00.195+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:00.476 INFO:journalctl@ceph.osd.5.smithi186.stdout:Dec 17 12:05:00 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-5[55448]: 2023-12-17T12:05:00.151+0000 7fbc59719700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.762236+0000 front 2023-12-17T12:04:25.762313+0000 (oldest deadline 2023-12-17T12:04:49.862150+0000) 2023-12-17T12:05:00.476 INFO:journalctl@ceph.osd.5.smithi186.stdout:Dec 17 12:05:00 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-5[55448]: 2023-12-17T12:05:00.151+0000 7fbc59719700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:33.963523+0000 front 2023-12-17T12:04:33.963434+0000 (oldest deadline 2023-12-17T12:04:56.863475+0000) 2023-12-17T12:05:00.476 INFO:journalctl@ceph.osd.5.smithi186.stdout:Dec 17 12:05:00 smithi186 systemd[1]: Stopping Ceph osd.5 for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:05:00.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:00 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:00.333+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:05:00.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:00 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:00.333+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.198555+0000 front 2023-12-17T12:04:34.198648+0000 (oldest deadline 2023-12-17T12:04:58.898492+0000) 2023-12-17T12:05:00.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:00 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:00.422+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:00.975 INFO:journalctl@ceph.osd.5.smithi186.stdout:Dec 17 12:05:00 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-5[55448]: 2023-12-17T12:05:00.519+0000 7fbc5e921700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:05:00.975 INFO:journalctl@ceph.osd.5.smithi186.stdout:Dec 17 12:05:00 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-5[55448]: 2023-12-17T12:05:00.519+0000 7fbc5e921700 -1 osd.5 88 *** Got signal Terminated *** 2023-12-17T12:05:00.975 INFO:journalctl@ceph.osd.5.smithi186.stdout:Dec 17 12:05:00 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-5[55448]: 2023-12-17T12:05:00.519+0000 7fbc5e921700 -1 osd.5 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-17T12:05:01.245 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:05:00 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:05:00.756+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.585532+0000 front 2023-12-17T12:04:25.585510+0000 (oldest deadline 2023-12-17T12:04:49.085746+0000) 2023-12-17T12:05:01.245 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:05:00 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:05:00.756+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:31.986979+0000 front 2023-12-17T12:04:31.987152+0000 (oldest deadline 2023-12-17T12:04:56.687070+0000) 2023-12-17T12:05:01.415 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:00 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:00.948+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:32.332019+0000 front 2023-12-17T12:04:32.331891+0000 (oldest deadline 2023-12-17T12:04:58.732839+0000) 2023-12-17T12:05:01.475 INFO:journalctl@ceph.osd.5.smithi186.stdout:Dec 17 12:05:01 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-5[55448]: 2023-12-17T12:05:01.200+0000 7fbc59719700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.762236+0000 front 2023-12-17T12:04:25.762313+0000 (oldest deadline 2023-12-17T12:04:49.862150+0000) 2023-12-17T12:05:01.475 INFO:journalctl@ceph.osd.5.smithi186.stdout:Dec 17 12:05:01 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-5[55448]: 2023-12-17T12:05:01.200+0000 7fbc59719700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:33.963523+0000 front 2023-12-17T12:04:33.963434+0000 (oldest deadline 2023-12-17T12:04:56.863475+0000) 2023-12-17T12:05:01.475 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:01 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:01.043+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.060228+0000 front 2023-12-17T12:04:30.059973+0000 (oldest deadline 2023-12-17T12:04:55.360222+0000) 2023-12-17T12:05:01.475 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:01 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:01.186+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:01.476 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:01 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:01.186+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:01.743 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:01 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:01.373+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:05:01.743 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:01 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:01.373+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.198555+0000 front 2023-12-17T12:04:34.198648+0000 (oldest deadline 2023-12-17T12:04:58.898492+0000) 2023-12-17T12:05:01.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:01 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:01.467+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:01.995 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:05:01 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:05:01.741+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.585532+0000 front 2023-12-17T12:04:25.585510+0000 (oldest deadline 2023-12-17T12:04:49.085746+0000) 2023-12-17T12:05:01.995 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:05:01 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:05:01.741+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:31.986979+0000 front 2023-12-17T12:04:31.987152+0000 (oldest deadline 2023-12-17T12:04:56.687070+0000) 2023-12-17T12:05:02.415 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:01 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:01.980+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:32.332019+0000 front 2023-12-17T12:04:32.331891+0000 (oldest deadline 2023-12-17T12:04:58.732839+0000) 2023-12-17T12:05:02.475 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:02 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:02.011+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.060228+0000 front 2023-12-17T12:04:30.059973+0000 (oldest deadline 2023-12-17T12:04:55.360222+0000) 2023-12-17T12:05:02.475 INFO:journalctl@ceph.osd.5.smithi186.stdout:Dec 17 12:05:02 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-5[55448]: 2023-12-17T12:05:02.193+0000 7fbc59719700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.762236+0000 front 2023-12-17T12:04:25.762313+0000 (oldest deadline 2023-12-17T12:04:49.862150+0000) 2023-12-17T12:05:02.475 INFO:journalctl@ceph.osd.5.smithi186.stdout:Dec 17 12:05:02 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-5[55448]: 2023-12-17T12:05:02.193+0000 7fbc59719700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:33.963523+0000 front 2023-12-17T12:04:33.963434+0000 (oldest deadline 2023-12-17T12:04:56.863475+0000) 2023-12-17T12:05:02.475 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:02 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:02.190+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:02.476 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:02 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:02.190+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:02.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:02 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:02.376+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:05:02.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:02 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:02.376+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.198555+0000 front 2023-12-17T12:04:34.198648+0000 (oldest deadline 2023-12-17T12:04:58.898492+0000) 2023-12-17T12:05:02.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:02 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:02.512+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:03.245 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:05:02 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:05:02.761+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.585532+0000 front 2023-12-17T12:04:25.585510+0000 (oldest deadline 2023-12-17T12:04:49.085746+0000) 2023-12-17T12:05:03.245 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:05:02 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:05:02.761+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:31.986979+0000 front 2023-12-17T12:04:31.987152+0000 (oldest deadline 2023-12-17T12:04:56.687070+0000) 2023-12-17T12:05:03.415 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:03 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:03.000+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:32.332019+0000 front 2023-12-17T12:04:32.331891+0000 (oldest deadline 2023-12-17T12:04:58.732839+0000) 2023-12-17T12:05:03.475 INFO:journalctl@ceph.osd.5.smithi186.stdout:Dec 17 12:05:03 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-5[55448]: 2023-12-17T12:05:03.219+0000 7fbc59719700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.762236+0000 front 2023-12-17T12:04:25.762313+0000 (oldest deadline 2023-12-17T12:04:49.862150+0000) 2023-12-17T12:05:03.475 INFO:journalctl@ceph.osd.5.smithi186.stdout:Dec 17 12:05:03 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-5[55448]: 2023-12-17T12:05:03.219+0000 7fbc59719700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:33.963523+0000 front 2023-12-17T12:04:33.963434+0000 (oldest deadline 2023-12-17T12:04:56.863475+0000) 2023-12-17T12:05:03.475 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:03 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:03.013+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.060228+0000 front 2023-12-17T12:04:30.059973+0000 (oldest deadline 2023-12-17T12:04:55.360222+0000) 2023-12-17T12:05:03.476 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:03 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:03.159+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:03.476 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:03 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:03.159+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:03.719 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:03 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:03.369+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:05:03.719 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:03 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:03.369+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.198555+0000 front 2023-12-17T12:04:34.198648+0000 (oldest deadline 2023-12-17T12:04:58.898492+0000) 2023-12-17T12:05:03.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:03 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:03.542+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:03.995 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:05:03 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:05:03.716+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.585532+0000 front 2023-12-17T12:04:25.585510+0000 (oldest deadline 2023-12-17T12:04:49.085746+0000) 2023-12-17T12:05:03.995 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:05:03 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:05:03.716+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:31.986979+0000 front 2023-12-17T12:04:31.987152+0000 (oldest deadline 2023-12-17T12:04:56.687070+0000) 2023-12-17T12:05:04.267 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:04 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:04.005+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.060228+0000 front 2023-12-17T12:04:30.059973+0000 (oldest deadline 2023-12-17T12:04:55.360222+0000) 2023-12-17T12:05:04.267 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:04 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:04.143+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:04.268 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:04 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:04.143+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:04.415 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:04 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:04.000+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:32.332019+0000 front 2023-12-17T12:04:32.331891+0000 (oldest deadline 2023-12-17T12:04:58.732839+0000) 2023-12-17T12:05:04.725 INFO:journalctl@ceph.osd.5.smithi186.stdout:Dec 17 12:05:04 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-5[55448]: 2023-12-17T12:05:04.265+0000 7fbc59719700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.762236+0000 front 2023-12-17T12:04:25.762313+0000 (oldest deadline 2023-12-17T12:04:49.862150+0000) 2023-12-17T12:05:04.725 INFO:journalctl@ceph.osd.5.smithi186.stdout:Dec 17 12:05:04 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-5[55448]: 2023-12-17T12:05:04.265+0000 7fbc59719700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:33.963523+0000 front 2023-12-17T12:04:33.963434+0000 (oldest deadline 2023-12-17T12:04:56.863475+0000) 2023-12-17T12:05:04.740 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:04 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:04.367+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:05:04.740 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:04 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:04.367+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.198555+0000 front 2023-12-17T12:04:34.198648+0000 (oldest deadline 2023-12-17T12:04:58.898492+0000) 2023-12-17T12:05:04.740 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:04 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:04.367+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.899210+0000 front 2023-12-17T12:04:38.899300+0000 (oldest deadline 2023-12-17T12:05:03.599093+0000) 2023-12-17T12:05:04.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:04 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:04.506+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:04.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:04 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:04.506+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:04.995 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:05:04 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:05:04.738+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.585532+0000 front 2023-12-17T12:04:25.585510+0000 (oldest deadline 2023-12-17T12:04:49.085746+0000) 2023-12-17T12:05:04.995 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:05:04 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:05:04.738+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:31.986979+0000 front 2023-12-17T12:04:31.987152+0000 (oldest deadline 2023-12-17T12:04:56.687070+0000) 2023-12-17T12:05:05.415 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:04 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:04.988+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:32.332019+0000 front 2023-12-17T12:04:32.331891+0000 (oldest deadline 2023-12-17T12:04:58.732839+0000) 2023-12-17T12:05:05.475 INFO:journalctl@ceph.osd.5.smithi186.stdout:Dec 17 12:05:05 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-5[55448]: 2023-12-17T12:05:05.264+0000 7fbc59719700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.762236+0000 front 2023-12-17T12:04:25.762313+0000 (oldest deadline 2023-12-17T12:04:49.862150+0000) 2023-12-17T12:05:05.475 INFO:journalctl@ceph.osd.5.smithi186.stdout:Dec 17 12:05:05 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-5[55448]: 2023-12-17T12:05:05.264+0000 7fbc59719700 -1 osd.5 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:33.963523+0000 front 2023-12-17T12:04:33.963434+0000 (oldest deadline 2023-12-17T12:04:56.863475+0000) 2023-12-17T12:05:05.475 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:05 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:05.028+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.060228+0000 front 2023-12-17T12:04:30.059973+0000 (oldest deadline 2023-12-17T12:04:55.360222+0000) 2023-12-17T12:05:05.476 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:05 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:05.147+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:05.476 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:05 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:05.147+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:05.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:05 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:05.415+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:05:05.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:05 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:05.415+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.198555+0000 front 2023-12-17T12:04:34.198648+0000 (oldest deadline 2023-12-17T12:04:58.898492+0000) 2023-12-17T12:05:05.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:05 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:05.415+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.899210+0000 front 2023-12-17T12:04:38.899300+0000 (oldest deadline 2023-12-17T12:05:03.599093+0000) 2023-12-17T12:05:05.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:05 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:05.460+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:05.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:05 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:05.460+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:06.245 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:05:05 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:05:05.786+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.585532+0000 front 2023-12-17T12:04:25.585510+0000 (oldest deadline 2023-12-17T12:04:49.085746+0000) 2023-12-17T12:05:06.245 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:05:05 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:05:05.786+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:31.986979+0000 front 2023-12-17T12:04:31.987152+0000 (oldest deadline 2023-12-17T12:04:56.687070+0000) 2023-12-17T12:05:06.415 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:06 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:06.019+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:32.332019+0000 front 2023-12-17T12:04:32.331891+0000 (oldest deadline 2023-12-17T12:04:58.732839+0000) 2023-12-17T12:05:06.475 INFO:journalctl@ceph.osd.5.smithi186.stdout:Dec 17 12:05:06 smithi186 bash[80196]: ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-5 2023-12-17T12:05:06.475 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:05 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:05.987+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.060228+0000 front 2023-12-17T12:04:30.059973+0000 (oldest deadline 2023-12-17T12:04:55.360222+0000) 2023-12-17T12:05:06.475 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:05 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:05.987+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:40.061304+0000 front 2023-12-17T12:04:40.061484+0000 (oldest deadline 2023-12-17T12:05:05.961463+0000) 2023-12-17T12:05:06.475 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:06 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:06.123+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:06.476 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:06 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:06.123+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:06.476 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:06 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:06.123+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:06.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:06 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:06.431+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:05:06.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:06 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:06.431+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.198555+0000 front 2023-12-17T12:04:34.198648+0000 (oldest deadline 2023-12-17T12:04:58.898492+0000) 2023-12-17T12:05:06.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:06 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:06.431+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.899210+0000 front 2023-12-17T12:04:38.899300+0000 (oldest deadline 2023-12-17T12:05:03.599093+0000) 2023-12-17T12:05:06.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:06 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:06.426+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:06.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:06 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:06.426+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:07.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:06 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:06.953+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.060228+0000 front 2023-12-17T12:04:30.059973+0000 (oldest deadline 2023-12-17T12:04:55.360222+0000) 2023-12-17T12:05:07.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:06 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:06.953+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:40.061304+0000 front 2023-12-17T12:04:40.061484+0000 (oldest deadline 2023-12-17T12:05:05.961463+0000) 2023-12-17T12:05:07.226 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:07 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:07.152+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:07.226 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:07 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:07.152+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:07.226 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:07 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:07.152+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:07.245 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:05:06 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:05:06.813+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.585532+0000 front 2023-12-17T12:04:25.585510+0000 (oldest deadline 2023-12-17T12:04:49.085746+0000) 2023-12-17T12:05:07.245 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:05:06 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:05:06.813+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:31.986979+0000 front 2023-12-17T12:04:31.987152+0000 (oldest deadline 2023-12-17T12:04:56.687070+0000) 2023-12-17T12:05:07.415 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:07 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:07.059+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:32.332019+0000 front 2023-12-17T12:04:32.331891+0000 (oldest deadline 2023-12-17T12:04:58.732839+0000) 2023-12-17T12:05:07.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:07 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:07.444+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:05:07.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:07 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:07.444+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.198555+0000 front 2023-12-17T12:04:34.198648+0000 (oldest deadline 2023-12-17T12:04:58.898492+0000) 2023-12-17T12:05:07.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:07 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:07.444+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.899210+0000 front 2023-12-17T12:04:38.899300+0000 (oldest deadline 2023-12-17T12:05:03.599093+0000) 2023-12-17T12:05:07.909 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.5.service' 2023-12-17T12:05:07.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:07 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:07.428+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:07.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:07 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:07.428+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:08.000 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-17T12:05:08.000 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-12-17T12:05:08.001 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2023-12-17T12:05:08.001 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.6 2023-12-17T12:05:08.097 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:05:07 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:05:07.834+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.585532+0000 front 2023-12-17T12:04:25.585510+0000 (oldest deadline 2023-12-17T12:04:49.085746+0000) 2023-12-17T12:05:08.097 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:05:07 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:05:07.834+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:31.986979+0000 front 2023-12-17T12:04:31.987152+0000 (oldest deadline 2023-12-17T12:04:56.687070+0000) 2023-12-17T12:05:08.097 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:05:07 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:05:07.834+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:36.687734+0000 front 2023-12-17T12:04:36.687751+0000 (oldest deadline 2023-12-17T12:05:07.288559+0000) 2023-12-17T12:05:08.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:07 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:07.987+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.060228+0000 front 2023-12-17T12:04:30.059973+0000 (oldest deadline 2023-12-17T12:04:55.360222+0000) 2023-12-17T12:05:08.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:07 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:07.987+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:40.061304+0000 front 2023-12-17T12:04:40.061484+0000 (oldest deadline 2023-12-17T12:05:05.961463+0000) 2023-12-17T12:05:08.225 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:08 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:08.130+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:08.226 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:08 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:08.130+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:08.226 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:08 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:08.130+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:08.386 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:05:08 smithi008 systemd[1]: Stopping Ceph osd.6 for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:05:08.415 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:08 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:08.034+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:32.332019+0000 front 2023-12-17T12:04:32.331891+0000 (oldest deadline 2023-12-17T12:04:58.732839+0000) 2023-12-17T12:05:08.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:05:08 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:05:08.384+0000 7f3d651fa700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:05:08.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:05:08 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:05:08.384+0000 7f3d651fa700 -1 osd.6 88 *** Got signal Terminated *** 2023-12-17T12:05:08.745 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:05:08 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:05:08.384+0000 7f3d651fa700 -1 osd.6 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-17T12:05:08.746 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:08 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:08.455+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:05:08.746 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:08 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:08.455+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.198555+0000 front 2023-12-17T12:04:34.198648+0000 (oldest deadline 2023-12-17T12:04:58.898492+0000) 2023-12-17T12:05:08.746 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:08 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:08.455+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.899210+0000 front 2023-12-17T12:04:38.899300+0000 (oldest deadline 2023-12-17T12:05:03.599093+0000) 2023-12-17T12:05:08.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:08 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:08.413+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:08.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:08 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:08.413+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:09.245 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:05:08 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:05:08.848+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.585532+0000 front 2023-12-17T12:04:25.585510+0000 (oldest deadline 2023-12-17T12:04:49.085746+0000) 2023-12-17T12:05:09.245 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:05:08 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:05:08.848+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:31.986979+0000 front 2023-12-17T12:04:31.987152+0000 (oldest deadline 2023-12-17T12:04:56.687070+0000) 2023-12-17T12:05:09.245 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:05:08 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:05:08.848+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:36.687734+0000 front 2023-12-17T12:04:36.687751+0000 (oldest deadline 2023-12-17T12:05:07.288559+0000) 2023-12-17T12:05:09.381 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:09 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:09.016+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:32.332019+0000 front 2023-12-17T12:04:32.331891+0000 (oldest deadline 2023-12-17T12:04:58.732839+0000) 2023-12-17T12:05:09.381 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:09 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:09.016+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.733611+0000 front 2023-12-17T12:04:38.733646+0000 (oldest deadline 2023-12-17T12:05:08.134047+0000) 2023-12-17T12:05:09.475 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:08 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:08.974+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.060228+0000 front 2023-12-17T12:04:30.059973+0000 (oldest deadline 2023-12-17T12:04:55.360222+0000) 2023-12-17T12:05:09.475 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:08 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:08.974+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:40.061304+0000 front 2023-12-17T12:04:40.061484+0000 (oldest deadline 2023-12-17T12:05:05.961463+0000) 2023-12-17T12:05:09.475 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:09 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:09.163+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:09.475 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:09 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:09.163+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:09.476 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:09 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:09.163+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:09.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:09 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:09.379+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:09.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:09 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:09.379+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:09.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:09 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:09.452+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:05:09.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:09 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:09.452+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.198555+0000 front 2023-12-17T12:04:34.198648+0000 (oldest deadline 2023-12-17T12:04:58.898492+0000) 2023-12-17T12:05:09.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:09 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:09.452+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.899210+0000 front 2023-12-17T12:04:38.899300+0000 (oldest deadline 2023-12-17T12:05:03.599093+0000) 2023-12-17T12:05:10.245 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:05:09 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:05:09.813+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.585532+0000 front 2023-12-17T12:04:25.585510+0000 (oldest deadline 2023-12-17T12:04:49.085746+0000) 2023-12-17T12:05:10.245 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:05:09 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:05:09.813+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:31.986979+0000 front 2023-12-17T12:04:31.987152+0000 (oldest deadline 2023-12-17T12:04:56.687070+0000) 2023-12-17T12:05:10.245 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:05:09 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:05:09.813+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:36.687734+0000 front 2023-12-17T12:04:36.687751+0000 (oldest deadline 2023-12-17T12:05:07.288559+0000) 2023-12-17T12:05:10.365 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:10 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:10.037+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:32.332019+0000 front 2023-12-17T12:04:32.331891+0000 (oldest deadline 2023-12-17T12:04:58.732839+0000) 2023-12-17T12:05:10.365 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:10 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:10.037+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.733611+0000 front 2023-12-17T12:04:38.733646+0000 (oldest deadline 2023-12-17T12:05:08.134047+0000) 2023-12-17T12:05:10.475 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:10 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:10.006+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.060228+0000 front 2023-12-17T12:04:30.059973+0000 (oldest deadline 2023-12-17T12:04:55.360222+0000) 2023-12-17T12:05:10.475 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:10 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:10.006+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:40.061304+0000 front 2023-12-17T12:04:40.061484+0000 (oldest deadline 2023-12-17T12:05:05.961463+0000) 2023-12-17T12:05:10.475 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:10 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:10.144+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:10.475 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:10 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:10.144+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:10.475 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:10 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:10.144+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:10.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:10 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:10.363+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:10.666 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:10 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:10.363+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:10.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:10 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:10.429+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:05:10.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:10 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:10.429+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.198555+0000 front 2023-12-17T12:04:34.198648+0000 (oldest deadline 2023-12-17T12:04:58.898492+0000) 2023-12-17T12:05:10.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:10 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:10.429+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.899210+0000 front 2023-12-17T12:04:38.899300+0000 (oldest deadline 2023-12-17T12:05:03.599093+0000) 2023-12-17T12:05:11.245 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:05:10 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:05:10.829+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.585532+0000 front 2023-12-17T12:04:25.585510+0000 (oldest deadline 2023-12-17T12:04:49.085746+0000) 2023-12-17T12:05:11.245 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:05:10 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:05:10.829+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:31.986979+0000 front 2023-12-17T12:04:31.987152+0000 (oldest deadline 2023-12-17T12:04:56.687070+0000) 2023-12-17T12:05:11.246 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:05:10 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:05:10.829+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:36.687734+0000 front 2023-12-17T12:04:36.687751+0000 (oldest deadline 2023-12-17T12:05:07.288559+0000) 2023-12-17T12:05:11.317 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:11 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:11.064+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:32.332019+0000 front 2023-12-17T12:04:32.331891+0000 (oldest deadline 2023-12-17T12:04:58.732839+0000) 2023-12-17T12:05:11.317 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:11 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:11.064+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.733611+0000 front 2023-12-17T12:04:38.733646+0000 (oldest deadline 2023-12-17T12:05:08.134047+0000) 2023-12-17T12:05:11.475 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:11 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:11.022+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.060228+0000 front 2023-12-17T12:04:30.059973+0000 (oldest deadline 2023-12-17T12:04:55.360222+0000) 2023-12-17T12:05:11.475 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:11 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:11.023+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:40.061304+0000 front 2023-12-17T12:04:40.061484+0000 (oldest deadline 2023-12-17T12:05:05.961463+0000) 2023-12-17T12:05:11.476 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:11 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:11.141+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:11.476 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:11 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:11.141+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:11.476 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:11 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:11.141+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:11.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:11 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:11.315+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:11.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:11 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:11.315+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:11.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:11 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:11.395+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:05:11.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:11 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:11.395+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.198555+0000 front 2023-12-17T12:04:34.198648+0000 (oldest deadline 2023-12-17T12:04:58.898492+0000) 2023-12-17T12:05:11.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:11 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:11.395+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.899210+0000 front 2023-12-17T12:04:38.899300+0000 (oldest deadline 2023-12-17T12:05:03.599093+0000) 2023-12-17T12:05:12.245 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:05:11 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:05:11.873+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.585532+0000 front 2023-12-17T12:04:25.585510+0000 (oldest deadline 2023-12-17T12:04:49.085746+0000) 2023-12-17T12:05:12.245 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:05:11 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:05:11.873+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:31.986979+0000 front 2023-12-17T12:04:31.987152+0000 (oldest deadline 2023-12-17T12:04:56.687070+0000) 2023-12-17T12:05:12.245 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:05:11 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:05:11.873+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:36.687734+0000 front 2023-12-17T12:04:36.687751+0000 (oldest deadline 2023-12-17T12:05:07.288559+0000) 2023-12-17T12:05:12.337 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:12 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:12.015+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:32.332019+0000 front 2023-12-17T12:04:32.331891+0000 (oldest deadline 2023-12-17T12:04:58.732839+0000) 2023-12-17T12:05:12.337 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:12 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:12.015+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.733611+0000 front 2023-12-17T12:04:38.733646+0000 (oldest deadline 2023-12-17T12:05:08.134047+0000) 2023-12-17T12:05:12.475 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:12 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:12.040+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.060228+0000 front 2023-12-17T12:04:30.059973+0000 (oldest deadline 2023-12-17T12:04:55.360222+0000) 2023-12-17T12:05:12.475 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:12 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:12.040+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:40.061304+0000 front 2023-12-17T12:04:40.061484+0000 (oldest deadline 2023-12-17T12:05:05.961463+0000) 2023-12-17T12:05:12.475 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:12 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:12.162+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:12.475 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:12 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:12.162+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:12.475 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:12 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:12.162+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:12.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:12 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:12.335+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:12.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:12 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:12.335+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:12.666 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:12 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:12.335+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.748238+0000 front 2023-12-17T12:04:49.748253+0000 (oldest deadline 2023-12-17T12:05:11.448295+0000) 2023-12-17T12:05:12.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:12 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:12.425+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:05:12.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:12 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:12.425+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.198555+0000 front 2023-12-17T12:04:34.198648+0000 (oldest deadline 2023-12-17T12:04:58.898492+0000) 2023-12-17T12:05:12.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:12 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:12.425+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.899210+0000 front 2023-12-17T12:04:38.899300+0000 (oldest deadline 2023-12-17T12:05:03.599093+0000) 2023-12-17T12:05:13.245 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:05:12 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:05:12.846+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:25.585532+0000 front 2023-12-17T12:04:25.585510+0000 (oldest deadline 2023-12-17T12:04:49.085746+0000) 2023-12-17T12:05:13.245 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:05:12 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:05:12.846+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:31.986979+0000 front 2023-12-17T12:04:31.987152+0000 (oldest deadline 2023-12-17T12:04:56.687070+0000) 2023-12-17T12:05:13.245 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:05:12 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:05:12.846+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:36.687734+0000 front 2023-12-17T12:04:36.687751+0000 (oldest deadline 2023-12-17T12:05:07.288559+0000) 2023-12-17T12:05:13.245 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:05:12 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6[71325]: 2023-12-17T12:05:12.846+0000 7f3d5f7f1700 -1 osd.6 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:48.989511+0000 front 2023-12-17T12:04:48.989545+0000 (oldest deadline 2023-12-17T12:05:11.889603+0000) 2023-12-17T12:05:13.374 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:12 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:12.981+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:32.332019+0000 front 2023-12-17T12:04:32.331891+0000 (oldest deadline 2023-12-17T12:04:58.732839+0000) 2023-12-17T12:05:13.374 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:12 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:12.981+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.733611+0000 front 2023-12-17T12:04:38.733646+0000 (oldest deadline 2023-12-17T12:05:08.134047+0000) 2023-12-17T12:05:13.475 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:13 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:13.011+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.060228+0000 front 2023-12-17T12:04:30.059973+0000 (oldest deadline 2023-12-17T12:04:55.360222+0000) 2023-12-17T12:05:13.475 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:13 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:13.011+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:40.061304+0000 front 2023-12-17T12:04:40.061484+0000 (oldest deadline 2023-12-17T12:05:05.961463+0000) 2023-12-17T12:05:13.476 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:13 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:13.175+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:13.476 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:13 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:13.175+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:13.476 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:13 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:13.175+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:13.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:13 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:13.371+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:13.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:13 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:13.371+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:13.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:13 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:13.371+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.748238+0000 front 2023-12-17T12:04:49.748253+0000 (oldest deadline 2023-12-17T12:05:11.448295+0000) 2023-12-17T12:05:13.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:13 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:13.460+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:05:13.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:13 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:13.460+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.198555+0000 front 2023-12-17T12:04:34.198648+0000 (oldest deadline 2023-12-17T12:04:58.898492+0000) 2023-12-17T12:05:13.746 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:13 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:13.460+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.899210+0000 front 2023-12-17T12:04:38.899300+0000 (oldest deadline 2023-12-17T12:05:03.599093+0000) 2023-12-17T12:05:14.245 INFO:journalctl@ceph.osd.6.smithi008.stdout:Dec 17 12:05:14 smithi008 bash[101148]: ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-6 2023-12-17T12:05:14.385 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:14 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:14.030+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:32.332019+0000 front 2023-12-17T12:04:32.331891+0000 (oldest deadline 2023-12-17T12:04:58.732839+0000) 2023-12-17T12:05:14.385 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:14 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:14.030+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.733611+0000 front 2023-12-17T12:04:38.733646+0000 (oldest deadline 2023-12-17T12:05:08.134047+0000) 2023-12-17T12:05:14.385 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:14 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:14.030+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:48.134921+0000 front 2023-12-17T12:04:48.134804+0000 (oldest deadline 2023-12-17T12:05:13.434792+0000) 2023-12-17T12:05:14.475 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:13 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:13.982+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.060228+0000 front 2023-12-17T12:04:30.059973+0000 (oldest deadline 2023-12-17T12:04:55.360222+0000) 2023-12-17T12:05:14.475 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:13 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:13.982+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:40.061304+0000 front 2023-12-17T12:04:40.061484+0000 (oldest deadline 2023-12-17T12:05:05.961463+0000) 2023-12-17T12:05:14.476 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:14 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:14.147+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:14.476 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:14 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:14.147+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:14.476 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:14 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:14.147+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:14.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:14 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:14.383+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:14.666 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:14 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:14.383+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:14.666 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:14 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:14.383+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.748238+0000 front 2023-12-17T12:04:49.748253+0000 (oldest deadline 2023-12-17T12:05:11.448295+0000) 2023-12-17T12:05:14.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:14 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:14.471+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:05:14.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:14 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:14.471+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.198555+0000 front 2023-12-17T12:04:34.198648+0000 (oldest deadline 2023-12-17T12:04:58.898492+0000) 2023-12-17T12:05:14.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:14 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:14.471+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.899210+0000 front 2023-12-17T12:04:38.899300+0000 (oldest deadline 2023-12-17T12:05:03.599093+0000) 2023-12-17T12:05:15.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:14 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:14.948+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.060228+0000 front 2023-12-17T12:04:30.059973+0000 (oldest deadline 2023-12-17T12:04:55.360222+0000) 2023-12-17T12:05:15.226 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:14 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:14.948+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:40.061304+0000 front 2023-12-17T12:04:40.061484+0000 (oldest deadline 2023-12-17T12:05:05.961463+0000) 2023-12-17T12:05:15.226 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:14 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:14.948+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:48.863158+0000 front 2023-12-17T12:04:48.863271+0000 (oldest deadline 2023-12-17T12:05:14.762928+0000) 2023-12-17T12:05:15.227 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:15 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:15.106+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:15.227 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:15 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:15.106+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:15.227 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:15 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:15.106+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:15.377 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:14 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:14.988+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:32.332019+0000 front 2023-12-17T12:04:32.331891+0000 (oldest deadline 2023-12-17T12:04:58.732839+0000) 2023-12-17T12:05:15.377 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:14 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:14.988+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.733611+0000 front 2023-12-17T12:04:38.733646+0000 (oldest deadline 2023-12-17T12:05:08.134047+0000) 2023-12-17T12:05:15.378 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:14 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:14.988+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:48.134921+0000 front 2023-12-17T12:04:48.134804+0000 (oldest deadline 2023-12-17T12:05:13.434792+0000) 2023-12-17T12:05:15.538 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.6.service' 2023-12-17T12:05:15.628 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-17T12:05:15.628 INFO:tasks.cephadm.osd.6:Stopped osd.6 2023-12-17T12:05:15.628 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2023-12-17T12:05:15.629 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.7 2023-12-17T12:05:15.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:15 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:15.375+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:15.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:15 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:15.375+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:15.666 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:15 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:15.375+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.748238+0000 front 2023-12-17T12:04:49.748253+0000 (oldest deadline 2023-12-17T12:05:11.448295+0000) 2023-12-17T12:05:15.984 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:15 smithi100 systemd[1]: Stopping Ceph osd.7 for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:05:15.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:15 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:15.517+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:05:15.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:15 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:15.517+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.198555+0000 front 2023-12-17T12:04:34.198648+0000 (oldest deadline 2023-12-17T12:04:58.898492+0000) 2023-12-17T12:05:15.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:15 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:15.517+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.899210+0000 front 2023-12-17T12:04:38.899300+0000 (oldest deadline 2023-12-17T12:05:03.599093+0000) 2023-12-17T12:05:15.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:15 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:15.517+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.500094+0000 front 2023-12-17T12:04:49.500272+0000 (oldest deadline 2023-12-17T12:05:15.400326+0000) 2023-12-17T12:05:16.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:15 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:15.915+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.060228+0000 front 2023-12-17T12:04:30.059973+0000 (oldest deadline 2023-12-17T12:04:55.360222+0000) 2023-12-17T12:05:16.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:15 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:15.915+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:40.061304+0000 front 2023-12-17T12:04:40.061484+0000 (oldest deadline 2023-12-17T12:05:05.961463+0000) 2023-12-17T12:05:16.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:15 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:15.915+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:48.863158+0000 front 2023-12-17T12:04:48.863271+0000 (oldest deadline 2023-12-17T12:05:14.762928+0000) 2023-12-17T12:05:16.226 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:16 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:16.151+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:16.226 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:16 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:16.151+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:16.226 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:16 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:16.151+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:16.373 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:15 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:15.982+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:32.332019+0000 front 2023-12-17T12:04:32.331891+0000 (oldest deadline 2023-12-17T12:04:58.732839+0000) 2023-12-17T12:05:16.373 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:15 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:15.982+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.733611+0000 front 2023-12-17T12:04:38.733646+0000 (oldest deadline 2023-12-17T12:05:08.134047+0000) 2023-12-17T12:05:16.374 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:15 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:15.982+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:48.134921+0000 front 2023-12-17T12:04:48.134804+0000 (oldest deadline 2023-12-17T12:05:13.434792+0000) 2023-12-17T12:05:16.374 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:16 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:16.017+0000 7ff191253700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:05:16.374 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:16 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:16.017+0000 7ff191253700 -1 osd.7 88 *** Got signal Terminated *** 2023-12-17T12:05:16.374 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:16 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:16.017+0000 7ff191253700 -1 osd.7 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-17T12:05:16.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:16 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:16.371+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:16.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:16 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:16.371+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:16.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:16 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:16.371+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.748238+0000 front 2023-12-17T12:04:49.748253+0000 (oldest deadline 2023-12-17T12:05:11.448295+0000) 2023-12-17T12:05:16.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:16 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:16.528+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:05:16.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:16 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:16.528+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.198555+0000 front 2023-12-17T12:04:34.198648+0000 (oldest deadline 2023-12-17T12:04:58.898492+0000) 2023-12-17T12:05:16.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:16 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:16.528+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.899210+0000 front 2023-12-17T12:04:38.899300+0000 (oldest deadline 2023-12-17T12:05:03.599093+0000) 2023-12-17T12:05:16.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:16 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:16.528+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.500094+0000 front 2023-12-17T12:04:49.500272+0000 (oldest deadline 2023-12-17T12:05:15.400326+0000) 2023-12-17T12:05:17.199 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:16 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:16.888+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.060228+0000 front 2023-12-17T12:04:30.059973+0000 (oldest deadline 2023-12-17T12:04:55.360222+0000) 2023-12-17T12:05:17.199 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:16 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:16.888+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:40.061304+0000 front 2023-12-17T12:04:40.061484+0000 (oldest deadline 2023-12-17T12:05:05.961463+0000) 2023-12-17T12:05:17.199 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:16 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:16.888+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:48.863158+0000 front 2023-12-17T12:04:48.863271+0000 (oldest deadline 2023-12-17T12:05:14.762928+0000) 2023-12-17T12:05:17.373 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:17 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:17.028+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:32.332019+0000 front 2023-12-17T12:04:32.331891+0000 (oldest deadline 2023-12-17T12:04:58.732839+0000) 2023-12-17T12:05:17.373 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:17 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:17.028+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.733611+0000 front 2023-12-17T12:04:38.733646+0000 (oldest deadline 2023-12-17T12:05:08.134047+0000) 2023-12-17T12:05:17.373 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:17 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:17.028+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:48.134921+0000 front 2023-12-17T12:04:48.134804+0000 (oldest deadline 2023-12-17T12:05:13.434792+0000) 2023-12-17T12:05:17.475 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:17 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:17.197+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:17.475 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:17 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:17.197+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:17.475 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:17 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:17.197+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:17.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:17 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:17.371+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:17.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:17 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:17.371+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:17.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:17 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:17.371+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.748238+0000 front 2023-12-17T12:04:49.748253+0000 (oldest deadline 2023-12-17T12:05:11.448295+0000) 2023-12-17T12:05:17.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:17 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:17.541+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:05:17.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:17 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:17.541+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.198555+0000 front 2023-12-17T12:04:34.198648+0000 (oldest deadline 2023-12-17T12:04:58.898492+0000) 2023-12-17T12:05:17.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:17 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:17.541+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.899210+0000 front 2023-12-17T12:04:38.899300+0000 (oldest deadline 2023-12-17T12:05:03.599093+0000) 2023-12-17T12:05:17.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:17 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:17.541+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.500094+0000 front 2023-12-17T12:04:49.500272+0000 (oldest deadline 2023-12-17T12:05:15.400326+0000) 2023-12-17T12:05:18.225 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:18 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:18.157+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:18.225 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:18 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:18.157+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:18.225 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:18 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:18.157+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:18.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:17 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:17.916+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.060228+0000 front 2023-12-17T12:04:30.059973+0000 (oldest deadline 2023-12-17T12:04:55.360222+0000) 2023-12-17T12:05:18.226 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:17 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:17.916+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:40.061304+0000 front 2023-12-17T12:04:40.061484+0000 (oldest deadline 2023-12-17T12:05:05.961463+0000) 2023-12-17T12:05:18.226 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:17 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:17.916+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:48.863158+0000 front 2023-12-17T12:04:48.863271+0000 (oldest deadline 2023-12-17T12:05:14.762928+0000) 2023-12-17T12:05:18.395 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:18 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:18.026+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:32.332019+0000 front 2023-12-17T12:04:32.331891+0000 (oldest deadline 2023-12-17T12:04:58.732839+0000) 2023-12-17T12:05:18.396 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:18 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:18.026+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.733611+0000 front 2023-12-17T12:04:38.733646+0000 (oldest deadline 2023-12-17T12:05:08.134047+0000) 2023-12-17T12:05:18.396 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:18 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:18.026+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:48.134921+0000 front 2023-12-17T12:04:48.134804+0000 (oldest deadline 2023-12-17T12:05:13.434792+0000) 2023-12-17T12:05:18.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:18 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:18.394+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:18.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:18 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:18.394+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:18.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:18 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:18.394+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.748238+0000 front 2023-12-17T12:04:49.748253+0000 (oldest deadline 2023-12-17T12:05:11.448295+0000) 2023-12-17T12:05:18.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:18 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:18.536+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:05:18.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:18 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:18.536+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.198555+0000 front 2023-12-17T12:04:34.198648+0000 (oldest deadline 2023-12-17T12:04:58.898492+0000) 2023-12-17T12:05:18.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:18 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:18.536+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.899210+0000 front 2023-12-17T12:04:38.899300+0000 (oldest deadline 2023-12-17T12:05:03.599093+0000) 2023-12-17T12:05:18.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:18 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:18.536+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.500094+0000 front 2023-12-17T12:04:49.500272+0000 (oldest deadline 2023-12-17T12:05:15.400326+0000) 2023-12-17T12:05:19.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:18 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:18.950+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.060228+0000 front 2023-12-17T12:04:30.059973+0000 (oldest deadline 2023-12-17T12:04:55.360222+0000) 2023-12-17T12:05:19.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:18 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:18.950+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:40.061304+0000 front 2023-12-17T12:04:40.061484+0000 (oldest deadline 2023-12-17T12:05:05.961463+0000) 2023-12-17T12:05:19.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:18 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:18.950+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:48.863158+0000 front 2023-12-17T12:04:48.863271+0000 (oldest deadline 2023-12-17T12:05:14.762928+0000) 2023-12-17T12:05:19.225 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:19 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:19.119+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:19.226 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:19 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:19.119+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:19.226 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:19 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:19.119+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:19.409 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:19 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:19.060+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:32.332019+0000 front 2023-12-17T12:04:32.331891+0000 (oldest deadline 2023-12-17T12:04:58.732839+0000) 2023-12-17T12:05:19.409 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:19 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:19.060+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.733611+0000 front 2023-12-17T12:04:38.733646+0000 (oldest deadline 2023-12-17T12:05:08.134047+0000) 2023-12-17T12:05:19.409 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:19 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:19.060+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:48.134921+0000 front 2023-12-17T12:04:48.134804+0000 (oldest deadline 2023-12-17T12:05:13.434792+0000) 2023-12-17T12:05:19.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:19 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:19.407+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:19.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:19 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:19.407+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:19.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:19 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:19.407+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.748238+0000 front 2023-12-17T12:04:49.748253+0000 (oldest deadline 2023-12-17T12:05:11.448295+0000) 2023-12-17T12:05:19.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:19 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:19.407+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:53.049800+0000 front 2023-12-17T12:04:53.049785+0000 (oldest deadline 2023-12-17T12:05:18.949849+0000) 2023-12-17T12:05:19.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:19 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:19.518+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:05:19.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:19 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:19.518+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.198555+0000 front 2023-12-17T12:04:34.198648+0000 (oldest deadline 2023-12-17T12:04:58.898492+0000) 2023-12-17T12:05:19.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:19 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:19.518+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.899210+0000 front 2023-12-17T12:04:38.899300+0000 (oldest deadline 2023-12-17T12:05:03.599093+0000) 2023-12-17T12:05:19.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:19 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:19.518+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.500094+0000 front 2023-12-17T12:04:49.500272+0000 (oldest deadline 2023-12-17T12:05:15.400326+0000) 2023-12-17T12:05:20.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:19 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:19.958+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.060228+0000 front 2023-12-17T12:04:30.059973+0000 (oldest deadline 2023-12-17T12:04:55.360222+0000) 2023-12-17T12:05:20.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:19 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:19.958+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:40.061304+0000 front 2023-12-17T12:04:40.061484+0000 (oldest deadline 2023-12-17T12:05:05.961463+0000) 2023-12-17T12:05:20.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:19 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:19.958+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:48.863158+0000 front 2023-12-17T12:04:48.863271+0000 (oldest deadline 2023-12-17T12:05:14.762928+0000) 2023-12-17T12:05:20.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:19 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:19.958+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.864262+0000 front 2023-12-17T12:04:55.864133+0000 (oldest deadline 2023-12-17T12:05:19.364268+0000) 2023-12-17T12:05:20.226 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:20 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:20.163+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:20.226 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:20 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:20.163+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:20.226 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:20 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:20.163+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:20.226 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:20 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:20.163+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.998420+0000 front 2023-12-17T12:04:55.998548+0000 (oldest deadline 2023-12-17T12:05:20.098447+0000) 2023-12-17T12:05:20.415 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:20 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:20.099+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:32.332019+0000 front 2023-12-17T12:04:32.331891+0000 (oldest deadline 2023-12-17T12:04:58.732839+0000) 2023-12-17T12:05:20.415 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:20 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:20.099+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.733611+0000 front 2023-12-17T12:04:38.733646+0000 (oldest deadline 2023-12-17T12:05:08.134047+0000) 2023-12-17T12:05:20.415 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:20 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7[62321]: 2023-12-17T12:05:20.099+0000 7ff189846700 -1 osd.7 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:48.134921+0000 front 2023-12-17T12:04:48.134804+0000 (oldest deadline 2023-12-17T12:05:13.434792+0000) 2023-12-17T12:05:20.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:20 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:20.429+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:20.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:20 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:20.429+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:20.916 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:20 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:20.430+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.748238+0000 front 2023-12-17T12:04:49.748253+0000 (oldest deadline 2023-12-17T12:05:11.448295+0000) 2023-12-17T12:05:20.916 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:20 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:20.430+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:53.049800+0000 front 2023-12-17T12:04:53.049785+0000 (oldest deadline 2023-12-17T12:05:18.949849+0000) 2023-12-17T12:05:20.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:20 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:20.534+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:05:20.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:20 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:20.534+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.198555+0000 front 2023-12-17T12:04:34.198648+0000 (oldest deadline 2023-12-17T12:04:58.898492+0000) 2023-12-17T12:05:20.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:20 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:20.534+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.899210+0000 front 2023-12-17T12:04:38.899300+0000 (oldest deadline 2023-12-17T12:05:03.599093+0000) 2023-12-17T12:05:20.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:20 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:20.534+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.500094+0000 front 2023-12-17T12:04:49.500272+0000 (oldest deadline 2023-12-17T12:05:15.400326+0000) 2023-12-17T12:05:20.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:20 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:20.534+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.401134+0000 front 2023-12-17T12:04:55.401481+0000 (oldest deadline 2023-12-17T12:05:20.101006+0000) 2023-12-17T12:05:21.205 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:20 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:20.946+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.060228+0000 front 2023-12-17T12:04:30.059973+0000 (oldest deadline 2023-12-17T12:04:55.360222+0000) 2023-12-17T12:05:21.205 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:20 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:20.946+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:40.061304+0000 front 2023-12-17T12:04:40.061484+0000 (oldest deadline 2023-12-17T12:05:05.961463+0000) 2023-12-17T12:05:21.205 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:20 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:20.946+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:48.863158+0000 front 2023-12-17T12:04:48.863271+0000 (oldest deadline 2023-12-17T12:05:14.762928+0000) 2023-12-17T12:05:21.205 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:20 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:20.946+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.864262+0000 front 2023-12-17T12:04:55.864133+0000 (oldest deadline 2023-12-17T12:05:19.364268+0000) 2023-12-17T12:05:21.475 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:21 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:21.203+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:21.475 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:21 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:21.203+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:21.475 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:21 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:21.203+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:21.475 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:21 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:21.203+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.998420+0000 front 2023-12-17T12:04:55.998548+0000 (oldest deadline 2023-12-17T12:05:20.098447+0000) 2023-12-17T12:05:21.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:21 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:21.489+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:05:21.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:21 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:21.489+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.198555+0000 front 2023-12-17T12:04:34.198648+0000 (oldest deadline 2023-12-17T12:04:58.898492+0000) 2023-12-17T12:05:21.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:21 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:21.489+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.899210+0000 front 2023-12-17T12:04:38.899300+0000 (oldest deadline 2023-12-17T12:05:03.599093+0000) 2023-12-17T12:05:21.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:21 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:21.489+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.500094+0000 front 2023-12-17T12:04:49.500272+0000 (oldest deadline 2023-12-17T12:05:15.400326+0000) 2023-12-17T12:05:21.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:21 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:21.489+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.401134+0000 front 2023-12-17T12:04:55.401481+0000 (oldest deadline 2023-12-17T12:05:20.101006+0000) 2023-12-17T12:05:21.915 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:21 smithi100 bash[79191]: ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-7 2023-12-17T12:05:21.916 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:21 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:21.474+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:21.916 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:21 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:21.474+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:21.916 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:21 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:21.474+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.748238+0000 front 2023-12-17T12:04:49.748253+0000 (oldest deadline 2023-12-17T12:05:11.448295+0000) 2023-12-17T12:05:21.916 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:21 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:21.474+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:53.049800+0000 front 2023-12-17T12:04:53.049785+0000 (oldest deadline 2023-12-17T12:05:18.949849+0000) 2023-12-17T12:05:22.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:21 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:21.965+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.060228+0000 front 2023-12-17T12:04:30.059973+0000 (oldest deadline 2023-12-17T12:04:55.360222+0000) 2023-12-17T12:05:22.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:21 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:21.965+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:40.061304+0000 front 2023-12-17T12:04:40.061484+0000 (oldest deadline 2023-12-17T12:05:05.961463+0000) 2023-12-17T12:05:22.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:21 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:21.965+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:48.863158+0000 front 2023-12-17T12:04:48.863271+0000 (oldest deadline 2023-12-17T12:05:14.762928+0000) 2023-12-17T12:05:22.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:21 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:21.965+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.864262+0000 front 2023-12-17T12:04:55.864133+0000 (oldest deadline 2023-12-17T12:05:19.364268+0000) 2023-12-17T12:05:22.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:22 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:22.228+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:22.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:22 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:22.228+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:22.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:22 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:22.228+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:22.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:22 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:22.228+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.998420+0000 front 2023-12-17T12:04:55.998548+0000 (oldest deadline 2023-12-17T12:05:20.098447+0000) 2023-12-17T12:05:22.802 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:22 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:22.452+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:22.802 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:22 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:22.452+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:22.802 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:22 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:22.452+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.748238+0000 front 2023-12-17T12:04:49.748253+0000 (oldest deadline 2023-12-17T12:05:11.448295+0000) 2023-12-17T12:05:22.802 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:22 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:22.452+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:53.049800+0000 front 2023-12-17T12:04:53.049785+0000 (oldest deadline 2023-12-17T12:05:18.949849+0000) 2023-12-17T12:05:22.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:22 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:22.529+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:05:22.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:22 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:22.529+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.198555+0000 front 2023-12-17T12:04:34.198648+0000 (oldest deadline 2023-12-17T12:04:58.898492+0000) 2023-12-17T12:05:22.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:22 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:22.529+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.899210+0000 front 2023-12-17T12:04:38.899300+0000 (oldest deadline 2023-12-17T12:05:03.599093+0000) 2023-12-17T12:05:22.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:22 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:22.529+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.500094+0000 front 2023-12-17T12:04:49.500272+0000 (oldest deadline 2023-12-17T12:05:15.400326+0000) 2023-12-17T12:05:22.996 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:22 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:22.529+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.401134+0000 front 2023-12-17T12:04:55.401481+0000 (oldest deadline 2023-12-17T12:05:20.101006+0000) 2023-12-17T12:05:23.049 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.7.service' 2023-12-17T12:05:23.152 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:23 smithi100 systemd[1]: ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.7.service: Succeeded. 2023-12-17T12:05:23.152 INFO:journalctl@ceph.osd.7.smithi100.stdout:Dec 17 12:05:23 smithi100 systemd[1]: Stopped Ceph osd.7 for f43f508a-9cd2-11ee-95a5-87774f69a715. 2023-12-17T12:05:23.178 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-17T12:05:23.178 INFO:tasks.cephadm.osd.7:Stopped osd.7 2023-12-17T12:05:23.178 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2023-12-17T12:05:23.178 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.8 2023-12-17T12:05:23.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:22 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:22.938+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.060228+0000 front 2023-12-17T12:04:30.059973+0000 (oldest deadline 2023-12-17T12:04:55.360222+0000) 2023-12-17T12:05:23.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:22 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:22.938+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:40.061304+0000 front 2023-12-17T12:04:40.061484+0000 (oldest deadline 2023-12-17T12:05:05.961463+0000) 2023-12-17T12:05:23.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:22 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:22.938+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:48.863158+0000 front 2023-12-17T12:04:48.863271+0000 (oldest deadline 2023-12-17T12:05:14.762928+0000) 2023-12-17T12:05:23.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:22 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:22.938+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.864262+0000 front 2023-12-17T12:04:55.864133+0000 (oldest deadline 2023-12-17T12:05:19.364268+0000) 2023-12-17T12:05:23.225 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:23 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:23.185+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:23.225 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:23 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:23.185+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:23.225 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:23 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:23.185+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:23.226 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:23 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:23.185+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.998420+0000 front 2023-12-17T12:04:55.998548+0000 (oldest deadline 2023-12-17T12:05:20.098447+0000) 2023-12-17T12:05:23.584 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:23 smithi186 systemd[1]: Stopping Ceph osd.8 for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:05:23.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:23 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:23.488+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:23.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:23 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:23.488+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:23.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:23 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:23.488+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.748238+0000 front 2023-12-17T12:04:49.748253+0000 (oldest deadline 2023-12-17T12:05:11.448295+0000) 2023-12-17T12:05:23.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:23 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:23.488+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:53.049800+0000 front 2023-12-17T12:04:53.049785+0000 (oldest deadline 2023-12-17T12:05:18.949849+0000) 2023-12-17T12:05:23.945 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:23 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:23.582+0000 7f6a6201e700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:05:23.945 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:23 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:23.582+0000 7f6a6201e700 -1 osd.8 88 *** Got signal Terminated *** 2023-12-17T12:05:23.945 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:23 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:23.582+0000 7f6a6201e700 -1 osd.8 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-17T12:05:23.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:23 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:23.551+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:05:23.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:23 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:23.551+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.198555+0000 front 2023-12-17T12:04:34.198648+0000 (oldest deadline 2023-12-17T12:04:58.898492+0000) 2023-12-17T12:05:23.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:23 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:23.551+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.899210+0000 front 2023-12-17T12:04:38.899300+0000 (oldest deadline 2023-12-17T12:05:03.599093+0000) 2023-12-17T12:05:23.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:23 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:23.551+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.500094+0000 front 2023-12-17T12:04:49.500272+0000 (oldest deadline 2023-12-17T12:05:15.400326+0000) 2023-12-17T12:05:23.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:23 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:23.551+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.401134+0000 front 2023-12-17T12:04:55.401481+0000 (oldest deadline 2023-12-17T12:05:20.101006+0000) 2023-12-17T12:05:24.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:23 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:23.943+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.060228+0000 front 2023-12-17T12:04:30.059973+0000 (oldest deadline 2023-12-17T12:04:55.360222+0000) 2023-12-17T12:05:24.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:23 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:23.943+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:40.061304+0000 front 2023-12-17T12:04:40.061484+0000 (oldest deadline 2023-12-17T12:05:05.961463+0000) 2023-12-17T12:05:24.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:23 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:23.943+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:48.863158+0000 front 2023-12-17T12:04:48.863271+0000 (oldest deadline 2023-12-17T12:05:14.762928+0000) 2023-12-17T12:05:24.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:23 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:23.943+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.864262+0000 front 2023-12-17T12:04:55.864133+0000 (oldest deadline 2023-12-17T12:05:19.364268+0000) 2023-12-17T12:05:24.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:24 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:24.231+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:24.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:24 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:24.231+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:24.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:24 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:24.231+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:24.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:24 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:24.231+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.998420+0000 front 2023-12-17T12:04:55.998548+0000 (oldest deadline 2023-12-17T12:05:20.098447+0000) 2023-12-17T12:05:24.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:24 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:24.448+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:24.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:24 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:24.448+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:24.916 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:24 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:24.448+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.748238+0000 front 2023-12-17T12:04:49.748253+0000 (oldest deadline 2023-12-17T12:05:11.448295+0000) 2023-12-17T12:05:24.916 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:24 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:24.448+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:53.049800+0000 front 2023-12-17T12:04:53.049785+0000 (oldest deadline 2023-12-17T12:05:18.949849+0000) 2023-12-17T12:05:24.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:24 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:24.593+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:05:24.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:24 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:24.593+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.198555+0000 front 2023-12-17T12:04:34.198648+0000 (oldest deadline 2023-12-17T12:04:58.898492+0000) 2023-12-17T12:05:24.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:24 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:24.593+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.899210+0000 front 2023-12-17T12:04:38.899300+0000 (oldest deadline 2023-12-17T12:05:03.599093+0000) 2023-12-17T12:05:24.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:24 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:24.593+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.500094+0000 front 2023-12-17T12:04:49.500272+0000 (oldest deadline 2023-12-17T12:05:15.400326+0000) 2023-12-17T12:05:24.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:24 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:24.593+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.401134+0000 front 2023-12-17T12:04:55.401481+0000 (oldest deadline 2023-12-17T12:05:20.101006+0000) 2023-12-17T12:05:25.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:24 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:24.912+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.060228+0000 front 2023-12-17T12:04:30.059973+0000 (oldest deadline 2023-12-17T12:04:55.360222+0000) 2023-12-17T12:05:25.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:24 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:24.912+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:40.061304+0000 front 2023-12-17T12:04:40.061484+0000 (oldest deadline 2023-12-17T12:05:05.961463+0000) 2023-12-17T12:05:25.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:24 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:24.912+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:48.863158+0000 front 2023-12-17T12:04:48.863271+0000 (oldest deadline 2023-12-17T12:05:14.762928+0000) 2023-12-17T12:05:25.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:24 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:24.912+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.864262+0000 front 2023-12-17T12:04:55.864133+0000 (oldest deadline 2023-12-17T12:05:19.364268+0000) 2023-12-17T12:05:25.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:25 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:25.282+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:25.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:25 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:25.282+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:25.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:25 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:25.282+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:25.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:25 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:25.282+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.998420+0000 front 2023-12-17T12:04:55.998548+0000 (oldest deadline 2023-12-17T12:05:20.098447+0000) 2023-12-17T12:05:25.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:25 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:25.481+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:25.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:25 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:25.481+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:25.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:25 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:25.481+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.748238+0000 front 2023-12-17T12:04:49.748253+0000 (oldest deadline 2023-12-17T12:05:11.448295+0000) 2023-12-17T12:05:25.916 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:25 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:25.481+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:53.049800+0000 front 2023-12-17T12:04:53.049785+0000 (oldest deadline 2023-12-17T12:05:18.949849+0000) 2023-12-17T12:05:25.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:25 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:25.593+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:05:25.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:25 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:25.593+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.198555+0000 front 2023-12-17T12:04:34.198648+0000 (oldest deadline 2023-12-17T12:04:58.898492+0000) 2023-12-17T12:05:25.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:25 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:25.593+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.899210+0000 front 2023-12-17T12:04:38.899300+0000 (oldest deadline 2023-12-17T12:05:03.599093+0000) 2023-12-17T12:05:25.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:25 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:25.593+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.500094+0000 front 2023-12-17T12:04:49.500272+0000 (oldest deadline 2023-12-17T12:05:15.400326+0000) 2023-12-17T12:05:25.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:25 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:25.593+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.401134+0000 front 2023-12-17T12:04:55.401481+0000 (oldest deadline 2023-12-17T12:05:20.101006+0000) 2023-12-17T12:05:26.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:25 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:25.890+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.060228+0000 front 2023-12-17T12:04:30.059973+0000 (oldest deadline 2023-12-17T12:04:55.360222+0000) 2023-12-17T12:05:26.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:25 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:25.890+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:40.061304+0000 front 2023-12-17T12:04:40.061484+0000 (oldest deadline 2023-12-17T12:05:05.961463+0000) 2023-12-17T12:05:26.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:25 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:25.890+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:48.863158+0000 front 2023-12-17T12:04:48.863271+0000 (oldest deadline 2023-12-17T12:05:14.762928+0000) 2023-12-17T12:05:26.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:25 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:25.890+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.864262+0000 front 2023-12-17T12:04:55.864133+0000 (oldest deadline 2023-12-17T12:05:19.364268+0000) 2023-12-17T12:05:26.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:26 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:26.324+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:26.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:26 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:26.324+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:26.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:26 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:26.324+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:26.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:26 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:26.324+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.998420+0000 front 2023-12-17T12:04:55.998548+0000 (oldest deadline 2023-12-17T12:05:20.098447+0000) 2023-12-17T12:05:26.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:26 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:26.473+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:26.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:26 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:26.473+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:26.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:26 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:26.473+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.748238+0000 front 2023-12-17T12:04:49.748253+0000 (oldest deadline 2023-12-17T12:05:11.448295+0000) 2023-12-17T12:05:26.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:26 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:26.473+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:53.049800+0000 front 2023-12-17T12:04:53.049785+0000 (oldest deadline 2023-12-17T12:05:18.949849+0000) 2023-12-17T12:05:26.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:26 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:26.556+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:05:26.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:26 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:26.556+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.198555+0000 front 2023-12-17T12:04:34.198648+0000 (oldest deadline 2023-12-17T12:04:58.898492+0000) 2023-12-17T12:05:26.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:26 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:26.556+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.899210+0000 front 2023-12-17T12:04:38.899300+0000 (oldest deadline 2023-12-17T12:05:03.599093+0000) 2023-12-17T12:05:26.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:26 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:26.556+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.500094+0000 front 2023-12-17T12:04:49.500272+0000 (oldest deadline 2023-12-17T12:05:15.400326+0000) 2023-12-17T12:05:26.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:26 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:26.556+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.401134+0000 front 2023-12-17T12:04:55.401481+0000 (oldest deadline 2023-12-17T12:05:20.101006+0000) 2023-12-17T12:05:27.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:26 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:26.934+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.060228+0000 front 2023-12-17T12:04:30.059973+0000 (oldest deadline 2023-12-17T12:04:55.360222+0000) 2023-12-17T12:05:27.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:26 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:26.934+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:40.061304+0000 front 2023-12-17T12:04:40.061484+0000 (oldest deadline 2023-12-17T12:05:05.961463+0000) 2023-12-17T12:05:27.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:26 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:26.934+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:48.863158+0000 front 2023-12-17T12:04:48.863271+0000 (oldest deadline 2023-12-17T12:05:14.762928+0000) 2023-12-17T12:05:27.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:26 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:26.934+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.864262+0000 front 2023-12-17T12:04:55.864133+0000 (oldest deadline 2023-12-17T12:05:19.364268+0000) 2023-12-17T12:05:27.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:27 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:27.339+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:27.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:27 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:27.339+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:27.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:27 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:27.339+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:27.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:27 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:27.339+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.998420+0000 front 2023-12-17T12:04:55.998548+0000 (oldest deadline 2023-12-17T12:05:20.098447+0000) 2023-12-17T12:05:27.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:27 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:27.449+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:27.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:27 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:27.449+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:27.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:27 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:27.449+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.748238+0000 front 2023-12-17T12:04:49.748253+0000 (oldest deadline 2023-12-17T12:05:11.448295+0000) 2023-12-17T12:05:27.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:27 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:27.449+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:53.049800+0000 front 2023-12-17T12:04:53.049785+0000 (oldest deadline 2023-12-17T12:05:18.949849+0000) 2023-12-17T12:05:27.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:27 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:27.522+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:05:27.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:27 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:27.522+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.198555+0000 front 2023-12-17T12:04:34.198648+0000 (oldest deadline 2023-12-17T12:04:58.898492+0000) 2023-12-17T12:05:27.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:27 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:27.522+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.899210+0000 front 2023-12-17T12:04:38.899300+0000 (oldest deadline 2023-12-17T12:05:03.599093+0000) 2023-12-17T12:05:27.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:27 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:27.522+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.500094+0000 front 2023-12-17T12:04:49.500272+0000 (oldest deadline 2023-12-17T12:05:15.400326+0000) 2023-12-17T12:05:27.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:27 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:27.522+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.401134+0000 front 2023-12-17T12:04:55.401481+0000 (oldest deadline 2023-12-17T12:05:20.101006+0000) 2023-12-17T12:05:28.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:27 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:27.944+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.060228+0000 front 2023-12-17T12:04:30.059973+0000 (oldest deadline 2023-12-17T12:04:55.360222+0000) 2023-12-17T12:05:28.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:27 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:27.944+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:40.061304+0000 front 2023-12-17T12:04:40.061484+0000 (oldest deadline 2023-12-17T12:05:05.961463+0000) 2023-12-17T12:05:28.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:27 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:27.944+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:48.863158+0000 front 2023-12-17T12:04:48.863271+0000 (oldest deadline 2023-12-17T12:05:14.762928+0000) 2023-12-17T12:05:28.225 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:27 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8[63297]: 2023-12-17T12:05:27.944+0000 7f6a5e619700 -1 osd.8 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.864262+0000 front 2023-12-17T12:04:55.864133+0000 (oldest deadline 2023-12-17T12:05:19.364268+0000) 2023-12-17T12:05:28.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:28 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:28.296+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:28.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:28 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:28.296+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:28.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:28 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:28.296+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:28.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:28 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:28.296+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.998420+0000 front 2023-12-17T12:04:55.998548+0000 (oldest deadline 2023-12-17T12:05:20.098447+0000) 2023-12-17T12:05:28.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:28 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:28.422+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:28.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:28 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:28.422+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:28.916 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:28 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:28.422+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.748238+0000 front 2023-12-17T12:04:49.748253+0000 (oldest deadline 2023-12-17T12:05:11.448295+0000) 2023-12-17T12:05:28.916 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:28 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:28.422+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:53.049800+0000 front 2023-12-17T12:04:53.049785+0000 (oldest deadline 2023-12-17T12:05:18.949849+0000) 2023-12-17T12:05:28.916 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:28 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:28.422+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:03.650897+0000 front 2023-12-17T12:05:03.651015+0000 (oldest deadline 2023-12-17T12:05:28.350947+0000) 2023-12-17T12:05:28.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:28 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:28.538+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:05:28.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:28 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:28.538+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.198555+0000 front 2023-12-17T12:04:34.198648+0000 (oldest deadline 2023-12-17T12:04:58.898492+0000) 2023-12-17T12:05:28.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:28 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:28.538+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.899210+0000 front 2023-12-17T12:04:38.899300+0000 (oldest deadline 2023-12-17T12:05:03.599093+0000) 2023-12-17T12:05:28.995 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:28 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:28.538+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.500094+0000 front 2023-12-17T12:04:49.500272+0000 (oldest deadline 2023-12-17T12:05:15.400326+0000) 2023-12-17T12:05:28.996 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:28 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:28.538+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.401134+0000 front 2023-12-17T12:04:55.401481+0000 (oldest deadline 2023-12-17T12:05:20.101006+0000) 2023-12-17T12:05:29.475 INFO:journalctl@ceph.osd.8.smithi186.stdout:Dec 17 12:05:29 smithi186 bash[80454]: ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-8 2023-12-17T12:05:29.475 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:29 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:29.258+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:29.475 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:29 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:29.258+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:29.476 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:29 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:29.258+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:29.476 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:29 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:29.258+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.998420+0000 front 2023-12-17T12:04:55.998548+0000 (oldest deadline 2023-12-17T12:05:20.098447+0000) 2023-12-17T12:05:29.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:29 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:29.488+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:05:29.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:29 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:29.488+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.198555+0000 front 2023-12-17T12:04:34.198648+0000 (oldest deadline 2023-12-17T12:04:58.898492+0000) 2023-12-17T12:05:29.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:29 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:29.488+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.899210+0000 front 2023-12-17T12:04:38.899300+0000 (oldest deadline 2023-12-17T12:05:03.599093+0000) 2023-12-17T12:05:29.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:29 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:29.488+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.500094+0000 front 2023-12-17T12:04:49.500272+0000 (oldest deadline 2023-12-17T12:05:15.400326+0000) 2023-12-17T12:05:29.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:29 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:29.488+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.401134+0000 front 2023-12-17T12:04:55.401481+0000 (oldest deadline 2023-12-17T12:05:20.101006+0000) 2023-12-17T12:05:29.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:29 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:29.423+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:29.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:29 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:29.423+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:29.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:29 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:29.423+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.748238+0000 front 2023-12-17T12:04:49.748253+0000 (oldest deadline 2023-12-17T12:05:11.448295+0000) 2023-12-17T12:05:29.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:29 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:29.423+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:53.049800+0000 front 2023-12-17T12:04:53.049785+0000 (oldest deadline 2023-12-17T12:05:18.949849+0000) 2023-12-17T12:05:29.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:29 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:29.423+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:03.650897+0000 front 2023-12-17T12:05:03.651015+0000 (oldest deadline 2023-12-17T12:05:28.350947+0000) 2023-12-17T12:05:30.505 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:30 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:30.241+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:30.505 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:30 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:30.241+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:30.505 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:30 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:30.241+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:30.505 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:30 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:30.241+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.998420+0000 front 2023-12-17T12:04:55.998548+0000 (oldest deadline 2023-12-17T12:05:20.098447+0000) 2023-12-17T12:05:30.505 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:30 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:30.241+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:05.399960+0000 front 2023-12-17T12:05:05.399924+0000 (oldest deadline 2023-12-17T12:05:29.499774+0000) 2023-12-17T12:05:30.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:30 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:30.397+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:30.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:30 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:30.397+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:30.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:30 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:30.397+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.748238+0000 front 2023-12-17T12:04:49.748253+0000 (oldest deadline 2023-12-17T12:05:11.448295+0000) 2023-12-17T12:05:30.666 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:30 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:30.397+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:53.049800+0000 front 2023-12-17T12:04:53.049785+0000 (oldest deadline 2023-12-17T12:05:18.949849+0000) 2023-12-17T12:05:30.666 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:30 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:30.397+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:03.650897+0000 front 2023-12-17T12:05:03.651015+0000 (oldest deadline 2023-12-17T12:05:28.350947+0000) 2023-12-17T12:05:30.672 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.8.service' 2023-12-17T12:05:30.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:30 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:30.492+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:05:30.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:30 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:30.492+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.198555+0000 front 2023-12-17T12:04:34.198648+0000 (oldest deadline 2023-12-17T12:04:58.898492+0000) 2023-12-17T12:05:30.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:30 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:30.492+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.899210+0000 front 2023-12-17T12:04:38.899300+0000 (oldest deadline 2023-12-17T12:05:03.599093+0000) 2023-12-17T12:05:30.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:30 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:30.492+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.500094+0000 front 2023-12-17T12:04:49.500272+0000 (oldest deadline 2023-12-17T12:05:15.400326+0000) 2023-12-17T12:05:30.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:30 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:30.492+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.401134+0000 front 2023-12-17T12:04:55.401481+0000 (oldest deadline 2023-12-17T12:05:20.101006+0000) 2023-12-17T12:05:30.800 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-17T12:05:30.800 INFO:tasks.cephadm.osd.8:Stopped osd.8 2023-12-17T12:05:30.801 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2023-12-17T12:05:30.801 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.9 2023-12-17T12:05:31.176 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:30 smithi008 systemd[1]: Stopping Ceph osd.9 for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:05:31.468 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:31 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:31.173+0000 7f42925ee700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:05:31.468 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:31 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:31.173+0000 7f42925ee700 -1 osd.9 88 *** Got signal Terminated *** 2023-12-17T12:05:31.468 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:31 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:31.173+0000 7f42925ee700 -1 osd.9 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-17T12:05:31.468 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:31 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:31.466+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:05:31.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:31 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:31.373+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:31.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:31 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:31.373+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:31.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:31 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:31.373+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.748238+0000 front 2023-12-17T12:04:49.748253+0000 (oldest deadline 2023-12-17T12:05:11.448295+0000) 2023-12-17T12:05:31.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:31 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:31.373+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:53.049800+0000 front 2023-12-17T12:04:53.049785+0000 (oldest deadline 2023-12-17T12:05:18.949849+0000) 2023-12-17T12:05:31.666 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:31 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:31.373+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:03.650897+0000 front 2023-12-17T12:05:03.651015+0000 (oldest deadline 2023-12-17T12:05:28.350947+0000) 2023-12-17T12:05:31.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:31 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:31.256+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:31.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:31 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:31.256+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:31.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:31 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:31.256+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:31.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:31 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:31.256+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.998420+0000 front 2023-12-17T12:04:55.998548+0000 (oldest deadline 2023-12-17T12:05:20.098447+0000) 2023-12-17T12:05:31.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:31 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:31.256+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:05.399960+0000 front 2023-12-17T12:05:05.399924+0000 (oldest deadline 2023-12-17T12:05:29.499774+0000) 2023-12-17T12:05:31.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:31 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:31.466+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.198555+0000 front 2023-12-17T12:04:34.198648+0000 (oldest deadline 2023-12-17T12:04:58.898492+0000) 2023-12-17T12:05:31.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:31 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:31.466+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.899210+0000 front 2023-12-17T12:04:38.899300+0000 (oldest deadline 2023-12-17T12:05:03.599093+0000) 2023-12-17T12:05:31.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:31 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:31.466+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.500094+0000 front 2023-12-17T12:04:49.500272+0000 (oldest deadline 2023-12-17T12:05:15.400326+0000) 2023-12-17T12:05:31.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:31 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:31.466+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.401134+0000 front 2023-12-17T12:04:55.401481+0000 (oldest deadline 2023-12-17T12:05:20.101006+0000) 2023-12-17T12:05:31.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:31 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:31.466+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:05.302701+0000 front 2023-12-17T12:05:05.302520+0000 (oldest deadline 2023-12-17T12:05:30.602313+0000) 2023-12-17T12:05:32.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:32 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:32.370+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:32.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:32 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:32.370+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:32.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:32 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:32.370+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.748238+0000 front 2023-12-17T12:04:49.748253+0000 (oldest deadline 2023-12-17T12:05:11.448295+0000) 2023-12-17T12:05:32.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:32 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:32.370+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:53.049800+0000 front 2023-12-17T12:04:53.049785+0000 (oldest deadline 2023-12-17T12:05:18.949849+0000) 2023-12-17T12:05:32.666 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:32 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:32.370+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:03.650897+0000 front 2023-12-17T12:05:03.651015+0000 (oldest deadline 2023-12-17T12:05:28.350947+0000) 2023-12-17T12:05:32.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:32 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:32.271+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:32.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:32 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:32.271+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:32.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:32 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:32.271+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:32.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:32 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:32.271+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.998420+0000 front 2023-12-17T12:04:55.998548+0000 (oldest deadline 2023-12-17T12:05:20.098447+0000) 2023-12-17T12:05:32.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:32 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:32.271+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:05.399960+0000 front 2023-12-17T12:05:05.399924+0000 (oldest deadline 2023-12-17T12:05:29.499774+0000) 2023-12-17T12:05:32.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:32 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:32.457+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:05:32.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:32 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:32.457+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.198555+0000 front 2023-12-17T12:04:34.198648+0000 (oldest deadline 2023-12-17T12:04:58.898492+0000) 2023-12-17T12:05:32.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:32 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:32.457+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.899210+0000 front 2023-12-17T12:04:38.899300+0000 (oldest deadline 2023-12-17T12:05:03.599093+0000) 2023-12-17T12:05:32.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:32 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:32.457+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.500094+0000 front 2023-12-17T12:04:49.500272+0000 (oldest deadline 2023-12-17T12:05:15.400326+0000) 2023-12-17T12:05:32.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:32 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:32.457+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.401134+0000 front 2023-12-17T12:04:55.401481+0000 (oldest deadline 2023-12-17T12:05:20.101006+0000) 2023-12-17T12:05:32.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:32 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:32.457+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:05.302701+0000 front 2023-12-17T12:05:05.302520+0000 (oldest deadline 2023-12-17T12:05:30.602313+0000) 2023-12-17T12:05:33.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:33 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:33.377+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:33.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:33 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:33.377+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:33.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:33 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:33.377+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.748238+0000 front 2023-12-17T12:04:49.748253+0000 (oldest deadline 2023-12-17T12:05:11.448295+0000) 2023-12-17T12:05:33.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:33 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:33.377+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:53.049800+0000 front 2023-12-17T12:04:53.049785+0000 (oldest deadline 2023-12-17T12:05:18.949849+0000) 2023-12-17T12:05:33.666 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:33 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:33.377+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:03.650897+0000 front 2023-12-17T12:05:03.651015+0000 (oldest deadline 2023-12-17T12:05:28.350947+0000) 2023-12-17T12:05:33.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:33 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:33.296+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:33.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:33 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:33.296+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:33.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:33 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:33.296+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:33.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:33 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:33.296+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.998420+0000 front 2023-12-17T12:04:55.998548+0000 (oldest deadline 2023-12-17T12:05:20.098447+0000) 2023-12-17T12:05:33.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:33 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:33.296+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:05.399960+0000 front 2023-12-17T12:05:05.399924+0000 (oldest deadline 2023-12-17T12:05:29.499774+0000) 2023-12-17T12:05:33.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:33 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:33.429+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:05:33.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:33 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:33.429+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.198555+0000 front 2023-12-17T12:04:34.198648+0000 (oldest deadline 2023-12-17T12:04:58.898492+0000) 2023-12-17T12:05:33.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:33 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:33.429+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.899210+0000 front 2023-12-17T12:04:38.899300+0000 (oldest deadline 2023-12-17T12:05:03.599093+0000) 2023-12-17T12:05:33.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:33 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:33.429+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.500094+0000 front 2023-12-17T12:04:49.500272+0000 (oldest deadline 2023-12-17T12:05:15.400326+0000) 2023-12-17T12:05:33.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:33 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:33.429+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.401134+0000 front 2023-12-17T12:04:55.401481+0000 (oldest deadline 2023-12-17T12:05:20.101006+0000) 2023-12-17T12:05:33.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:33 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:33.429+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:05.302701+0000 front 2023-12-17T12:05:05.302520+0000 (oldest deadline 2023-12-17T12:05:30.602313+0000) 2023-12-17T12:05:34.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:34 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:34.362+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:34.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:34 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:34.362+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:34.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:34 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:34.362+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.748238+0000 front 2023-12-17T12:04:49.748253+0000 (oldest deadline 2023-12-17T12:05:11.448295+0000) 2023-12-17T12:05:34.666 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:34 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:34.362+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:53.049800+0000 front 2023-12-17T12:04:53.049785+0000 (oldest deadline 2023-12-17T12:05:18.949849+0000) 2023-12-17T12:05:34.666 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:34 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:34.362+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:03.650897+0000 front 2023-12-17T12:05:03.651015+0000 (oldest deadline 2023-12-17T12:05:28.350947+0000) 2023-12-17T12:05:34.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:34 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:34.343+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:34.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:34 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:34.343+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:34.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:34 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:34.343+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:34.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:34 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:34.343+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.998420+0000 front 2023-12-17T12:04:55.998548+0000 (oldest deadline 2023-12-17T12:05:20.098447+0000) 2023-12-17T12:05:34.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:34 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:34.343+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:05.399960+0000 front 2023-12-17T12:05:05.399924+0000 (oldest deadline 2023-12-17T12:05:29.499774+0000) 2023-12-17T12:05:34.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:34 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:34.415+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:05:34.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:34 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:34.415+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.198555+0000 front 2023-12-17T12:04:34.198648+0000 (oldest deadline 2023-12-17T12:04:58.898492+0000) 2023-12-17T12:05:34.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:34 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:34.415+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.899210+0000 front 2023-12-17T12:04:38.899300+0000 (oldest deadline 2023-12-17T12:05:03.599093+0000) 2023-12-17T12:05:34.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:34 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:34.415+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.500094+0000 front 2023-12-17T12:04:49.500272+0000 (oldest deadline 2023-12-17T12:05:15.400326+0000) 2023-12-17T12:05:34.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:34 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:34.415+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.401134+0000 front 2023-12-17T12:04:55.401481+0000 (oldest deadline 2023-12-17T12:05:20.101006+0000) 2023-12-17T12:05:34.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:34 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:34.415+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:05.302701+0000 front 2023-12-17T12:05:05.302520+0000 (oldest deadline 2023-12-17T12:05:30.602313+0000) 2023-12-17T12:05:34.746 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:34 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:34.415+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-12-17T12:05:10.602755+0000 front 2023-12-17T12:05:10.602793+0000 (oldest deadline 2023-12-17T12:05:34.102813+0000) 2023-12-17T12:05:35.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:35 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:35.375+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:35.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:35 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:35.375+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:35.666 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:35 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:35.375+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.748238+0000 front 2023-12-17T12:04:49.748253+0000 (oldest deadline 2023-12-17T12:05:11.448295+0000) 2023-12-17T12:05:35.666 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:35 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:35.375+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:53.049800+0000 front 2023-12-17T12:04:53.049785+0000 (oldest deadline 2023-12-17T12:05:18.949849+0000) 2023-12-17T12:05:35.666 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:35 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:35.375+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:03.650897+0000 front 2023-12-17T12:05:03.651015+0000 (oldest deadline 2023-12-17T12:05:28.350947+0000) 2023-12-17T12:05:35.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:35 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:35.390+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:35.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:35 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:35.390+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:35.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:35 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:35.390+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:35.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:35 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:35.390+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.998420+0000 front 2023-12-17T12:04:55.998548+0000 (oldest deadline 2023-12-17T12:05:20.098447+0000) 2023-12-17T12:05:35.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:35 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:35.390+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:05.399960+0000 front 2023-12-17T12:05:05.399924+0000 (oldest deadline 2023-12-17T12:05:29.499774+0000) 2023-12-17T12:05:35.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:35 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:35.373+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:24.896692+0000 front 2023-12-17T12:04:24.896747+0000 (oldest deadline 2023-12-17T12:04:48.396822+0000) 2023-12-17T12:05:35.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:35 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:35.373+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.198555+0000 front 2023-12-17T12:04:34.198648+0000 (oldest deadline 2023-12-17T12:04:58.898492+0000) 2023-12-17T12:05:35.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:35 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:35.373+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:38.899210+0000 front 2023-12-17T12:04:38.899300+0000 (oldest deadline 2023-12-17T12:05:03.599093+0000) 2023-12-17T12:05:35.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:35 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:35.373+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.500094+0000 front 2023-12-17T12:04:49.500272+0000 (oldest deadline 2023-12-17T12:05:15.400326+0000) 2023-12-17T12:05:35.745 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:35 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:35.373+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.401134+0000 front 2023-12-17T12:04:55.401481+0000 (oldest deadline 2023-12-17T12:05:20.101006+0000) 2023-12-17T12:05:35.746 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:35 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:35.373+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:05.302701+0000 front 2023-12-17T12:05:05.302520+0000 (oldest deadline 2023-12-17T12:05:30.602313+0000) 2023-12-17T12:05:35.746 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:35 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9[79770]: 2023-12-17T12:05:35.373+0000 7f428cbe5700 -1 osd.9 88 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-12-17T12:05:10.602755+0000 front 2023-12-17T12:05:10.602793+0000 (oldest deadline 2023-12-17T12:05:34.102813+0000) 2023-12-17T12:05:36.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:36 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:36.360+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:36.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:36 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:36.360+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:36.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:36 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:36.360+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:36.726 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:36 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:36.360+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.998420+0000 front 2023-12-17T12:04:55.998548+0000 (oldest deadline 2023-12-17T12:05:20.098447+0000) 2023-12-17T12:05:36.726 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:36 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:36.360+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:05.399960+0000 front 2023-12-17T12:05:05.399924+0000 (oldest deadline 2023-12-17T12:05:29.499774+0000) 2023-12-17T12:05:36.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:36 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:36.425+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:36.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:36 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:36.425+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:36.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:36 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:36.425+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.748238+0000 front 2023-12-17T12:04:49.748253+0000 (oldest deadline 2023-12-17T12:05:11.448295+0000) 2023-12-17T12:05:36.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:36 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:36.425+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:53.049800+0000 front 2023-12-17T12:04:53.049785+0000 (oldest deadline 2023-12-17T12:05:18.949849+0000) 2023-12-17T12:05:36.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:36 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:36.425+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:03.650897+0000 front 2023-12-17T12:05:03.651015+0000 (oldest deadline 2023-12-17T12:05:28.350947+0000) 2023-12-17T12:05:37.245 INFO:journalctl@ceph.osd.9.smithi008.stdout:Dec 17 12:05:36 smithi008 bash[101404]: ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-9 2023-12-17T12:05:37.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:37 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:37.340+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:37.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:37 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:37.340+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:37.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:37 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:37.340+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:37.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:37 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:37.340+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.998420+0000 front 2023-12-17T12:04:55.998548+0000 (oldest deadline 2023-12-17T12:05:20.098447+0000) 2023-12-17T12:05:37.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:37 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:37.340+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:05.399960+0000 front 2023-12-17T12:05:05.399924+0000 (oldest deadline 2023-12-17T12:05:29.499774+0000) 2023-12-17T12:05:37.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:37 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:37.440+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:37.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:37 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:37.440+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:37.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:37 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:37.440+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.748238+0000 front 2023-12-17T12:04:49.748253+0000 (oldest deadline 2023-12-17T12:05:11.448295+0000) 2023-12-17T12:05:37.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:37 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:37.440+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:53.049800+0000 front 2023-12-17T12:04:53.049785+0000 (oldest deadline 2023-12-17T12:05:18.949849+0000) 2023-12-17T12:05:37.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:37 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:37.440+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:03.650897+0000 front 2023-12-17T12:05:03.651015+0000 (oldest deadline 2023-12-17T12:05:28.350947+0000) 2023-12-17T12:05:38.433 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.9.service' 2023-12-17T12:05:38.521 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-17T12:05:38.522 INFO:tasks.cephadm.osd.9:Stopped osd.9 2023-12-17T12:05:38.522 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2023-12-17T12:05:38.522 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.10 2023-12-17T12:05:38.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:38 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:38.393+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:38.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:38 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:38.393+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:38.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:38 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:38.393+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.748238+0000 front 2023-12-17T12:04:49.748253+0000 (oldest deadline 2023-12-17T12:05:11.448295+0000) 2023-12-17T12:05:38.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:38 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:38.393+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:53.049800+0000 front 2023-12-17T12:04:53.049785+0000 (oldest deadline 2023-12-17T12:05:18.949849+0000) 2023-12-17T12:05:38.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:38 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:38.393+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:03.650897+0000 front 2023-12-17T12:05:03.651015+0000 (oldest deadline 2023-12-17T12:05:28.350947+0000) 2023-12-17T12:05:38.666 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:38 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:38.393+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-12-17T12:05:13.052601+0000 front 2023-12-17T12:05:13.052511+0000 (oldest deadline 2023-12-17T12:05:37.652854+0000) 2023-12-17T12:05:38.666 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:38 smithi100 systemd[1]: Stopping Ceph osd.10 for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:05:38.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:38 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:38.323+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:38.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:38 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:38.323+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:38.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:38 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:38.323+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:38.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:38 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:38.323+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.998420+0000 front 2023-12-17T12:04:55.998548+0000 (oldest deadline 2023-12-17T12:05:20.098447+0000) 2023-12-17T12:05:38.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:38 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:38.323+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:05.399960+0000 front 2023-12-17T12:05:05.399924+0000 (oldest deadline 2023-12-17T12:05:29.499774+0000) 2023-12-17T12:05:39.165 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:38 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:38.897+0000 7f8606022700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:05:39.165 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:38 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:38.897+0000 7f8606022700 -1 osd.10 88 *** Got signal Terminated *** 2023-12-17T12:05:39.165 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:38 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:38.897+0000 7f8606022700 -1 osd.10 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-17T12:05:39.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:39 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:39.413+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:39.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:39 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:39.413+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:39.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:39 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:39.413+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.748238+0000 front 2023-12-17T12:04:49.748253+0000 (oldest deadline 2023-12-17T12:05:11.448295+0000) 2023-12-17T12:05:39.666 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:39 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:39.413+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:53.049800+0000 front 2023-12-17T12:04:53.049785+0000 (oldest deadline 2023-12-17T12:05:18.949849+0000) 2023-12-17T12:05:39.666 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:39 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:39.413+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:03.650897+0000 front 2023-12-17T12:05:03.651015+0000 (oldest deadline 2023-12-17T12:05:28.350947+0000) 2023-12-17T12:05:39.666 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:39 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:39.413+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-12-17T12:05:13.052601+0000 front 2023-12-17T12:05:13.052511+0000 (oldest deadline 2023-12-17T12:05:37.652854+0000) 2023-12-17T12:05:39.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:39 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:39.308+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:39.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:39 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:39.308+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:39.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:39 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:39.308+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:39.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:39 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:39.308+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.998420+0000 front 2023-12-17T12:04:55.998548+0000 (oldest deadline 2023-12-17T12:05:20.098447+0000) 2023-12-17T12:05:39.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:39 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:39.308+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:05.399960+0000 front 2023-12-17T12:05:05.399924+0000 (oldest deadline 2023-12-17T12:05:29.499774+0000) 2023-12-17T12:05:40.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:40 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:40.364+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:40.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:40 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:40.364+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:40.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:40 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:40.364+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.748238+0000 front 2023-12-17T12:04:49.748253+0000 (oldest deadline 2023-12-17T12:05:11.448295+0000) 2023-12-17T12:05:40.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:40 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:40.364+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:53.049800+0000 front 2023-12-17T12:04:53.049785+0000 (oldest deadline 2023-12-17T12:05:18.949849+0000) 2023-12-17T12:05:40.666 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:40 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:40.364+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:03.650897+0000 front 2023-12-17T12:05:03.651015+0000 (oldest deadline 2023-12-17T12:05:28.350947+0000) 2023-12-17T12:05:40.666 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:40 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:40.364+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-12-17T12:05:13.052601+0000 front 2023-12-17T12:05:13.052511+0000 (oldest deadline 2023-12-17T12:05:37.652854+0000) 2023-12-17T12:05:40.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:40 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:40.269+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:40.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:40 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:40.269+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:40.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:40 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:40.269+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:40.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:40 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:40.269+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.998420+0000 front 2023-12-17T12:04:55.998548+0000 (oldest deadline 2023-12-17T12:05:20.098447+0000) 2023-12-17T12:05:40.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:40 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:40.269+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:05.399960+0000 front 2023-12-17T12:05:05.399924+0000 (oldest deadline 2023-12-17T12:05:29.499774+0000) 2023-12-17T12:05:40.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:40 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:40.269+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-12-17T12:05:09.500693+0000 front 2023-12-17T12:05:09.500527+0000 (oldest deadline 2023-12-17T12:05:39.501014+0000) 2023-12-17T12:05:41.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:41 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:41.410+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:41.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:41 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:41.410+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:41.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:41 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:41.410+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.748238+0000 front 2023-12-17T12:04:49.748253+0000 (oldest deadline 2023-12-17T12:05:11.448295+0000) 2023-12-17T12:05:41.665 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:41 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:41.410+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:53.049800+0000 front 2023-12-17T12:04:53.049785+0000 (oldest deadline 2023-12-17T12:05:18.949849+0000) 2023-12-17T12:05:41.666 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:41 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:41.410+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:03.650897+0000 front 2023-12-17T12:05:03.651015+0000 (oldest deadline 2023-12-17T12:05:28.350947+0000) 2023-12-17T12:05:41.666 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:41 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:41.410+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-12-17T12:05:13.052601+0000 front 2023-12-17T12:05:13.052511+0000 (oldest deadline 2023-12-17T12:05:37.652854+0000) 2023-12-17T12:05:41.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:41 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:41.318+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:41.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:41 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:41.318+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:41.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:41 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:41.318+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:41.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:41 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:41.318+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.998420+0000 front 2023-12-17T12:04:55.998548+0000 (oldest deadline 2023-12-17T12:05:20.098447+0000) 2023-12-17T12:05:41.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:41 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:41.318+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:05.399960+0000 front 2023-12-17T12:05:05.399924+0000 (oldest deadline 2023-12-17T12:05:29.499774+0000) 2023-12-17T12:05:41.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:41 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:41.318+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-12-17T12:05:09.500693+0000 front 2023-12-17T12:05:09.500527+0000 (oldest deadline 2023-12-17T12:05:39.501014+0000) 2023-12-17T12:05:42.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:42 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:42.342+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:42.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:42 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:42.342+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:42.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:42 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:42.342+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:42.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:42 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:42.342+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.998420+0000 front 2023-12-17T12:04:55.998548+0000 (oldest deadline 2023-12-17T12:05:20.098447+0000) 2023-12-17T12:05:42.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:42 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:42.342+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:05.399960+0000 front 2023-12-17T12:05:05.399924+0000 (oldest deadline 2023-12-17T12:05:29.499774+0000) 2023-12-17T12:05:42.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:42 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:42.342+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-12-17T12:05:09.500693+0000 front 2023-12-17T12:05:09.500527+0000 (oldest deadline 2023-12-17T12:05:39.501014+0000) 2023-12-17T12:05:42.726 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:42 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:42.342+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2023-12-17T12:05:19.501714+0000 front 2023-12-17T12:05:19.501794+0000 (oldest deadline 2023-12-17T12:05:42.302212+0000) 2023-12-17T12:05:42.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:42 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:42.435+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:42.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:42 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:42.435+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:42.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:42 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:42.435+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.748238+0000 front 2023-12-17T12:04:49.748253+0000 (oldest deadline 2023-12-17T12:05:11.448295+0000) 2023-12-17T12:05:42.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:42 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:42.435+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:53.049800+0000 front 2023-12-17T12:04:53.049785+0000 (oldest deadline 2023-12-17T12:05:18.949849+0000) 2023-12-17T12:05:42.916 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:42 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:42.435+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:03.650897+0000 front 2023-12-17T12:05:03.651015+0000 (oldest deadline 2023-12-17T12:05:28.350947+0000) 2023-12-17T12:05:42.916 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:42 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:42.435+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-12-17T12:05:13.052601+0000 front 2023-12-17T12:05:13.052511+0000 (oldest deadline 2023-12-17T12:05:37.652854+0000) 2023-12-17T12:05:42.916 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:42 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:42.435+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2023-12-17T12:05:17.653361+0000 front 2023-12-17T12:05:17.653335+0000 (oldest deadline 2023-12-17T12:05:42.353234+0000) 2023-12-17T12:05:43.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:43 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:43.344+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:43.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:43 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:43.344+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:43.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:43 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:43.344+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:43.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:43 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:43.344+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.998420+0000 front 2023-12-17T12:04:55.998548+0000 (oldest deadline 2023-12-17T12:05:20.098447+0000) 2023-12-17T12:05:43.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:43 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:43.344+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:05.399960+0000 front 2023-12-17T12:05:05.399924+0000 (oldest deadline 2023-12-17T12:05:29.499774+0000) 2023-12-17T12:05:43.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:43 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:43.344+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-12-17T12:05:09.500693+0000 front 2023-12-17T12:05:09.500527+0000 (oldest deadline 2023-12-17T12:05:39.501014+0000) 2023-12-17T12:05:43.726 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:43 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:43.344+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2023-12-17T12:05:19.501714+0000 front 2023-12-17T12:05:19.501794+0000 (oldest deadline 2023-12-17T12:05:42.302212+0000) 2023-12-17T12:05:43.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:43 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:43.426+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:34.045068+0000 front 2023-12-17T12:04:34.045044+0000 (oldest deadline 2023-12-17T12:04:58.145050+0000) 2023-12-17T12:05:43.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:43 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:43.426+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.246266+0000 front 2023-12-17T12:04:39.246279+0000 (oldest deadline 2023-12-17T12:05:03.946065+0000) 2023-12-17T12:05:43.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:43 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:43.426+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.8:6814 osd.3 since back 2023-12-17T12:04:49.748238+0000 front 2023-12-17T12:04:49.748253+0000 (oldest deadline 2023-12-17T12:05:11.448295+0000) 2023-12-17T12:05:43.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:43 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:43.426+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:53.049800+0000 front 2023-12-17T12:04:53.049785+0000 (oldest deadline 2023-12-17T12:05:18.949849+0000) 2023-12-17T12:05:43.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:43 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:43.426+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:03.650897+0000 front 2023-12-17T12:05:03.651015+0000 (oldest deadline 2023-12-17T12:05:28.350947+0000) 2023-12-17T12:05:43.916 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:43 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:43.426+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-12-17T12:05:13.052601+0000 front 2023-12-17T12:05:13.052511+0000 (oldest deadline 2023-12-17T12:05:37.652854+0000) 2023-12-17T12:05:43.916 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:43 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10[70245]: 2023-12-17T12:05:43.426+0000 7f8600619700 -1 osd.10 88 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2023-12-17T12:05:17.653361+0000 front 2023-12-17T12:05:17.653335+0000 (oldest deadline 2023-12-17T12:05:42.353234+0000) 2023-12-17T12:05:44.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:44 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:44.352+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:44.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:44 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:44.352+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:44.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:44 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:44.352+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:44.726 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:44 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:44.352+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.998420+0000 front 2023-12-17T12:04:55.998548+0000 (oldest deadline 2023-12-17T12:05:20.098447+0000) 2023-12-17T12:05:44.726 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:44 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:44.352+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:05.399960+0000 front 2023-12-17T12:05:05.399924+0000 (oldest deadline 2023-12-17T12:05:29.499774+0000) 2023-12-17T12:05:44.726 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:44 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:44.352+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-12-17T12:05:09.500693+0000 front 2023-12-17T12:05:09.500527+0000 (oldest deadline 2023-12-17T12:05:39.501014+0000) 2023-12-17T12:05:44.726 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:44 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:44.352+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2023-12-17T12:05:19.501714+0000 front 2023-12-17T12:05:19.501794+0000 (oldest deadline 2023-12-17T12:05:42.302212+0000) 2023-12-17T12:05:44.915 INFO:journalctl@ceph.osd.10.smithi100.stdout:Dec 17 12:05:44 smithi100 bash[79448]: ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-10 2023-12-17T12:05:45.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:45 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:45.367+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:45.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:45 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:45.367+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:45.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:45 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:45.367+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:45.726 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:45 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:45.367+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.998420+0000 front 2023-12-17T12:04:55.998548+0000 (oldest deadline 2023-12-17T12:05:20.098447+0000) 2023-12-17T12:05:45.726 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:45 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:45.367+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:05.399960+0000 front 2023-12-17T12:05:05.399924+0000 (oldest deadline 2023-12-17T12:05:29.499774+0000) 2023-12-17T12:05:45.726 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:45 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:45.367+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-12-17T12:05:09.500693+0000 front 2023-12-17T12:05:09.500527+0000 (oldest deadline 2023-12-17T12:05:39.501014+0000) 2023-12-17T12:05:45.726 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:45 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:45.367+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2023-12-17T12:05:19.501714+0000 front 2023-12-17T12:05:19.501794+0000 (oldest deadline 2023-12-17T12:05:42.302212+0000) 2023-12-17T12:05:45.972 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.10.service' 2023-12-17T12:05:46.060 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-17T12:05:46.060 INFO:tasks.cephadm.osd.10:Stopped osd.10 2023-12-17T12:05:46.060 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2023-12-17T12:05:46.060 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.11 2023-12-17T12:05:46.447 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:46 smithi186 systemd[1]: Stopping Ceph osd.11 for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:05:46.447 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:46 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:46.339+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:46.448 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:46 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:46.339+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:46.448 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:46 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:46.339+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:46.448 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:46 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:46.339+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.998420+0000 front 2023-12-17T12:04:55.998548+0000 (oldest deadline 2023-12-17T12:05:20.098447+0000) 2023-12-17T12:05:46.448 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:46 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:46.339+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:05.399960+0000 front 2023-12-17T12:05:05.399924+0000 (oldest deadline 2023-12-17T12:05:29.499774+0000) 2023-12-17T12:05:46.448 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:46 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:46.339+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-12-17T12:05:09.500693+0000 front 2023-12-17T12:05:09.500527+0000 (oldest deadline 2023-12-17T12:05:39.501014+0000) 2023-12-17T12:05:46.448 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:46 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:46.339+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2023-12-17T12:05:19.501714+0000 front 2023-12-17T12:05:19.501794+0000 (oldest deadline 2023-12-17T12:05:42.302212+0000) 2023-12-17T12:05:46.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:46 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:46.445+0000 7fc961b3d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:05:46.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:46 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:46.445+0000 7fc961b3d700 -1 osd.11 88 *** Got signal Terminated *** 2023-12-17T12:05:46.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:46 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:46.445+0000 7fc961b3d700 -1 osd.11 88 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-17T12:05:47.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:47 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:47.312+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:47.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:47 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:47.312+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:47.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:47 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:47.312+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:47.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:47 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:47.312+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.998420+0000 front 2023-12-17T12:04:55.998548+0000 (oldest deadline 2023-12-17T12:05:20.098447+0000) 2023-12-17T12:05:47.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:47 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:47.312+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:05.399960+0000 front 2023-12-17T12:05:05.399924+0000 (oldest deadline 2023-12-17T12:05:29.499774+0000) 2023-12-17T12:05:47.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:47 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:47.312+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-12-17T12:05:09.500693+0000 front 2023-12-17T12:05:09.500527+0000 (oldest deadline 2023-12-17T12:05:39.501014+0000) 2023-12-17T12:05:47.726 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:47 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:47.312+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2023-12-17T12:05:19.501714+0000 front 2023-12-17T12:05:19.501794+0000 (oldest deadline 2023-12-17T12:05:42.302212+0000) 2023-12-17T12:05:48.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:48 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:48.287+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:48.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:48 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:48.287+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:48.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:48 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:48.287+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:48.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:48 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:48.287+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.998420+0000 front 2023-12-17T12:04:55.998548+0000 (oldest deadline 2023-12-17T12:05:20.098447+0000) 2023-12-17T12:05:48.726 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:48 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:48.287+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:05.399960+0000 front 2023-12-17T12:05:05.399924+0000 (oldest deadline 2023-12-17T12:05:29.499774+0000) 2023-12-17T12:05:48.726 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:48 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:48.287+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-12-17T12:05:09.500693+0000 front 2023-12-17T12:05:09.500527+0000 (oldest deadline 2023-12-17T12:05:39.501014+0000) 2023-12-17T12:05:48.726 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:48 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:48.287+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2023-12-17T12:05:19.501714+0000 front 2023-12-17T12:05:19.501794+0000 (oldest deadline 2023-12-17T12:05:42.302212+0000) 2023-12-17T12:05:49.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:49 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:49.241+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:49.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:49 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:49.241+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:49.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:49 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:49.241+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:49.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:49 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:49.241+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.998420+0000 front 2023-12-17T12:04:55.998548+0000 (oldest deadline 2023-12-17T12:05:20.098447+0000) 2023-12-17T12:05:49.725 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:49 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:49.241+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:05.399960+0000 front 2023-12-17T12:05:05.399924+0000 (oldest deadline 2023-12-17T12:05:29.499774+0000) 2023-12-17T12:05:49.726 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:49 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:49.241+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-12-17T12:05:09.500693+0000 front 2023-12-17T12:05:09.500527+0000 (oldest deadline 2023-12-17T12:05:39.501014+0000) 2023-12-17T12:05:49.726 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:49 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:49.241+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2023-12-17T12:05:19.501714+0000 front 2023-12-17T12:05:19.501794+0000 (oldest deadline 2023-12-17T12:05:42.302212+0000) 2023-12-17T12:05:50.475 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:50 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:50.201+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:50.475 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:50 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:50.201+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:50.475 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:50 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:50.201+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:50.475 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:50 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:50.201+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.998420+0000 front 2023-12-17T12:04:55.998548+0000 (oldest deadline 2023-12-17T12:05:20.098447+0000) 2023-12-17T12:05:50.475 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:50 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:50.201+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:05.399960+0000 front 2023-12-17T12:05:05.399924+0000 (oldest deadline 2023-12-17T12:05:29.499774+0000) 2023-12-17T12:05:50.475 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:50 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:50.201+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-12-17T12:05:09.500693+0000 front 2023-12-17T12:05:09.500527+0000 (oldest deadline 2023-12-17T12:05:39.501014+0000) 2023-12-17T12:05:50.475 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:50 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:50.201+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2023-12-17T12:05:19.501714+0000 front 2023-12-17T12:05:19.501794+0000 (oldest deadline 2023-12-17T12:05:42.302212+0000) 2023-12-17T12:05:51.475 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:51 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:51.205+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6806 osd.0 since back 2023-12-17T12:04:21.491974+0000 front 2023-12-17T12:04:21.492104+0000 (oldest deadline 2023-12-17T12:04:48.492779+0000) 2023-12-17T12:05:51.475 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:51 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:51.205+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6804 osd.1 since back 2023-12-17T12:04:30.794034+0000 front 2023-12-17T12:04:30.794351+0000 (oldest deadline 2023-12-17T12:04:56.094071+0000) 2023-12-17T12:05:51.475 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:51 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:51.205+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6804 osd.2 since back 2023-12-17T12:04:39.595496+0000 front 2023-12-17T12:04:39.595563+0000 (oldest deadline 2023-12-17T12:05:05.495708+0000) 2023-12-17T12:05:51.475 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:51 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:51.205+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6812 osd.4 since back 2023-12-17T12:04:55.998420+0000 front 2023-12-17T12:04:55.998548+0000 (oldest deadline 2023-12-17T12:05:20.098447+0000) 2023-12-17T12:05:51.476 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:51 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:51.205+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.186:6812 osd.5 since back 2023-12-17T12:05:05.399960+0000 front 2023-12-17T12:05:05.399924+0000 (oldest deadline 2023-12-17T12:05:29.499774+0000) 2023-12-17T12:05:51.476 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:51 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:51.205+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.8:6822 osd.6 since back 2023-12-17T12:05:09.500693+0000 front 2023-12-17T12:05:09.500527+0000 (oldest deadline 2023-12-17T12:05:39.501014+0000) 2023-12-17T12:05:51.476 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:51 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11[71223]: 2023-12-17T12:05:51.205+0000 7fc95a130700 -1 osd.11 88 heartbeat_check: no reply from 172.21.15.100:6820 osd.7 since back 2023-12-17T12:05:19.501714+0000 front 2023-12-17T12:05:19.501794+0000 (oldest deadline 2023-12-17T12:05:42.302212+0000) 2023-12-17T12:05:52.475 INFO:journalctl@ceph.osd.11.smithi186.stdout:Dec 17 12:05:52 smithi186 bash[80711]: ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-osd-11 2023-12-17T12:05:53.901 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@osd.11.service' 2023-12-17T12:05:53.990 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-17T12:05:53.990 INFO:tasks.cephadm.osd.11:Stopped osd.11 2023-12-17T12:05:53.990 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2023-12-17T12:05:53.990 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mds.a 2023-12-17T12:05:54.373 INFO:journalctl@ceph.mds.a.smithi008.stdout:Dec 17 12:05:54 smithi008 systemd[1]: Stopping Ceph mds.a for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:05:54.745 INFO:journalctl@ceph.mds.a.smithi008.stdout:Dec 17 12:05:54 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-a[88210]: 2023-12-17T12:05:54.371+0000 7f7334011700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:05:54.745 INFO:journalctl@ceph.mds.a.smithi008.stdout:Dec 17 12:05:54 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-a[88210]: 2023-12-17T12:05:54.371+0000 7f7334011700 -1 mds.a *** got signal Terminated *** 2023-12-17T12:05:58.745 INFO:journalctl@ceph.mds.a.smithi008.stdout:Dec 17 12:05:58 smithi008 bash[101670]: ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-a 2023-12-17T12:05:58.849 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mds.a.service' 2023-12-17T12:05:58.938 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-17T12:05:58.938 INFO:tasks.cephadm.mds.a:Stopped mds.a 2023-12-17T12:05:58.938 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2023-12-17T12:05:58.939 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mds.d 2023-12-17T12:05:59.245 INFO:journalctl@ceph.mds.d.smithi008.stdout:Dec 17 12:05:59 smithi008 systemd[1]: Stopping Ceph mds.d for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:05:59.745 INFO:journalctl@ceph.mds.d.smithi008.stdout:Dec 17 12:05:59 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-d[87212]: 2023-12-17T12:05:59.345+0000 7f6f56adb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:05:59.745 INFO:journalctl@ceph.mds.d.smithi008.stdout:Dec 17 12:05:59 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-d[87212]: 2023-12-17T12:05:59.345+0000 7f6f56adb700 -1 mds.d *** got signal Terminated *** 2023-12-17T12:06:03.989 INFO:journalctl@ceph.mds.d.smithi008.stdout:Dec 17 12:06:03 smithi008 bash[101808]: ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-d 2023-12-17T12:06:04.013 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mds.d.service' 2023-12-17T12:06:04.096 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-17T12:06:04.096 INFO:tasks.cephadm.mds.d:Stopped mds.d 2023-12-17T12:06:04.096 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2023-12-17T12:06:04.097 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mds.g 2023-12-17T12:06:04.463 INFO:journalctl@ceph.mds.g.smithi008.stdout:Dec 17 12:06:04 smithi008 systemd[1]: Stopping Ceph mds.g for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:06:04.744 INFO:journalctl@ceph.mds.g.smithi008.stdout:Dec 17 12:06:04 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-g[87827]: 2023-12-17T12:06:04.461+0000 7f49ca12a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:06:04.745 INFO:journalctl@ceph.mds.g.smithi008.stdout:Dec 17 12:06:04 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-g[87827]: 2023-12-17T12:06:04.461+0000 7f49ca12a700 -1 mds.g *** got signal Terminated *** 2023-12-17T12:06:06.745 INFO:journalctl@ceph.mds.g.smithi008.stdout:Dec 17 12:06:06 smithi008 bash[101947]: ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-g 2023-12-17T12:06:06.819 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mds.g.service' 2023-12-17T12:06:06.902 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-17T12:06:06.902 INFO:tasks.cephadm.mds.g:Stopped mds.g 2023-12-17T12:06:06.903 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2023-12-17T12:06:06.903 DEBUG:teuthology.orchestra.run.smithi008:> sudo systemctl stop ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mds.j 2023-12-17T12:06:07.245 INFO:journalctl@ceph.mds.j.smithi008.stdout:Dec 17 12:06:06 smithi008 systemd[1]: Stopping Ceph mds.j for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:06:07.745 INFO:journalctl@ceph.mds.j.smithi008.stdout:Dec 17 12:06:07 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-j[86829]: 2023-12-17T12:06:07.269+0000 7fd1e82ff700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:06:07.745 INFO:journalctl@ceph.mds.j.smithi008.stdout:Dec 17 12:06:07 smithi008 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-j[86829]: 2023-12-17T12:06:07.269+0000 7fd1e82ff700 -1 mds.j *** got signal Terminated *** 2023-12-17T12:06:09.244 INFO:journalctl@ceph.mds.j.smithi008.stdout:Dec 17 12:06:08 smithi008 bash[102087]: ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-j 2023-12-17T12:06:09.297 DEBUG:teuthology.orchestra.run.smithi008:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mds.j.service' 2023-12-17T12:06:09.378 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-17T12:06:09.379 INFO:tasks.cephadm.mds.j:Stopped mds.j 2023-12-17T12:06:09.379 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2023-12-17T12:06:09.379 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mds.b 2023-12-17T12:06:09.752 INFO:journalctl@ceph.mds.b.smithi100.stdout:Dec 17 12:06:09 smithi100 systemd[1]: Stopping Ceph mds.b for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:06:10.165 INFO:journalctl@ceph.mds.b.smithi100.stdout:Dec 17 12:06:09 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-b[76415]: 2023-12-17T12:06:09.750+0000 7f2253ec3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:06:10.165 INFO:journalctl@ceph.mds.b.smithi100.stdout:Dec 17 12:06:09 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-b[76415]: 2023-12-17T12:06:09.750+0000 7f2253ec3700 -1 mds.b *** got signal Terminated *** 2023-12-17T12:06:14.165 INFO:journalctl@ceph.mds.b.smithi100.stdout:Dec 17 12:06:13 smithi100 bash[79715]: ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-b 2023-12-17T12:06:14.364 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mds.b.service' 2023-12-17T12:06:14.448 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-17T12:06:14.449 INFO:tasks.cephadm.mds.b:Stopped mds.b 2023-12-17T12:06:14.449 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2023-12-17T12:06:14.449 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mds.e 2023-12-17T12:06:14.665 INFO:journalctl@ceph.mds.e.smithi100.stdout:Dec 17 12:06:14 smithi100 systemd[1]: Stopping Ceph mds.e for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:06:15.165 INFO:journalctl@ceph.mds.e.smithi100.stdout:Dec 17 12:06:14 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-e[75734]: 2023-12-17T12:06:14.806+0000 7f5867ccc700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:06:15.165 INFO:journalctl@ceph.mds.e.smithi100.stdout:Dec 17 12:06:14 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-e[75734]: 2023-12-17T12:06:14.806+0000 7f5867ccc700 -1 mds.e *** got signal Terminated *** 2023-12-17T12:06:18.665 INFO:journalctl@ceph.mds.e.smithi100.stdout:Dec 17 12:06:18 smithi100 bash[79853]: ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-e 2023-12-17T12:06:18.785 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mds.e.service' 2023-12-17T12:06:18.865 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-17T12:06:18.866 INFO:tasks.cephadm.mds.e:Stopped mds.e 2023-12-17T12:06:18.866 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2023-12-17T12:06:18.866 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mds.h 2023-12-17T12:06:19.165 INFO:journalctl@ceph.mds.h.smithi100.stdout:Dec 17 12:06:18 smithi100 systemd[1]: Stopping Ceph mds.h for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:06:19.665 INFO:journalctl@ceph.mds.h.smithi100.stdout:Dec 17 12:06:19 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-h[76074]: 2023-12-17T12:06:19.215+0000 7f84d9a14700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:06:19.665 INFO:journalctl@ceph.mds.h.smithi100.stdout:Dec 17 12:06:19 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-h[76074]: 2023-12-17T12:06:19.215+0000 7f84d9a14700 -1 mds.h *** got signal Terminated *** 2023-12-17T12:06:22.665 INFO:journalctl@ceph.mds.h.smithi100.stdout:Dec 17 12:06:22 smithi100 bash[79991]: ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-h 2023-12-17T12:06:22.761 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mds.h.service' 2023-12-17T12:06:22.841 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-17T12:06:22.841 INFO:tasks.cephadm.mds.h:Stopped mds.h 2023-12-17T12:06:22.841 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2023-12-17T12:06:22.842 DEBUG:teuthology.orchestra.run.smithi100:> sudo systemctl stop ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mds.k 2023-12-17T12:06:23.165 INFO:journalctl@ceph.mds.k.smithi100.stdout:Dec 17 12:06:22 smithi100 systemd[1]: Stopping Ceph mds.k for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:06:23.665 INFO:journalctl@ceph.mds.k.smithi100.stdout:Dec 17 12:06:23 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-k[75393]: 2023-12-17T12:06:23.197+0000 7f66e24e9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:06:23.665 INFO:journalctl@ceph.mds.k.smithi100.stdout:Dec 17 12:06:23 smithi100 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-k[75393]: 2023-12-17T12:06:23.197+0000 7f66e24e9700 -1 mds.k *** got signal Terminated *** 2023-12-17T12:06:26.665 INFO:journalctl@ceph.mds.k.smithi100.stdout:Dec 17 12:06:26 smithi100 bash[80133]: ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-k 2023-12-17T12:06:26.782 DEBUG:teuthology.orchestra.run.smithi100:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mds.k.service' 2023-12-17T12:06:26.862 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-17T12:06:26.862 INFO:tasks.cephadm.mds.k:Stopped mds.k 2023-12-17T12:06:26.862 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2023-12-17T12:06:26.863 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mds.c 2023-12-17T12:06:27.225 INFO:journalctl@ceph.mds.c.smithi186.stdout:Dec 17 12:06:26 smithi186 systemd[1]: Stopping Ceph mds.c for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:06:27.725 INFO:journalctl@ceph.mds.c.smithi186.stdout:Dec 17 12:06:27 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-c[77338]: 2023-12-17T12:06:27.266+0000 7f2f32b16700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:06:27.725 INFO:journalctl@ceph.mds.c.smithi186.stdout:Dec 17 12:06:27 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-c[77338]: 2023-12-17T12:06:27.266+0000 7f2f32b16700 -1 mds.c *** got signal Terminated *** 2023-12-17T12:06:30.724 INFO:journalctl@ceph.mds.c.smithi186.stdout:Dec 17 12:06:30 smithi186 bash[80975]: ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-c 2023-12-17T12:06:30.870 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mds.c.service' 2023-12-17T12:06:30.954 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-17T12:06:30.954 INFO:tasks.cephadm.mds.c:Stopped mds.c 2023-12-17T12:06:30.955 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2023-12-17T12:06:30.955 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mds.f 2023-12-17T12:06:31.224 INFO:journalctl@ceph.mds.f.smithi186.stdout:Dec 17 12:06:31 smithi186 systemd[1]: Stopping Ceph mds.f for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:06:31.725 INFO:journalctl@ceph.mds.f.smithi186.stdout:Dec 17 12:06:31 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-f[76998]: 2023-12-17T12:06:31.315+0000 7fa02a0a7700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:06:31.725 INFO:journalctl@ceph.mds.f.smithi186.stdout:Dec 17 12:06:31 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-f[76998]: 2023-12-17T12:06:31.315+0000 7fa02a0a7700 -1 mds.f *** got signal Terminated *** 2023-12-17T12:06:34.724 INFO:journalctl@ceph.mds.f.smithi186.stdout:Dec 17 12:06:34 smithi186 bash[81112]: ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-f 2023-12-17T12:06:34.760 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mds.f.service' 2023-12-17T12:06:34.844 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-17T12:06:34.844 INFO:tasks.cephadm.mds.f:Stopped mds.f 2023-12-17T12:06:34.845 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2023-12-17T12:06:34.845 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mds.i 2023-12-17T12:06:35.215 INFO:journalctl@ceph.mds.i.smithi186.stdout:Dec 17 12:06:34 smithi186 systemd[1]: Stopping Ceph mds.i for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:06:35.475 INFO:journalctl@ceph.mds.i.smithi186.stdout:Dec 17 12:06:35 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-i[77678]: 2023-12-17T12:06:35.213+0000 7f3a044b1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:06:35.475 INFO:journalctl@ceph.mds.i.smithi186.stdout:Dec 17 12:06:35 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-i[77678]: 2023-12-17T12:06:35.213+0000 7f3a044b1700 -1 mds.i *** got signal Terminated *** 2023-12-17T12:06:38.725 INFO:journalctl@ceph.mds.i.smithi186.stdout:Dec 17 12:06:38 smithi186 bash[81250]: ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-i 2023-12-17T12:06:38.759 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mds.i.service' 2023-12-17T12:06:38.840 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-17T12:06:38.840 INFO:tasks.cephadm.mds.i:Stopped mds.i 2023-12-17T12:06:38.841 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2023-12-17T12:06:38.841 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mds.l 2023-12-17T12:06:39.214 INFO:journalctl@ceph.mds.l.smithi186.stdout:Dec 17 12:06:38 smithi186 systemd[1]: Stopping Ceph mds.l for f43f508a-9cd2-11ee-95a5-87774f69a715... 2023-12-17T12:06:39.474 INFO:journalctl@ceph.mds.l.smithi186.stdout:Dec 17 12:06:39 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-l[76659]: 2023-12-17T12:06:39.213+0000 7f9eaaa55700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-12-17T12:06:39.474 INFO:journalctl@ceph.mds.l.smithi186.stdout:Dec 17 12:06:39 smithi186 ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-l[76659]: 2023-12-17T12:06:39.213+0000 7f9eaaa55700 -1 mds.l *** got signal Terminated *** 2023-12-17T12:06:42.725 INFO:journalctl@ceph.mds.l.smithi186.stdout:Dec 17 12:06:42 smithi186 bash[81389]: ceph-f43f508a-9cd2-11ee-95a5-87774f69a715-mds-l 2023-12-17T12:06:42.843 DEBUG:teuthology.orchestra.run.smithi186:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f43f508a-9cd2-11ee-95a5-87774f69a715@mds.l.service' 2023-12-17T12:06:42.924 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-12-17T12:06:42.924 INFO:tasks.cephadm.mds.l:Stopped mds.l 2023-12-17T12:06:42.924 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 --force --keep-logs 2023-12-17T12:06:43.245 INFO:teuthology.orchestra.run.smithi008.stdout:Deleting cluster with fsid: f43f508a-9cd2-11ee-95a5-87774f69a715 2023-12-17T12:06:46.373 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 --force --keep-logs 2023-12-17T12:06:46.678 INFO:teuthology.orchestra.run.smithi100.stdout:Deleting cluster with fsid: f43f508a-9cd2-11ee-95a5-87774f69a715 2023-12-17T12:06:49.652 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 --force --keep-logs 2023-12-17T12:06:49.959 INFO:teuthology.orchestra.run.smithi186.stdout:Deleting cluster with fsid: f43f508a-9cd2-11ee-95a5-87774f69a715 2023-12-17T12:06:52.973 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-17T12:06:53.055 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-17T12:06:53.132 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-12-17T12:06:53.204 INFO:tasks.cephadm:Archiving crash dumps... 2023-12-17T12:06:53.209 DEBUG:teuthology.misc:Transferring archived files from smithi008:/var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/crash to /home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495186/remote/smithi008/crash 2023-12-17T12:06:53.210 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar c -f - -C /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/crash -- . 2023-12-17T12:06:53.287 INFO:teuthology.orchestra.run.smithi008.stderr:tar: /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/crash: Cannot open: No such file or directory 2023-12-17T12:06:53.287 INFO:teuthology.orchestra.run.smithi008.stderr:tar: Error is not recoverable: exiting now 2023-12-17T12:06:53.291 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/crash to /home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495186/remote/smithi100/crash 2023-12-17T12:06:53.292 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/crash -- . 2023-12-17T12:06:53.372 INFO:teuthology.orchestra.run.smithi100.stderr:tar: /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/crash: Cannot open: No such file or directory 2023-12-17T12:06:53.373 INFO:teuthology.orchestra.run.smithi100.stderr:tar: Error is not recoverable: exiting now 2023-12-17T12:06:53.376 DEBUG:teuthology.misc:Transferring archived files from smithi186:/var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/crash to /home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495186/remote/smithi186/crash 2023-12-17T12:06:53.377 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar c -f - -C /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/crash -- . 2023-12-17T12:06:53.462 INFO:teuthology.orchestra.run.smithi186.stderr:tar: /var/lib/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/crash: Cannot open: No such file or directory 2023-12-17T12:06:53.462 INFO:teuthology.orchestra.run.smithi186.stderr:tar: Error is not recoverable: exiting now 2023-12-17T12:06:53.464 INFO:tasks.cephadm:Checking cluster log for badness... 2023-12-17T12:06:53.465 DEBUG:teuthology.orchestra.run.smithi008:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2023-12-17T12:06:53.548 INFO:teuthology.orchestra.run.smithi008.stderr:grep: /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph.log: No such file or directory 2023-12-17T12:06:53.553 INFO:tasks.cephadm:Compressing logs... 2023-12-17T12:06:53.553 DEBUG:teuthology.orchestra.run.smithi008:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-17T12:06:53.558 DEBUG:teuthology.orchestra.run.smithi100:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-17T12:06:53.562 DEBUG:teuthology.orchestra.run.smithi186:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-12-17T12:06:53.621 INFO:teuthology.orchestra.run.smithi008.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-17T12:06:53.622 INFO:teuthology.orchestra.run.smithi008.stderr:: No such file or directory 2023-12-17T12:06:53.622 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mon.a.log 2023-12-17T12:06:53.623 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mds.g.log 2023-12-17T12:06:53.624 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mds.j.log 2023-12-17T12:06:53.625 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mds.a.log 2023-12-17T12:06:53.626 INFO:teuthology.orchestra.run.smithi100.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-17T12:06:53.626 INFO:teuthology.orchestra.run.smithi100.stderr:: No such file or directory 2023-12-17T12:06:53.627 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-osd.9.log 2023-12-17T12:06:53.627 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-osd.7.log 2023-12-17T12:06:53.628 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-osd.1.log 2023-12-17T12:06:53.629 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-osd.3.log 2023-12-17T12:06:53.629 INFO:teuthology.orchestra.run.smithi008.stderr: 94.6% -- replaced with /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mds.j.log.gz 2023-12-17T12:06:53.629 INFO:teuthology.orchestra.run.smithi100.stderr: 91.6% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-17T12:06:53.630 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mds.h.log 2023-12-17T12:06:53.630 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-osd.9.log: 93.3% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-17T12:06:53.630 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-volume.log 2023-12-17T12:06:53.631 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-volume.log 2023-12-17T12:06:53.631 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mds.k.log 2023-12-17T12:06:53.632 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-osd.0.log 2023-12-17T12:06:53.633 INFO:teuthology.orchestra.run.smithi186.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-12-17T12:06:53.633 INFO:teuthology.orchestra.run.smithi186.stderr:: No such file or directory 2023-12-17T12:06:53.633 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mds.e.log 2023-12-17T12:06:53.634 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-osd.5.log 2023-12-17T12:06:53.635 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mds.d.log 2023-12-17T12:06:53.635 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mon.b.log 2023-12-17T12:06:53.636 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mds.i.log 2023-12-17T12:06:53.636 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-osd.5.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2023-12-17T12:06:53.636 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mds.c.log 2023-12-17T12:06:53.637 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mds.b.log 2023-12-17T12:06:53.637 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mds.f.log 2023-12-17T12:06:53.638 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-osd.0.log: /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-osd.6.log 2023-12-17T12:06:53.638 INFO:teuthology.orchestra.run.smithi008.stderr: 92.7% -- replaced with /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mds.g.log.gz 2023-12-17T12:06:53.639 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mgr.z.log 2023-12-17T12:06:53.639 INFO:teuthology.orchestra.run.smithi008.stderr:gzip -5 --verbose -- /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mgr.x.log 2023-12-17T12:06:53.640 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-osd.11.log 2023-12-17T12:06:53.640 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mon.b.log: /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mgr.y.log 2023-12-17T12:06:53.641 INFO:teuthology.orchestra.run.smithi008.stderr: 94.6% -- replaced with /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mds.d.log.gz 2023-12-17T12:06:53.641 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-osd.2.log 2023-12-17T12:06:53.642 INFO:teuthology.orchestra.run.smithi008.stderr:/var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mgr.x.log: /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-osd.6.log: 92.7% -- replaced with /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mds.a.log.gz 2023-12-17T12:06:53.645 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-osd.11.log: /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-osd.2.log: 91.5% -- replaced with /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mgr.z.log.gz 2023-12-17T12:06:53.646 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-volume.log 2023-12-17T12:06:53.647 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mgr.y.log: 91.1% -- replaced with /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-volume.log.gz 2023-12-17T12:06:53.648 INFO:teuthology.orchestra.run.smithi008.stderr: 91.1% -- replaced with /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-volume.log.gz 2023-12-17T12:06:53.648 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mds.l.log 2023-12-17T12:06:53.648 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-osd.10.log 2023-12-17T12:06:53.649 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mon.c.log 2023-12-17T12:06:53.650 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mds.l.log: 92.8% -- replaced with /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mds.f.log.gz 2023-12-17T12:06:53.650 INFO:teuthology.orchestra.run.smithi100.stderr:gzip -5 --verbose -- /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-osd.4.log 2023-12-17T12:06:53.651 INFO:teuthology.orchestra.run.smithi100.stderr: 91.4% -- replaced with /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mds.k.log.gz 2023-12-17T12:06:53.651 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mon.c.log: 92.9% -- replaced with /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mds.c.log.gz 2023-12-17T12:06:53.652 INFO:teuthology.orchestra.run.smithi100.stderr: 92.4% -- replaced with /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mds.h.log.gz 2023-12-17T12:06:53.653 INFO:teuthology.orchestra.run.smithi186.stderr: 91.1% -- replaced with /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mds.i.log.gz 2023-12-17T12:06:53.653 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-osd.8.log 2023-12-17T12:06:53.654 INFO:teuthology.orchestra.run.smithi100.stderr:/var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-osd.10.log: /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-osd.4.log: 91.1% -- replaced with /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mds.e.log.gz 2023-12-17T12:06:53.655 INFO:teuthology.orchestra.run.smithi100.stderr: 91.4% -- replaced with /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mgr.y.log.gz 2023-12-17T12:06:53.661 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-osd.8.log: 91.1% -- replaced with /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-volume.log.gz 2023-12-17T12:06:53.662 INFO:teuthology.orchestra.run.smithi186.stderr: 91.5% -- replaced with /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mds.l.log.gz 2023-12-17T12:06:53.728 INFO:teuthology.orchestra.run.smithi100.stderr: 92.2% -- replaced with /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mds.b.log.gz 2023-12-17T12:06:53.785 INFO:teuthology.orchestra.run.smithi186.stderr: 92.8% -- replaced with /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-osd.11.log.gz 2023-12-17T12:06:53.799 INFO:teuthology.orchestra.run.smithi008.stderr: 89.1% -- replaced with /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mgr.x.log.gz 2023-12-17T12:06:53.801 INFO:teuthology.orchestra.run.smithi008.stderr: 92.2% -- replaced with /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-osd.9.log.gz 2023-12-17T12:06:53.837 INFO:teuthology.orchestra.run.smithi100.stderr: 91.9% -- replaced with /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mon.b.log.gz 2023-12-17T12:06:53.847 INFO:teuthology.orchestra.run.smithi186.stderr: 92.2% -- replaced with /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-osd.8.log.gz 2023-12-17T12:06:53.858 INFO:teuthology.orchestra.run.smithi186.stderr: 91.9% -- replaced with /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mon.c.log.gz 2023-12-17T12:06:53.868 INFO:teuthology.orchestra.run.smithi100.stderr: 92.1% -- replaced with /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-osd.7.log.gz 2023-12-17T12:06:53.876 INFO:teuthology.orchestra.run.smithi186.stderr: 92.0% -- replaced with /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-osd.5.log.gz 2023-12-17T12:06:53.877 INFO:teuthology.orchestra.run.smithi100.stderr: 92.3% -- replaced with /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-osd.10.log.gz 2023-12-17T12:06:53.894 INFO:teuthology.orchestra.run.smithi008.stderr: 92.2% -- replaced with /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-osd.6.log.gz 2023-12-17T12:06:53.896 INFO:teuthology.orchestra.run.smithi100.stderr: 92.1% -- replaced with /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-osd.4.log.gz 2023-12-17T12:06:53.904 INFO:teuthology.orchestra.run.smithi008.stderr: 92.0% -- replaced with /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-osd.3.log.gz 2023-12-17T12:06:53.907 INFO:teuthology.orchestra.run.smithi008.stderr: 92.1% -- replaced with /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-osd.0.log.gz 2023-12-17T12:06:53.931 INFO:teuthology.orchestra.run.smithi100.stderr: 91.9% -- replaced with /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-osd.1.log.gz 2023-12-17T12:06:53.934 INFO:teuthology.orchestra.run.smithi100.stderr: 2023-12-17T12:06:53.934 INFO:teuthology.orchestra.run.smithi100.stderr:real 0m0.335s 2023-12-17T12:06:53.934 INFO:teuthology.orchestra.run.smithi100.stderr:user 0m1.264s 2023-12-17T12:06:53.934 INFO:teuthology.orchestra.run.smithi100.stderr:sys 0m0.183s 2023-12-17T12:06:53.965 INFO:teuthology.orchestra.run.smithi186.stderr: 91.9% -- replaced with /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-osd.2.log.gz 2023-12-17T12:06:53.969 INFO:teuthology.orchestra.run.smithi186.stderr: 2023-12-17T12:06:53.969 INFO:teuthology.orchestra.run.smithi186.stderr:real 0m0.366s 2023-12-17T12:06:53.969 INFO:teuthology.orchestra.run.smithi186.stderr:user 0m1.082s 2023-12-17T12:06:53.969 INFO:teuthology.orchestra.run.smithi186.stderr:sys 0m0.177s 2023-12-17T12:06:54.025 INFO:teuthology.orchestra.run.smithi008.stderr: 90.8% -- replaced with /var/log/ceph/f43f508a-9cd2-11ee-95a5-87774f69a715/ceph-mon.a.log.gz 2023-12-17T12:06:54.027 INFO:teuthology.orchestra.run.smithi008.stderr: 2023-12-17T12:06:54.027 INFO:teuthology.orchestra.run.smithi008.stderr:real 0m0.433s 2023-12-17T12:06:54.027 INFO:teuthology.orchestra.run.smithi008.stderr:user 0m1.483s 2023-12-17T12:06:54.027 INFO:teuthology.orchestra.run.smithi008.stderr:sys 0m0.184s 2023-12-17T12:06:54.028 INFO:tasks.cephadm:Archiving logs... 2023-12-17T12:06:54.028 DEBUG:teuthology.misc:Transferring archived files from smithi008:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495186/remote/smithi008/log 2023-12-17T12:06:54.029 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-17T12:06:54.277 DEBUG:teuthology.misc:Transferring archived files from smithi100:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495186/remote/smithi100/log 2023-12-17T12:06:54.278 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-17T12:06:54.516 DEBUG:teuthology.misc:Transferring archived files from smithi186:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495186/remote/smithi186/log 2023-12-17T12:06:54.517 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-17T12:06:54.729 INFO:tasks.cephadm:Removing cluster... 2023-12-17T12:06:54.729 DEBUG:teuthology.orchestra.run.smithi008:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 --force 2023-12-17T12:06:55.041 INFO:teuthology.orchestra.run.smithi008.stdout:Deleting cluster with fsid: f43f508a-9cd2-11ee-95a5-87774f69a715 2023-12-17T12:06:55.518 DEBUG:teuthology.orchestra.run.smithi100:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 --force 2023-12-17T12:06:55.824 INFO:teuthology.orchestra.run.smithi100.stdout:Deleting cluster with fsid: f43f508a-9cd2-11ee-95a5-87774f69a715 2023-12-17T12:06:56.291 DEBUG:teuthology.orchestra.run.smithi186:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f43f508a-9cd2-11ee-95a5-87774f69a715 --force 2023-12-17T12:06:56.607 INFO:teuthology.orchestra.run.smithi186.stdout:Deleting cluster with fsid: f43f508a-9cd2-11ee-95a5-87774f69a715 2023-12-17T12:06:57.091 INFO:tasks.cephadm:Removing cephadm ... 2023-12-17T12:06:57.091 DEBUG:teuthology.orchestra.run.smithi008:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-17T12:06:57.141 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-17T12:06:57.190 DEBUG:teuthology.orchestra.run.smithi186:> rm -rf /home/ubuntu/cephtest/cephadm 2023-12-17T12:06:57.235 INFO:tasks.cephadm:Teardown complete 2023-12-17T12:06:57.236 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-17T12:06:57.244 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-17T12:06:57.244 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-17T12:06:57.249 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-17T12:06:57.254 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-17T12:06:57.416 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-17T12:06:57.425 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-17T12:06:57.425 DEBUG:teuthology.orchestra.run.smithi008:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-17T12:06:57.430 DEBUG:teuthology.orchestra.run.smithi100:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-17T12:06:57.434 DEBUG:teuthology.orchestra.run.smithi186:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-17T12:06:57.468 INFO:teuthology.orchestra.run.smithi008.stderr:bash: ntpq: command not found 2023-12-17T12:06:57.472 INFO:teuthology.orchestra.run.smithi100.stderr:bash: ntpq: command not found 2023-12-17T12:06:57.475 INFO:teuthology.orchestra.run.smithi186.stderr:bash: ntpq: command not found 2023-12-17T12:06:57.476 INFO:teuthology.orchestra.run.smithi008.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-17T12:06:57.476 INFO:teuthology.orchestra.run.smithi008.stdout:=============================================================================== 2023-12-17T12:06:57.476 INFO:teuthology.orchestra.run.smithi008.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 51 +1430us[+1430us] +/- 85ms 2023-12-17T12:06:57.476 INFO:teuthology.orchestra.run.smithi008.stdout:^* hv02.front.sepia.ceph.com 3 7 377 52 +216us[ +219us] +/- 65ms 2023-12-17T12:06:57.477 INFO:teuthology.orchestra.run.smithi008.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 52 -1744us[-1744us] +/- 88ms 2023-12-17T12:06:57.477 INFO:teuthology.orchestra.run.smithi008.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-12-17T12:06:57.480 INFO:teuthology.orchestra.run.smithi100.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-17T12:06:57.480 INFO:teuthology.orchestra.run.smithi100.stdout:=============================================================================== 2023-12-17T12:06:57.480 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 52 +1427us[+1427us] +/- 85ms 2023-12-17T12:06:57.480 INFO:teuthology.orchestra.run.smithi100.stdout:^* hv02.front.sepia.ceph.com 3 6 377 55 +224us[ +259us] +/- 65ms 2023-12-17T12:06:57.480 INFO:teuthology.orchestra.run.smithi100.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 54 -1743us[-1743us] +/- 88ms 2023-12-17T12:06:57.480 INFO:teuthology.orchestra.run.smithi100.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-12-17T12:06:57.483 INFO:teuthology.orchestra.run.smithi186.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-17T12:06:57.483 INFO:teuthology.orchestra.run.smithi186.stdout:=============================================================================== 2023-12-17T12:06:57.483 INFO:teuthology.orchestra.run.smithi186.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 51 +1410us[+1447us] +/- 85ms 2023-12-17T12:06:57.483 INFO:teuthology.orchestra.run.smithi186.stdout:^* hv02.front.sepia.ceph.com 3 6 377 51 +223us[ +259us] +/- 49ms 2023-12-17T12:06:57.483 INFO:teuthology.orchestra.run.smithi186.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 51 -1747us[-1747us] +/- 88ms 2023-12-17T12:06:57.484 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-12-17T12:06:57.484 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-17T12:06:57.493 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-17T12:06:57.494 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-17T12:06:57.502 DEBUG:teuthology.orchestra.run.smithi008:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-17T12:06:57.649 DEBUG:teuthology.orchestra.run.smithi100:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-17T12:06:57.773 DEBUG:teuthology.orchestra.run.smithi186:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-17T12:06:57.899 DEBUG:teuthology.orchestra.run.smithi008:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-17T12:06:57.972 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-17T12:06:57.972 DEBUG:teuthology.orchestra.run.smithi100:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-17T12:06:58.043 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-17T12:06:58.044 DEBUG:teuthology.orchestra.run.smithi186:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-17T12:06:58.116 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-17T12:06:58.116 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-17T12:06:58.125 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-17T12:06:58.134 INFO:teuthology.task.internal:Duration was 1535.094976 seconds 2023-12-17T12:06:58.134 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-17T12:06:58.143 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-17T12:06:58.143 DEBUG:teuthology.orchestra.run.smithi008:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-17T12:06:58.148 DEBUG:teuthology.orchestra.run.smithi100:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-17T12:06:58.152 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-17T12:06:58.263 INFO:teuthology.orchestra.run.smithi008.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-17T12:06:58.264 INFO:teuthology.orchestra.run.smithi100.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-17T12:06:58.270 INFO:teuthology.orchestra.run.smithi186.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-17T12:06:58.532 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-17T12:06:58.533 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi008.front.sepia.ceph.com 2023-12-17T12:06:58.533 DEBUG:teuthology.orchestra.run.smithi008:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-17T12:06:58.593 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi100.front.sepia.ceph.com 2023-12-17T12:06:58.593 DEBUG:teuthology.orchestra.run.smithi100:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-17T12:06:58.651 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi186.front.sepia.ceph.com 2023-12-17T12:06:58.651 DEBUG:teuthology.orchestra.run.smithi186:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-17T12:06:58.709 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-17T12:06:58.710 DEBUG:teuthology.orchestra.run.smithi008:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-17T12:06:58.716 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-17T12:06:58.721 DEBUG:teuthology.orchestra.run.smithi186:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-17T12:06:58.804 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-17T12:06:58.804 DEBUG:teuthology.orchestra.run.smithi008:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-17T12:06:58.809 DEBUG:teuthology.orchestra.run.smithi100:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-17T12:06:58.813 DEBUG:teuthology.orchestra.run.smithi186:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-17T12:06:58.937 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-17T12:06:58.946 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-17T12:06:58.947 DEBUG:teuthology.orchestra.run.smithi008:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-17T12:06:59.016 DEBUG:teuthology.orchestra.run.smithi100:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-17T12:06:59.084 DEBUG:teuthology.orchestra.run.smithi186:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-17T12:06:59.154 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-17T12:06:59.164 DEBUG:teuthology.orchestra.run.smithi008:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-17T12:06:59.169 DEBUG:teuthology.orchestra.run.smithi100:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-17T12:06:59.173 DEBUG:teuthology.orchestra.run.smithi186:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-17T12:06:59.233 INFO:teuthology.orchestra.run.smithi008.stdout:kernel.core_pattern = core 2023-12-17T12:06:59.236 INFO:teuthology.orchestra.run.smithi100.stdout:kernel.core_pattern = core 2023-12-17T12:06:59.241 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern = core 2023-12-17T12:06:59.305 DEBUG:teuthology.orchestra.run.smithi008:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-17T12:06:59.346 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-17T12:06:59.346 DEBUG:teuthology.orchestra.run.smithi100:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-17T12:06:59.387 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-17T12:06:59.387 DEBUG:teuthology.orchestra.run.smithi186:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-17T12:06:59.428 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-17T12:06:59.429 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-17T12:06:59.440 INFO:teuthology.task.internal:Transferring archived files... 2023-12-17T12:06:59.440 DEBUG:teuthology.misc:Transferring archived files from smithi008:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495186/remote/smithi008 2023-12-17T12:06:59.441 DEBUG:teuthology.orchestra.run.smithi008:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-17T12:06:59.518 DEBUG:teuthology.misc:Transferring archived files from smithi100:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495186/remote/smithi100 2023-12-17T12:06:59.519 DEBUG:teuthology.orchestra.run.smithi100:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-17T12:06:59.594 DEBUG:teuthology.misc:Transferring archived files from smithi186:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495186/remote/smithi186 2023-12-17T12:06:59.594 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-17T12:06:59.671 INFO:teuthology.task.internal:Removing archive directory... 2023-12-17T12:06:59.671 DEBUG:teuthology.orchestra.run.smithi008:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-17T12:06:59.676 DEBUG:teuthology.orchestra.run.smithi100:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-17T12:06:59.680 DEBUG:teuthology.orchestra.run.smithi186:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-17T12:06:59.724 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-17T12:06:59.738 INFO:teuthology.task.internal:Not uploading archives. 2023-12-17T12:06:59.738 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-17T12:06:59.748 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-17T12:06:59.748 DEBUG:teuthology.orchestra.run.smithi008:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-17T12:06:59.760 DEBUG:teuthology.orchestra.run.smithi100:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-17T12:06:59.764 DEBUG:teuthology.orchestra.run.smithi186:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-17T12:06:59.799 INFO:teuthology.orchestra.run.smithi008.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 17 12:06 /home/ubuntu/cephtest 2023-12-17T12:06:59.803 INFO:teuthology.orchestra.run.smithi100.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 17 12:06 /home/ubuntu/cephtest 2023-12-17T12:06:59.808 INFO:teuthology.orchestra.run.smithi186.stdout: 655373 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 17 12:06 /home/ubuntu/cephtest 2023-12-17T12:06:59.811 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-17T12:06:59.822 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-17T12:06:59.842 INFO:teuthology.nuke:Checking targets against current locks 2023-12-17T12:06:59.869 DEBUG:teuthology.nuke:shortname: smithi008 2023-12-17T12:06:59.869 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-17T12:06:59.893 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi008.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495186', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-17 11:21:31.545159', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOX94aMeRrAKfYj3aVLUbfkXRSEVAi4taiUJYa9mnBG81kycTeEXy3BI1pxu1B8kLXQq/pzkn0FyYtX96RaDplw='} 2023-12-17T12:06:59.897 DEBUG:teuthology.nuke:shortname: smithi100 2023-12-17T12:06:59.897 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-17T12:06:59.926 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi100.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495186', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-17 11:21:31.543191', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJbs4lzcAzApz1BJNzcKvPKXHFEKi9kRHbWImBeDT0Cp+gzkn5ZsY9c4eqJm6PaBiuO/hpo1LxYWQVFdF5rq+LU='} 2023-12-17T12:06:59.929 DEBUG:teuthology.nuke:shortname: smithi186 2023-12-17T12:06:59.930 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-17T12:06:59.953 INFO:teuthology.orchestra.console.smithi008:Power off 2023-12-17T12:06:59.954 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-17T12:06:59.965 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-17_11:19:43-fs-rishabh-2023dec11-testing-default-smithi/7495186', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-17 11:21:31.546922', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPhO1Ffo4DoojJMi/vqST8+CWXg8BJFJlMJgLpjrHSk/KG4AGUy+kCQnllGrmpkYVEYgL+uZLxEZ8+FqnZPxkMw='} 2023-12-17T12:06:59.978 DEBUG:teuthology.orchestra.console.smithi008:power off output: Chassis Power Control: Down/Off 2023-12-17T12:06:59.978 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T12:06:59.996 INFO:teuthology.orchestra.console.smithi100:Power off 2023-12-17T12:06:59.997 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-17T12:07:00.009 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2023-12-17T12:07:00.017 DEBUG:teuthology.orchestra.console.smithi100:power off output: Chassis Power Control: Down/Off 2023-12-17T12:07:00.017 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T12:07:00.031 INFO:teuthology.orchestra.console.smithi186:Power off 2023-12-17T12:07:00.032 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-17T12:07:00.041 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2023-12-17T12:07:00.052 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off 2023-12-17T12:07:00.052 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T12:07:00.072 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-12-17T12:07:04.009 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T12:07:04.042 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T12:07:04.073 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T12:07:04.119 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is on 2023-12-17T12:07:04.152 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2023-12-17T12:07:04.183 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-12-17T12:07:08.125 DEBUG:teuthology.orchestra.console.smithi008:pexpect command: ipmitool -H smithi008.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T12:07:08.152 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T12:07:08.185 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T12:07:08.234 DEBUG:teuthology.orchestra.console.smithi008:check power output: Chassis Power is off 2023-12-17T12:07:08.263 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is on 2023-12-17T12:07:08.293 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2023-12-17T12:07:08.336 INFO:teuthology.orchestra.console.smithi008:Power off completed 2023-12-17T12:07:12.269 DEBUG:teuthology.orchestra.console.smithi100:pexpect command: ipmitool -H smithi100.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T12:07:12.294 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-17T12:07:12.379 DEBUG:teuthology.orchestra.console.smithi100:check power output: Chassis Power is off 2023-12-17T12:07:12.402 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2023-12-17T12:07:12.480 INFO:teuthology.orchestra.console.smithi100:Power off completed 2023-12-17T12:07:12.503 INFO:teuthology.orchestra.console.smithi186:Power off completed 2023-12-17T12:07:12.608 INFO:teuthology.run:Summary data: description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/5 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/kernel_untar_build}} duration: 1535.094976425171 failure_reason: No module named 'tasks.fs' flavor: default mon.a-kernel-sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c mon.b-kernel-sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c mon.c-kernel-sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c owner: scheduled_rishabh@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=07e4202d99c84f2b84d592a0b99091ca status: fail success: false 2023-12-17T12:07:12.608 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-17T12:07:12.689 INFO:teuthology.run:FAIL